TWI723946B - Image recognition system for generating passbook image containing color block - Google Patents

Abstract

An image recognition system, for generating passbook image containing color block, includes a server, a camera, and an image processing device. The server contains an amount database and an analysis module. The camera device is used to capture the passbook image. The image processing device is communicatively coupled to the camera device and the server. The image processing device includes a signal receiving unit, an identification unit, an analyzing unit, and an image processing unit. The signal receiving unit receives the passbook image. The identification unit identifies a plurality of fields in which the amount of money is recorded in the passbook image. The analysis unit receives the amount database and compares the amount in the field with the amount database to generate a coloring indication. The image processing unit generates a plurality of color patches in accordance with the coloring instructions to replace the fields. The analysis module of the server receives the passbook image containing the color patches from the image processing device.

Description

Image recognition system capable of generating passbook images with color blocks

The present invention relates to an image recognition system, in particular to an image recognition system that helps determine the customer's deposit balance.

Financial management is a very important concept in the current society. Especially in a capital society, how to accumulate capital through financial management is a very important knowledge. For the financial industry, how to evaluate a client's financial resources to recommend suitable financial products or financial services for the client has become an important issue.

For some financial companies, customer deposits are an important indicator of their financial strength. More specifically, if a customer deposits a larger amount of money in the account during a certain period, the financial industry can reasonably expect the customer to have a higher level of financial resources.

Some financial industry players would like to try to help assess the financial strength of customers based on customer deposit records. However, in the process of judging a customer's financial level, the deposit record may be hacked because it is transmitted between multiple devices.

In view of the above problems, the present invention discloses an image recognition system, which helps to solve the problem that the customer's deposit record is easily hacked in the process of assessing the financial level.

The image recognition system capable of generating passbook images with color blocks disclosed in the present invention includes a server, a camera device, an image processing device, and a display device. The server includes an amount database and an analysis module. The camera device is used to capture an image of a passbook. The image processing device is connected to the camera device and the server in communication. The image processing device includes a signal receiving unit, an identification unit, an analysis unit, and an image processing unit. The signal receiving unit receives the passbook image. The identification unit recognizes multiple fields in the passbook image with the amount recorded and divides the fields into multiple deposit fields and multiple withdrawal fields. The analysis unit receives the amount database and compares the amount in the field with the amount database to generate a coloring instruction. The image processing unit generates multiple color blocks according to the coloring instructions to replace these gold deposit fields respectively. The display device is communicatively connected to the image processing device, and when part of the fields of the passbook image cannot be recognized by the identification unit, the display device receives and displays the passbook image containing color blocks. The image processing unit removes the pixels that constitute the deposit field in the passbook image, and fills in color blocks in the area where the pixels are removed to replace the deposit field. The analysis module of the server receives the passbook image containing these color blocks from the image processing device.

According to the image recognition system disclosed in the present invention, the image processing unit generates color blocks according to the coloring instructions to replace the fields that record the corresponding amount. In this way, in the process of evaluating the financial level of the customer based on the image of the passbook, the color block realizes the encryption of the amount, which helps prevent the risk of the amount directly leaking when the image recognition system 1 is hacked. In other words, even in the process of passing the passbook image to the server or image processing device by the camera, the passbook image is unfortunately hacked. Because the fields have been replaced with color blocks with specific colors or specific grayscales, hacking The party with the image of the passbook also cannot know the actual amount deposited into the account.

The above description of the disclosure and the following description of the implementation manners are used to demonstrate and explain the spirit and principle of the present invention, and to provide a further explanation of the patent application scope of the present invention.

The detailed features and advantages of the present invention will be described in detail in the following embodiments. The content is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and in accordance with the content disclosed in this specification, the scope of patent application and the drawings. Anyone who is familiar with relevant skills can easily understand the purpose and advantages of the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention by any viewpoint.

Please refer to FIG. 1, which is a schematic diagram of an image recognition system according to an embodiment of the present invention. In this embodiment, the image recognition system 1 includes a server 10, a camera device 20, and an image processing device 30.

The server 10 includes an amount database 110 and an analysis module 120. The amount database 110 includes, for example, numeric characters or numeric fonts for identifying numbers. The amount database 110 may be stored in the hard disk of the server 10. The analysis module 120 is, for example, an electronic component including a processor.

The camera device 20 is, for example, a network monitor or a camera, which is used to capture an image of a passbook. 2 is an image of a passbook before some fields are replaced by color blocks according to an embodiment of the present invention. The passbook image contains multiple deposit fields C1 and multiple withdrawal fields C2.

The image processing device 30 is communicatively connected to the camera device 20 and the server 10. The image processing device 30 includes a signal receiving unit 310, an identification unit 320, an analysis unit 330, and an image processing unit 340.

The signal receiving unit 310 is, for example, a wireless receiver, which is used to receive the passbook image output by the camera device 20 to the image processing device 30. The recognition unit 320 is, for example, a device or a processor installed with optical character recognition (OCR) software, and is used to recognize multiple fields in the passbook image that have the amount recorded. As shown in FIG. 2, in this embodiment, the field refers to the deposit field C1, and the identification unit 320 recognizes the amount in the deposit field C1.

In one embodiment, the recognition unit 320 recognizes the deposit field C1 by using a fixed position as the deposit field. For example, the deposit field in the existing passbook is usually located in the fourth row, so the recognition unit 320 recognizes The fields in the fourth column are used as deposit fields. In another embodiment, the identification unit 320 can identify the deposit field through the text in the first row of the field. For example, the identification unit 320 can identify if there are "deposit", "deposit", "deposit" in the first line of the field. "", "DEPOSIT" and other characteristic words, all the corresponding fields in this row are used as deposit fields.

The analysis unit 330 is, for example, an electronic component including a processor, which is used to receive the amount database 110 and compare the amount in the deposit field C1 with the amount database 110 to generate a coloring instruction. In detail, after the identification unit 320 identifies the amount in the deposit field C1, the analysis unit 330 compares the amount database 110 with the numeric characters of the amount to confirm the amount. In the amount database 110, the representative colors corresponding to different amounts of money are further included. For example, thousand yuan (amount with four digits before the decimal point) is represented by red, and ten thousand yuan (amount with five digits before the decimal point) It is represented by blue, but the present invention is not limited to this. The analysis unit 330 confirms the amount of money in the deposit field C1, and the analysis unit 330 generates a coloring instruction. For example, in some of the deposit fields C1 of FIG. 2, the amount of four digits before the decimal point is recorded, so the analysis unit 330 generates a red color block (for example, color code #CC0000) to replace these deposit fields C1 The coloring instructions. In addition, several deposit fields C1 record amounts with five digits before the decimal point, so the analysis unit 330 generates a blue color block (for example, color code #0000CC) to replace these deposit fields C1 with coloring instructions.

The image processing unit 340 is, for example, a device or a processor installed with image processing software, and generates color blocks according to the aforementioned coloring instructions to replace the deposit field C1 corresponding to the four-digit amount. Please also refer to Figure 3, which is a schematic diagram showing that the fields of the passbook image in Figure 2 are replaced by color blocks. After the image processing unit 340 receives the coloring instruction from the analysis unit 330, it generates a corresponding coloring instruction color block to replace the gold column C1. For example, the image processing unit 340 receives the coloring instructions for replacing the fields with red and blue generated by the aforementioned analysis unit 330, and then generates a plurality of red color blocks B1 and a plurality of blue color blocks B2 to replace these gold deposit fields C1. .

In this embodiment, replacing the deposit field C1 with a color block refers to removing a plurality of pixels that constitute the deposit field C1 in the original passbook image. Then, a plurality of red (blue) pixels are filled in to form a red color block B1 (blue color block B2) with the same area as the gold column C1, to replace the removed pixels, and then obtain a red color block B1 and blue The new passbook image of color block B2.

The analysis module 120 of the server 10 receives the passbook image containing the red color block B1 and the blue color block B2 from the image processing device 30, and the analysis module 120 compares the red color block B1 and the blue color block B2 with the amount database Therefore, the estimated amount can be obtained, and then the financial level indicators of the client can be evaluated. For example, the analysis module 120 analyzes that the passbook image contains ten red color blocks B1 and fifteen blue color blocks B2, so it can be estimated that the amount originally included in the deposit field C1 replaced by the red color block B1 is The amount originally calculated in the deposit column C1 that is 1000~9999 yuan and replaced by the blue color block B2 is 10000~99999 yuan. Therefore, it can be estimated that the amount of the customer's deposit in the account is about 100,000 to hundreds of thousands, so that the financial industry can evaluate the customer's financial level according to a customized measurement standard.

In the process of evaluating customer spending preferences based on passbook information, the red color block B1 and blue color block B2 can replace the deposit field C1, which helps prevent the risk of direct leakage of the deposit amount when the image recognition system 1 is hacked. In other words, even in the process of transmitting the camera device 20 to the server 10 or the image processing device 30, the passbook image is unfortunately hacked, because the deposit field C1 has been replaced by the red color block B1 and the blue color block B2. Encrypted, the party who hacked the passbook image could not know the actual amount deposited into the account.

In another embodiment, the gray scale difference of the color blocks can be further used to more accurately estimate the amount of money in the gold column C1 based on the color blocks. Please refer to FIGS. 4 and 5, which are schematic diagrams showing that the fields of the passbook image are replaced by color blocks according to another embodiment of the present invention.

Different from the embodiment in FIG. 3, in this embodiment, the amount database 110 further includes the gray levels corresponding to different amounts of money, such as thousand yuan (amount with four digits before the decimal point). The first gray scale represents ten thousand yuan (a sum of five digits before the decimal point) is represented by a second gray scale that is different from the first gray scale, but the present invention is not limited to this. In addition, in this embodiment, the amount database 110 contains colors corresponding to different numeric characters. For example, when the number is 1, it is represented by red, and when the number is 6, it is represented by blue. However, the present invention does not take this as limit.

The analysis unit 330 compares the amount database 110 with the amount. The analysis unit 330 confirms the digits of the amount in the deposit field C1 and the highest digit of the digital character, and generates a coloring instruction. For example, in one of the deposit fields C11 of FIG. 4, it is recorded that there are four digits before the decimal point and the highest digit is 1, so the analysis unit 330 generates a red color block with the first grayscale to replace this The coloring instructions of C11 in the deposit field. Another deposit field C12 records the amount with four digits before the decimal point and the highest digit is 6, so the analysis unit 330 generates a blue color block with the first gray scale to replace this deposit field C12 coloring instructions . Another deposit field C13 records the amount with five digits before the decimal point and the highest digit is 6, so the analysis unit 330 generates a blue color block with the second gray scale to replace the coloring of this deposit field C13 Instructions.

After the image processing unit 340 receives the coloring instruction from the analysis unit 330, it generates a corresponding coloring instruction color block to replace the gold deposit field. For example, the image processing unit 340 receives the coloring instructions generated by the aforementioned analysis unit 330, and then generates a red color block B11 with the first gray scale instead of the gold field C11, and generates a blue color block B21 with the first gray scale. Replace the deposit field C12, and generate a blue color block B22 with the second grayscale to replace the deposit field C13. In this embodiment, the first gray scale is higher than the second gray scale, so the red color block B11 may be a light red color block (for example, color code #FF0088), and the blue color block B21 may be a light blue color block ( For example, the color code #33CCFF), and the blue color block B22 may be a dark blue color block (for example, the color code #0000CC).

In this embodiment, the analysis unit 330 of the image processing device 30 not only analyzes the digits of the amount of money in the deposit field, but also further analyzes the highest digits of the amount of money. In this way, the generated color blocks that replace the deposit field can more accurately represent the size of the original amount. Specifically, when the analysis module 120 of the server 10 analyzes the color block in the passbook image, it can not only know the highest digit of the original amount according to the color of the color block, but also know the original amount according to the gray scale of the color block. The number of digits. In this way, the exact amount of the customer's deposit into the account can be more accurately inferred, and the result of evaluating the customer's financial level can be more credible.

For example, the analysis module 120 can estimate that the amount originally included in the deposit field C1 replaced by the red color block B11 is 1000~1999 yuan, and the amount originally included in the deposit field C1 replaced by the blue color block B21 The amount is 6000~6999, and the amount originally calculated in the deposit field C1 replaced by the blue color block B22 is 60000~69999 yuan.

In the foregoing embodiment, color blocks of different colors or different gray scales are used to cover the deposit fields with different amounts of money, but the present invention is not limited to this. FIG. 6 is a schematic diagram showing that the fields of the passbook image are replaced by color blocks according to still another embodiment of the present invention. The analysis unit 330 can generate color blocks with different patterns to cover the gold field. As shown in FIG. 6, the analysis unit 330 confirms that there is an amount of four digits before the decimal point in the deposit column C1, and therefore generates a coloring instruction to replace the deposit column with a dot pattern. In addition, the analysis unit 330 confirms that there is an amount of five digits before the decimal point in another deposit field C1, and therefore generates a coloring instruction that replaces the deposit field with a diagonal pattern. The image processing unit 340 generates a halftone pattern color block B3 and an oblique line pattern color block B4 according to the coloring instructions to replace the two previous gold deposit fields C1, respectively.

In one embodiment, the image recognition system further includes a display device communicatively connected to the image processing device. 1, the image recognition system 1 further includes a display device 40 communicatively connected to the image processing device 30, and the display device 40 is, for example, a display. When some fields of the passbook image cannot be recognized by the recognition unit 320, after the image processing unit 340 generates the color block replacement field, the image processing device 30 outputs the passbook image containing the color block to the display device 40. The display device 40 receives and displays the passbook image. In this way, the industry can review the passbook image containing the color blocks, and manually replace the fields that cannot be recognized by the recognition unit 320 with color blocks.

In one embodiment, before the image processing unit generates multiple color blocks to replace multiple fields respectively, the image processing unit binarizes the passbook image. In this way, the success rate of the recognition unit in recognizing the digits of the amount of money and the numeric characters can be improved.

To sum up, in the image recognition system disclosed in the present invention, the image processing unit generates color blocks according to the coloring instructions to replace the fields that record the corresponding amount. In this way, in the process of evaluating the financial level of the customer based on the image of the passbook, the color block realizes the encryption of the amount, which helps prevent the risk of the amount directly leaking when the image recognition system 1 is hacked. In other words, even in the process of passing the passbook image to the server or image processing device by the camera, the passbook image is unfortunately hacked. Because the fields have been replaced with color blocks with specific colors or specific grayscales, hacking The party with the image of the passbook also cannot know the actual amount deposited into the account.

Although the present invention is disclosed above with the foregoing embodiments, these embodiments are not intended to limit the present invention. All changes and modifications made without departing from the spirit and scope of the present invention fall within the scope of the patent protection of the present invention. For the scope of protection defined by the present invention, please refer to the attached scope of patent application.

Image recognition system 1 Server 10 Amount database 110 Analysis module 120 Camera device 20 Image processing device 30 Signal receiving unit 310 Identification unit 320 Analysis unit 330 Image processing unit 340 Display device 40 Red color block B1, B11 Blue color block B2, B21, B22 Dot pattern color block B3 Diagonal pattern color block B4 Deposit field C1, C11, C12, C13 Withdrawal field C2

FIG. 1 is a schematic diagram of an image recognition system according to an embodiment of the invention. 2 is an image of a passbook before some fields are replaced by color blocks according to an embodiment of the present invention. FIG. 3 is a schematic diagram showing that the fields of the passbook image in FIG. 2 are replaced by color blocks. 4 and 5 are schematic diagrams showing that the fields of the passbook image are replaced by color blocks according to another embodiment of the present invention. FIG. 6 is a schematic diagram showing that the fields of the passbook image are replaced by color blocks according to still another embodiment of the present invention.

Image recognition system 1 Server 10 Amount database 110 Analysis module 120 Camera device 20 Image processing device 30 Signal receiving unit 310 Identification unit 320 Analysis unit 330 Image processing unit 340 Display device 40

Claims (6)

An image recognition system capable of generating passbook images with color blocks, comprising: a server, including an amount database and an analysis module; a camera device for capturing an image of a passbook; an image processing device, and a communication connection In the camera device and the server, the image processing device includes a signal receiving unit, an identification unit, an analysis unit, and an image processing unit. The signal receiving unit receives the passbook image, and the identification unit recognizes the record in the passbook image There are multiple fields for the amount and the fields are divided into multiple deposit fields and multiple withdrawal fields, the analysis unit receives the amount database and the amount in these fields is compared with the amount database A coloring instruction is generated by comparison. The image processing unit removes a plurality of pixels constituting the deposit fields in the passbook image according to the coloring instruction, and generates a plurality of color blocks to fill in the area where the pixels are removed to Respectively replace the deposit fields; and a display device, which is communicatively connected to the image processing device. When some of the fields of the passbook image are not recognized by the identification unit, the display device receives and displays the color Block the passbook image; wherein, the analysis module of the server receives the passbook image containing the color blocks from the image processing device. The image recognition system according to claim 1, wherein before the image processing unit generates the color blocks to replace the deposit fields respectively, the image processing unit performs binarization processing on the passbook image. The image recognition system according to claim 1, wherein at least two of the color blocks have different colors. The image recognition system according to claim 1, wherein at least two of the color blocks have different patterns. The image recognition system according to claim 1, wherein the amount database includes gray scales corresponding to different digits and colors, and the analysis unit receives the amount database and places them in the fields The digits of the amount and the highest digit are compared with the amount database to generate the coloring instruction. The image recognition system according to claim 1, wherein the analysis module of the server compares the color blocks with the amount database to obtain the estimated amount.

Images