JP2022069813A - Character reader and inspection device - Google Patents

Abstract

To provide a character reader and an inspection device capable of improving character recognition accuracy regardless of a state of a character contained in image data.SOLUTION: A character reader includes: an acquisition unit that acquires image data including a character; a converter that changes a length-to-width ratio (aspect ratio) of a character contained in the image data by changing vertical and horizontal magnification of the image data; and an analysis unit that performs OCR processing on image data whose magnification is changed by the converter and recognizes the character contained in the image data.SELECTED DRAWING: Figure 3

Description

The present invention relates to a character reading device and an inspection device.

Conventionally, OCR processing (optical character recognition processing) may be performed on image data. For example, Patent Document 1 below describes that when the image data of a manuscript in which a plurality of character sizes are mixed is scaled, image processing is performed so that the character size is appropriate for each area. In the following Patent Document 1, the image is converted for each area so that the character size for each area becomes the specified character size.

Japanese Unexamined Patent Publication No. 2010-322644

For example, when an area in which characters are printed is fixed, such as a product label, vertically or horizontally long characters may be printed in the above area depending on the number of characters to be printed. When OCR processing is performed on image data including such characters, the accuracy of character recognition may be poor. In this case, for example, even if the character size is changed as shown in Patent Document 1, it may be difficult to improve the accuracy of character recognition.

An object of one aspect of the present invention is to provide a character reading device and an inspection device capable of improving character recognition accuracy regardless of the state of characters contained in image data.

The character reading device according to one aspect of the present invention has an acquisition unit for acquiring image data including characters and an aspect ratio of characters included in the image data by changing the vertical and horizontal magnifications of the image data. It includes a conversion unit for changing, and an analysis unit for performing OCR processing on image data whose magnification has been changed by the conversion unit and recognizing characters included in the image data.

According to this character reading device, the conversion unit changes the aspect ratio of the characters included in the image data by changing the vertical and horizontal magnifications of the image data. This makes it possible to change the aspect ratio and size of the characters included in the image data so that they can be easily recognized by the analysis unit. Therefore, by using the character reading device, the character recognition accuracy can be improved regardless of the state of the characters included in the image data.

The image data includes the first image data of the label on which the product information is printed, and the aspect ratio of at least a part of the characters printed on the label is such that the character string of the product information fits in the print field of the label. , The conversion unit may change the vertical and horizontal magnifications of the first image data so that the characters whose aspect ratio has been changed become the characters having the original aspect ratio. In this case, each process is performed after the characters included in the first image data and whose aspect ratio has been changed are changed to a state in which they can be easily recognized by the analysis unit. Therefore, the character recognition accuracy for the first image data can be improved.

The character reading device includes a specific unit that identifies the product information printed on the label from the product code attached to the form, and the character string recognized by the analysis unit includes the character string of the product information specified by the specific unit. A determination unit for determining whether or not the product may be used may be further provided. In this case, the determination accuracy by the determination unit can be improved.

The character reading device further includes a reading unit for reading the product code attached to the form, and a storage unit for storing the product code and the product information specified in association with the product code, and the specific unit reads. The product information associated with the product code read by the unit may be read from the storage unit and output to the determination unit. In this case, the determination by the determination unit can be speeded up.

The product information may include at least one of a product name, an amount of money, an expiration date, and a raw material name.

The inspection device according to one aspect of the present invention includes the above-mentioned character reading device, a label affixed to a product is affixed to the form, and the acquisition unit includes a camera for taking an image of the form, and the image pickup data of the camera. The first image data is acquired from the above, and the correctness of the product information printed on the label attached to the form and the product information specified from the product code is notified. In this inspection device, the character recognition accuracy of the first image data can be improved by using the character reading device. Therefore, the inspection device can accurately notify the correctness of the product information printed on the label and the product information specified from the product code.

According to one aspect of the present invention, it is possible to provide a character reading device and an inspection device capable of improving character recognition accuracy regardless of the state of characters included in image data.

FIG. 1 is a block diagram showing a configuration of a label affixing device according to an embodiment. FIG. 2 is a diagram showing an example of a form. FIG. 3A is a diagram showing an example of a sample label, and FIG. 3B is a diagram showing an example of a product label. FIG. 4 is a block diagram showing a configuration of an inspection device according to an embodiment. FIG. 5 is a perspective view of the terminal device of FIG. FIG. 6 is a flowchart showing a flow of inspection processing executed by the inspection apparatus of FIG. FIG. 7 is a flowchart showing a flow of inspection processing executed by the inspection apparatus of FIG. FIG. 8 is a diagram showing an example of image data after conversion by the data conversion unit.

Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted.

The inspection device according to the present embodiment is, for example, a device used in the label affixing device described below and inspects the correctness of a product label (label) on which characters are printed. The inspection device includes at least a character reading device for inspecting the correctness of the characters written on the product label. As will be described below, the inspection device is included in the label affixing device, but is not limited to this. The inspection device may be an device independent of the label sticking device, or may be included in a device different from the label sticking device.

FIG. 1 is a block diagram showing a configuration of a label affixing device according to the present embodiment. As shown in FIG. 1, the label affixing device 100 includes a label affixing unit 30, a label affixing unit 40, a control unit 70, a display input panel 80, and an inspection device 1.

The label issuing unit 30 prints at least a part of the information of the designated product via the display input panel 80 on the label, and issues the label as the product label. The label attaching unit 40 attracts and holds the product label issued by the label issuing unit 30, and attaches the product label to the article.

The control unit 70 controls various operations in the label affixing device 100. The control unit 70 is composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The control of various operations in the control unit 70 is performed, for example, by loading a program stored in the ROM into the RAM and executing the program in the CPU. The control unit 70 is connected to a label issuing unit 30, a label attaching unit 40, a display input panel 80, and an inspection device 1. The display input panel 80 displays various information and accepts various operations by the operator. The display input panel 80 accepts an operation for designating a product.

The inspection device 1 inspects the correctness of the product label using, for example, a label ledger (form). FIG. 2 is a diagram showing an example of a form. As shown in FIG. 2, in a factory or the like that produces a product, a product code 51, a portion 53 on which a sample label 61, which is a correct label to be affixed to the product, is printed, and a product to be affixed to the product. A portion 55 to which the label 63 is affixed, a portion 56 to which the appearance of the product is printed, a portion 57 to which a one-point label of a sample to be affixed to the product is printed and a one-point label to be affixed to the product, and a portion 57. Form 50 may be used.

The form 50 is provided with a plurality of portions 55 to which the product label 63 is attached. Whether the portion 55 to which the product label 63 is affixed is at the stage of the affixing work (for example, at the time of withdrawal or return from the storage, at the start of the work, at the time of label replacement, and at the end of the work). , And the time of sticking). A worker and a manager of a factory or the like attach a product label 63 to a form 50 at a predetermined stage of work, and confirm whether or not the product label 63 is the correct label to be affixed to the product. The inspection device 1 inspects the correctness of such a product label 63.

The product code 51 includes product identification information (product ID information) that identifies the product, and is attached to the form 50. For example, the product code 51 is printed on the form 50. The product identification information is, for example, a code that combines numbers, letters, patterns, symbols, and the like. In the present embodiment, the product code 51 includes, in addition to the product identification information, manufacturing identification information which is information for specifying a schedule of how the product is manufactured. Like the product identification information, the manufacturing identification information is also a code that combines, for example, numbers, letters, patterns, symbols, and the like. Here, as an example of information including product identification information and manufacturing identification information, a barcode has been described as an example, but the present invention is not limited to this. The product code 51 may be a two-dimensional code such as a QR code (registered trademark) or information such as a character string.

As shown in FIG. 3A, the sample label 61 includes a table label 61A on which characters such as a product name and an amount of money are printed as information about the product. The table label 61A is divided into areas 61a on which figures, patterns and the like are printed, and areas 61b and 61c on which the characters are printed. In each of the regions 61b and 61c, the vertical size of the character is predetermined. The sample label 61 includes a back label 61B on which a product name, a raw material name, an expiration date, a storage method, a product code, a manufacturer, and the like are printed. The sample label 61 here is a printed image of the product label 63 as it is.

As shown in FIG. 3B, the product label 63 includes a table label 63A on which the product name, amount, expiration date such as expiration date and expiration date, and shipping service are printed. The table label 63A is divided into an area 63a on which a figure, a pattern, etc. are printed and an area 63b to 63d (printing column) on which the characters are printed. In each of the regions 63b to 63d, the vertical size of the character is predetermined. The predetermined vertical size of the character may be at least one of the minimum value and the maximum value. In the present embodiment, the aspect ratio of the characters printed in the area 63b is the character printed in the area 63b due to the size of the area 63b and the length of the character string printed in the area 63b. It has been modified to fit the column. For example, when the number of characters printed in the area 63b is larger than the predetermined value, the product name indicated by the vertically long characters is printed in the area 63b as shown in FIG. 3 (b). The aspect ratio of the characters before the change is, for example, 1: 1. Therefore, for example, when the number of characters printed in the area 63b is equal to or less than a predetermined value, the maximum value of the vertical length and the maximum value of the horizontal length of the characters printed in the area 63b are the same or substantially the same. Is. On the other hand, the aspect ratio of the characters printed in the areas 63c and 63d has not been changed. In addition to figures, patterns, etc., characters may be printed in the area 63a.

In addition, the product label 63 includes a back label 63B on which a product name, a raw material name, an expiration date, a storage method, a manufacturer, and a product code are printed. The portion 55 to which the product label 63 is attached corresponds to the portion to which the product label 63 to be attached to the product is attached according to the stage of work. The product label 63 is at least one of the following labels (1) to (5).
(1) A label peeled off from a label roll discharged from the storage.
(2) A label issued by the label issuing unit 30 of the label affixing device 100 before the label affixing by the label affixing device 100 is started.
(3) A label issued by the label issuing unit 30 of the label affixing device 100 immediately after the label is exchanged in the label affixing device 100.
(4) A label issued by the label issuing unit 30 of the label affixing device 100 after the label affixing by the label affixing device 100 is completed.
(5) Labels removed from the label rolls returned to the storage.

In other words, the product label 63 in (1) above is a label that is manually or automatically peeled off from, for example, a label roll that has been discharged (delivered) from the storage based on a production plan. The storage is, for example, a warehouse in which label rolls are placed. The product label 63 of the above (2) is a label issued by the label issuing unit 30 immediately before the start of production of the product. The product label 63 of the above (3) is a label issued by the label issuing unit 30 immediately after the label exchange is performed during the production of the product. The product label 63 of the above (4) is a label issued by the label issuing unit 30 immediately after the end of production of the product. The product label 63 in (5) above is a label that is manually or automatically peeled off from a label roll that has been returned (received) to a storage, for example, based on a production plan.

FIG. 4 is a block diagram showing the configuration of the inspection device according to the present embodiment. As shown in FIG. 4, the inspection device 1 includes a terminal device 3 and a management server 9 provided so as to be able to communicate with the terminal device 3. The inspection device 1 inspects the correctness of the product label 63 from the image data of the form 50 including the sample label 61 on which each information is printed and to which the product label 63 on which each information is printed is attached. In the present embodiment, the inspection device 1 inspects and determines whether the product information printed on the product label 63 affixed to the form 50 and the product information specified from the product code 51 (details will be described later) are correct or not. The character reading device according to the present embodiment is configured by at least a part of the terminal device 3 and at least a part of the management server 9.

The terminal device 3 transmits data related to the form 50 to the management server 9, and also receives a determination result of whether or not the product label 63 is a correct label from the management server 9. Examples of the terminal device 3 include a stationary terminal, a mobile terminal such as a smartphone, a tablet terminal, and the like. The terminal device 3 is supported, for example, by a gantry 5 having a columnar portion 5A and a leg portion 5B, as shown in FIG. The terminal device 3 is supported by the gantry 5 so that it can overlap the form 50. The terminal device 3 transmits the data of the form 50 to the management server 9. The data itself transmitted to the management server 9 or the processed data of the data is used by the management server 9 as image data including characters. The processed data is, for example, data processed so that the product label 63 is in the normal position. In this case, the management server 9 acquires the image data including the product label 63 set to the normal position. As shown in FIG. 4, the terminal device 3 includes an image pickup unit 11, a display operation unit 13, a control unit 15, and a communication unit 17.

The image pickup unit 11 is, for example, a camera mounted on the back surface of a tablet terminal. The image pickup of the form 50 by the image pickup unit 11 may be executed by the operator or the manager operating the display operation unit 13, or may be executed by being controlled by the management server 9. The image pickup unit 11 takes an image of a part or the whole of the form 50, and acquires data of a part or the whole image of the form 50 (hereinafter, also referred to as “imaging data”). Therefore, the image pickup unit 11 functions as a part of the acquisition unit that acquires data including characters in the inspection device 1. In the present embodiment, the image pickup unit 11 takes an image of the entire form 50. The image pickup unit 11 transmits the image pickup data to the management server 9. The image pickup data itself or the processed data of the image pickup data is transmitted to the management server 9. The processed data is, for example, data processed so that the product label 63 in the image pickup data is in the normal position.

The display operation unit 13 is, for example, a touch panel. The display operation unit 13 notifies the correctness of the product label 63 inspected by the determination unit 96F described later. The display operation unit 13 notifies the correctness of the form 50 determined by the determination unit 96F described later. The notification of the display operation unit 13 can be realized by, for example, at least one of voice, display, and vibration. The display operation unit 13 constitutes at least a part of the notification unit.

The control unit 15 is an electronic control unit including a CPU, ROM, RAM, and the like. The control unit 15 controls various operations in the terminal device 3. The control unit 15 can be configured as software in which a program stored in the ROM is loaded on the RAM and executed by the CPU, for example. The control unit 15 may be configured as hardware using an electronic circuit or the like. The control unit 15 controls the image pickup unit 11 according to the contents operated by the display operation unit 13, and acquires the image pickup data of the form 50, for example. For example, the control unit 15 controls the communication unit 17 and transmits the image pickup data acquired by the image pickup unit 11 to the management server 9. The control unit 15 controls, for example, the display operation unit 13 to display the correctness inspection result of the product label 63 and the form 50 transmitted from the management server 9.

The communication unit 17 transmits / receives information to / from the management server 9. The communication unit 17 transmits the image capture data of the form 50 imaged by the image pickup unit 11 to the management server 9. The communication unit 17 receives the correctness inspection result of the product label 63 and the form 50 from the management server 9.

The management server 9 is configured as a computer system including a main storage unit such as a CPU, RAM and ROM, an auxiliary storage unit exemplified by a hard disk, a flash memory and the like. The management server 9 includes a storage unit 91, a control unit 95, and a communication unit 97. The management server 9 may use a cloud server, and in this case, at least the storage unit 91 may be included in the cloud server. Further, the management server 9 may be configured by one device or may be configured by a plurality of devices. When composed of a plurality of devices, one management server 9 is logically constructed by connecting them via a communication network such as the Internet or an intranet. The management server 9 may include, for example, a stationary terminal, a mobile terminal such as a smartphone, a tablet terminal, or the like.

As the storage unit 91, a hard disk, a flash memory, or the like is exemplified as described above. The storage unit 91 stores, for example, information about the form 50, information about the sample label 61, information about the product using the label affixing device 100 (product information), and the like in advance. The information regarding the form 50 is, for example, the type of ledger, the position coordinates of the product code 51 and the portions 53, 55, and the like. The information regarding the sample label 61 is the type of the sample label, the type and position coordinates of the figure, the position coordinates of the area where the characters are printed, and the like. For example, the position coordinates of the area where characters are printed are stored with reference to a reference position such as the center of the target label. The size of the area where the characters are printed may be determined based on the above position coordinates.

In the present embodiment, the storage unit 91 stores the product code 51 and the product information in advance in association with each other. In other words, the product code and the product information specified in association with each product code are stored in advance in the storage unit 91. In addition to the product ID information described above, the product information includes at least one of product name information, raw material information, expiration date information, price information (amount), weight information, and the like. The product name information includes, for example, the number of characters and the type of characters (Japanese, English, etc.). The expiration date information includes, for example, a recommended usage expiration date, a best-by-date expiration date, an expiration date, and the like.

The control unit 95 is an electronic control unit including a CPU, ROM, RAM, and the like. The control unit 95 controls various operations on the management server 9. The control unit 95 can be configured as software in which a program stored in the ROM is loaded on the RAM and executed by the CPU, for example. The control unit 95 may be configured as hardware using an electronic circuit or the like. In the control unit 95, the data acquisition unit 96A, the product code reading unit 96B, and the product information specifying unit 96C shown below are combined with the hardware such as the CPU, RAM, and ROM and the software such as the program. , A data conversion unit 96D, a data analysis unit 96E, and a determination unit 96F are formed.

The data acquisition unit 96A receives the image pickup data transmitted from the communication unit 17, and acquires image data including characters. The data acquisition unit 96A functions as another part of the acquisition unit of the inspection device 1. In the present embodiment, the data acquisition unit 96A acquires a plurality of image data (first image data) obtained by processing the image data in addition to the image data of the form 50. Therefore, the image data acquired by the data acquisition unit 96A includes a plurality of image data. Each of the plurality of first image data corresponds to the data obtained by cutting out a predetermined portion from the image data of the form 50. The predetermined portion is determined based on information stored in advance in the storage unit 91 (in particular, at least one of information regarding the form 50, information regarding the portions 53 and 55, and information regarding the sample label 61). For example, based on the position coordinates of the portions 53 and 55, an area on which the sample label 61 is printed and an area (estimated area) in which the front label 63A and the back label 63B are presumed to be attached are defined. In this case, the data acquisition unit 96A performs processing to cut out the above-mentioned region and the above-mentioned estimation region. Since the form 50 includes the portion 53 and the plurality of portions 55, a plurality of first image data are generated. The data acquisition unit 96A determines, for example, a portion of a predetermined portion estimated to be regions 63b to 63d from the position coordinates of the portion 53 and the position coordinates of the region where characters are printed on the sample label 61. Similarly, the data acquisition unit 96A also determines a portion presumed to be the region 63a. As a result, the data acquisition unit 96A acquires information regarding the positions and sizes of the regions 63a to 63d when the image data is acquired.

The product code reading unit 96B (reading unit) reads the product code 51 included in the image data. The product code reading unit 96B outputs the reading result of the product code 51 to the product information specifying unit 96C.

The product information specifying unit 96C (specific unit) specifies the product information printed on the sample label 61 and the product label 63 from the read product code 51. The product information specifying unit 96C reads the product information associated with the product code 51 read by the product code reading unit 96B from the storage unit 91. In addition, the product information specifying unit 96C outputs the product information read from the storage unit 91 to the data conversion unit 96D and the determination unit 96F.

The data conversion unit 96D (conversion unit) changes the vertical and horizontal magnifications of the image data, and changes the aspect ratio of the characters included in the image data. The data conversion unit 96D has, for example, image data so that the aspect ratio of the vertically long characters (see FIG. 3B) printed in the area 61b of the sample label 61 and the area 63b of the product label 63 is close to 1: 1. Change the vertical and horizontal magnification of. In the present embodiment, the data conversion unit 96D performs image data so that the vertically long characters (that is, the characters after the change) included in the image data become the characters with the original aspect ratio (that is, the characters before the change). Change the vertical and horizontal magnification of. The data conversion unit 96D may change the image data so that the aspect ratio of the changed character approaches the aspect ratio of the character before the change. Further, the data conversion unit 96D enlarges the image data, but may reduce the image data. The image data converted by the data conversion unit 96D may be the first image data processed by the data acquisition unit 96A, or may be image data not processed by the data acquisition unit 96A. In the former case, the magnification is changed only for the first image data including the characters whose aspect ratio has been changed. When the vertical and horizontal magnifications of the image data are changed by the data conversion unit 96D, at least one of the vertical and horizontal magnifications of the image data may be changed. In other words, one of the vertical and horizontal magnifications of the image data does not have to be changed.

The magnification change of the image data by the data conversion unit 96D is, for example, the size of the area where characters are printed, the product information specified by the product information identification unit 96C (for example, product name information, product ID information, etc.), etc. It is carried out based on. In the present embodiment, since the size of the characters printed in each area is predetermined as described above, the size of the area and the number of characters of the characters printed in the area (for example, included in the specified product information). The magnification of the image data is determined based on the product name, etc.). A threshold value is input in advance to the data conversion unit 96D, or a threshold value is registered in advance. When the threshold value is equal to or less than the number of characters in the product name, the data conversion unit 96D changes the vertical and horizontal magnifications of the image data. In other words, when the threshold value is larger than the number of characters in the product name, the data conversion unit 96D does not change the vertical and horizontal magnifications of the image data. Therefore, the data conversion unit 96D may not operate depending on the product information or the like specified by the product information identification unit 96C. The threshold value is appropriately calculated depending on, for example, the size of the area where the product name is printed and the number of characters, as well as the character type and the like. The above thresholds for the regions 63b to 63d are different from each other.

The data analysis unit 96E (analysis unit) performs OCR processing on the image data whose magnification has been changed by the data conversion unit 96D, and recognizes the characters included in the image data. When the data conversion unit 96D does not operate, the data analysis unit 96E performs OCR processing on the image data acquired by the data acquisition unit 96A and recognizes the characters included in the image data. In the present embodiment, the data analysis unit 96E performs OCR processing on the first image data of the product label 63, and the character string (text information) such as the product name and the amount of money included in the image of the front label 63A and the back label. Recognizes character strings such as product names and raw material names included in the image of 63B. The extraction method and identification method of each text information are not particularly limited, and various known methods can be used. When the regions 63a to 63d are estimated, for example, the regions 63a may be excluded in advance and then OCR processing may be performed. This makes it possible to prevent the pattern or the like from being erroneously recognized as a character. In addition, the influence of the characters included in the area 63a can be eliminated. The data analysis unit 96E may perform OCR processing on the first image data of the sample label 61 and recognize the characters included in the image of the sample label 61.

The determination unit 96F determines whether or not the character string recognized by the data analysis unit 96E includes the character string of the product information specified by the product information identification unit 96C. For example, the determination unit 96F determines whether or not the character string of the product name and the character string of the amount of money included in the table label 63A are included in the character string of the product information. When both the character string of the product name and the character string of the amount of money included in the table label 63A are included in the character string of the product information, the determination unit 96F determines that the table label 63A is correct. On the other hand, if either the product name character string or the amount character string included in the table label 63A is not included in the product information character string, the determination unit 96F determines that the table label 63A is incorrect. The determination unit 96F stores and stores the determination result in the storage unit 91. At this time, the determination unit 96F stores the determination result for each of the plurality of portions 55 in the storage unit 91. The determination unit 96F may determine whether or not the character string of the product name and the character string of the amount of money included in the sample label 61 are included in the character string of the product information. In addition, "included in the character string" means that one character string is segmented into words by morphological analysis or the like, and then each word is included in the other character string. Each word contained in one string is completely included in the other string, but is not limited to this. Since there is a possibility that a character recognition error may occur when recognizing a character included in the image data, a mismatch of about several characters (for example, a predetermined number of 1 or 2 characters) may be allowed.

The determination unit 96F reads the product ID information from the product code included in the back label 63B, and whether or not the product ID information matches the product ID information included in the product information specified by the product information identification unit 96C. Is determined. When these product ID information match, it is determined that the back label 63B is correct. On the other hand, if these product ID information do not match, it is determined that the back label 63B is incorrect. The determination unit 96F stores and stores the determination result in the storage unit 91. At this time, the determination unit 96F stores the determination result for each of the plurality of portions 55 in the storage unit 91. The determination unit 96F determines whether or not the product ID information read from the product code included in the sample label 61 and the product ID information included in the product information specified by the product information identification unit 96C match. May be good.

The determination unit 96F may determine whether or not the character string of the product name included in the back label 63B is included in the character string of the product information. In this case, the determination of the product ID information may or may not be carried out.

The determination unit 96F determines whether or not all the above-mentioned determinations are correct. If all the determinations are correct, the determination unit 96F determines that there is no problem with the form 50. On the other hand, if at least one determination is incorrect, the determination unit 96F determines that there is a problem with the form 50.

The communication unit 97 transmits / receives information to / from the terminal device 3. The communication unit 97 transmits the correctness determination of the product label 63 by the determination unit 96F to the terminal device 3. The communication unit 97 transmits the correctness determination of the form 50 by the determination unit 96F to the terminal device 3. In the inspection device 1 as described above, when the determination result by the determination unit 96F indicates that there is a problem in the form 50, the control unit 95 transmits error information to the label issuing unit 30 via the communication unit 97.

Next, an example of the operation of the inspection device 1 will be described with reference to FIGS. 6 to 8. 6 and 7 are flowcharts showing the flow of inspection processing executed by the inspection apparatus of FIG. FIG. 8 is a diagram showing an example of image data after conversion by the data conversion unit 96D.

When inspecting the correctness of the product label 63 of the form 50, the operator first installs the terminal device 3 on the gantry 5 (see FIG. 5) so that the form 50 can be imaged. The operator operates the display operation unit 13 of the terminal device 3 and images the form 50 by the image pickup unit 11 (step S1). In step S1, the worker takes an image of the entire form 50. As a result, the image pickup data showing the product code 51 and the product label 63 is acquired. The product label 63 is at least one of the labels (1) to (5) above.

The image pickup data acquired by the image pickup unit 11 is transmitted to the management server 9 by the communication unit 17 (step S2). The data acquisition unit 96A acquires at least one image data including characters based on the received image pickup data. As a specific example, the data acquisition unit 96A has image data showing the entire form 50, first image data showing the product code 51, first image data showing the front label 63A, and first showing the back label 63B. Get image data. Each of the first image data showing the front label 63A and the first image data showing the back label 63B is acquired in association with each portion 55 included in the form 50. The data acquisition unit 96A may acquire one or more image data indicating the sample label 61. The acquired image data is output to the data conversion unit 96D or the like. Hereinafter, it is assumed that the data acquisition unit 96A has acquired the image data of the front label 63A and the back label 63B printed with the trade name "dry-baked curry bread using domestic beef".

Next, the product code 51 is read from the first image data indicating the product code 51 or the image data indicating the entire form 50 (step S3). In step S3, the product code reading unit 96B outputs the reading result of the product code 51 to the product information specifying unit 96C. The product information specifying unit 96C reads out the product information associated with the input product code 51 from the storage unit 91. The read product information is output to the data conversion unit 96D or the like. In the following, the product information specified by the product information specifying unit 96C is associated with the product name "dry-baked curry bread using domestic beef" and the amount "¥ 110 (tax included ¥ 118)" in the storage unit 91. I will explain it.

Next, the data conversion unit 96D determines whether or not the number of characters of the product name included in the read product information is equal to or greater than the threshold value registered in advance (step S4). Here, it is determined whether or not each of the number of characters of the product name "dry-baked curry bread using domestic beef" and the number of characters of the amount of money "¥ 110 (¥ 118 including tax)" is equal to or higher than the above threshold value. When at least one of the characters is equal to or greater than the above threshold value (step S4: YES), the data conversion unit 96D changes the vertical and horizontal magnifications of the plurality of first image data indicating the table label 63A (step S5). In step S5, the data conversion unit 96D first calculates the change magnification based on the product information (for example, the number of characters in the product name) and the information regarding the sizes of the areas 63a to 63d. Then, the data conversion unit 96D changes the magnification of the image data. As a result, for example, as shown in FIG. 8, the data conversion unit 96D generates the changed image data (second image data) including the characters indicated by the changed aspect ratio. On the other hand, when the total number of characters to be determined is less than the above threshold value (step S4: NO), the data conversion unit 96D does not change the vertical and horizontal magnifications of the first image data indicating the table label 63A. The threshold value is calculated by the data conversion unit 96D or the like before performing the determination.

Next, the data analysis unit 96E performs OCR processing on the image data indicating the table label 63A attached to the predetermined one portion 55 (predetermined portion 55) among the plurality of portions 55, and the characters included in the image data. (Step S6). In step S6, either the second image data obtained in step S5 or the first image data obtained in step S2 is subjected to OCR processing. Here, the data analysis unit 96E indicates in the area 63d the product name "dry-baked curry bread using domestic beef" shown in the area 63b and the amount "¥ 110 (¥ 118 including tax)" shown in the area 63c. It is assumed that the expiration date "expiration date 18.12.11 3:00 am Y1" is recognized as text information.

Next, the determination unit 96F determines whether or not the character string such as the product name and the amount of money included in the image data of the table label 63A includes the character string of the product information specified by the product information identification unit 96C. (Step S7). In step S7, first, the character string of the product name and the character string of the amount of money are extracted from the text information recognized in step S6, and the character string of the product name and the character string of the amount of money are extracted from the specified product information. To. Then, these character strings are compared with each other. For example, when both the character string of the product name and the character string of the amount of money included in the table label 63A are included in the character string of the product information (step S7: YES), the determination unit 96F determines that the table label 63A is correct. (Step S8). On the other hand, when at least one of the product name character string and the amount character string included in the table label 63A is not included in the product information character string (step S7: NO), the determination unit 96F correctly indicates the table label 63A. It is determined that there is no such thing (step S9).

Next, after step S8 or after step S9, the determination unit 96F reads the product ID information from the product code included in the image data indicating the back label 63B attached to the predetermined portion 55. Subsequently, the determination unit 96F determines whether or not the read product ID information matches the product ID information included in the product information specified by the product information identification unit 96C (step S10). When these product ID information match (step S10: YES), the determination unit 96F determines that the back label 63B is correct (step S11). On the other hand, when these product ID information do not match (step S10: NO), the determination unit 96F determines that the back label 63B is incorrect (step S12).

Next, the above steps S6 to S12 are repeatedly carried out (step S13). As a result, the correctness of the front label 63A and the back label 63B included in the portion 55 other than the predetermined portion 55 is determined. Then, it is determined whether or not all the front labels 63A and the back labels 63B are correct (step S14). When all the determinations are correct (step S14: YES), the determination unit 96F determines that there is no problem in the form 50 (step S15). On the other hand, when at least one determination is incorrect (step S14: NO), the determination unit 96F determines that there is a problem in the form 50 (step S16). In this case, the control unit 95 transmits error information to the label issuing unit 30 via the communication unit 97 (step S17). Then, after step S15 or after step S17, the control unit 95 notifies the terminal device 3 of the inspection result via the communication unit 97 (step S18).

According to the character reading device included in the inspection device 1 according to the present embodiment described above, the data conversion unit 96D changes the vertical and horizontal magnifications of the image data indicating the table label 63A and includes the image data. Change the aspect ratio of the product name "Dry-baked curry bread using domestic beef". As a result, the aspect ratio and size of the product name can be changed to a state in which the data analysis unit 96E can easily recognize them. Therefore, the character recognition accuracy can be improved regardless of the state of the characters included in the image data.

In the present embodiment, the image data includes the first image data of the product label 63 on which the product information is printed, and the aspect ratio of at least a part of the characters printed on the product label 63 is the area of the product label 63. It has been changed so that the character string of the product information fits in 63b, and the data conversion unit 96D vertically and vertically the first image data so that the character whose aspect ratio has been changed becomes the character of the original aspect ratio. Change the horizontal magnification. Therefore, the aspect ratio and size of the characters included in the first image data can be changed to a state in which the data analysis unit 96E can easily recognize the characters.

In the present embodiment, the character reading device uses the product code 51 attached to the form 50 to the product information specifying unit 96C for specifying the product information printed on the product label 63, and the character string recognized by the data analysis unit 96E. The product information specifying unit 96C includes a determination unit 96F for determining whether or not a character string of the product information specified by the product information specifying unit 96C is included. Therefore, the determination accuracy by the determination unit 96F can be improved.

In the present embodiment, the character reading device stores the product code reading unit 96B for reading the product code 51 attached to the form 50, the product code 51, and the product information specified in association with the product code 51. The product information specifying unit 96C includes the unit 91 and reads the product information associated with the product code 51 read by the product code reading unit 96B from the storage unit 91 and outputs the product information to the determination unit 96F. Therefore, the determination by the determination unit 96F can be speeded up.

In the present embodiment, the product information may include at least one of a product name, an amount of money, an expiration date, and a raw material name.

In the present embodiment, the inspection device 1 is provided with the character reading device, the product label 63 to be attached to the product is attached to the form 50, and the data acquisition unit 96A is an image pickup unit 11 that images the form 50. A certain camera is provided, the first image data of the product label 63 is acquired from the image pickup data of the camera, and the inspection device 1 is identified from the product information printed on the product label affixed to the form 50 and the product code 51. Notify the correctness of the product information. In the inspection device 1, by using the character reading device, the character recognition accuracy can be improved regardless of the state of the characters included in the image data. Therefore, the inspection device 1 can accurately notify the correctness of the product information printed on the product label 63 and the product information specified from the product code 51.

Although the embodiments according to the present invention have been described above, the present invention is not limited to the above-mentioned embodiments and the like. Various changes can be made without departing from the spirit of the invention. For example, in the above embodiment, the character reading device is included in the inspection device, but is not limited thereto. In other words, the character reading device is not limited to the product name, and may be any device for recognizing characters in image data including characters. The character reading device may have at least a data acquisition unit, a data conversion unit, and a data analysis unit in a control unit of a server such as a management server.

In the above embodiment, the product code reading unit reads the product code, but the present invention is not limited to this. For example, the image pickup unit or the terminal device including the image pickup unit may read the product code attached to the form. In this case, the image pickup unit or the terminal device also functions as a reading unit of the character reading device, and the product code reading unit is not formed in the control unit. In addition, step S3 is performed before step S2.

In the above embodiment, the acquisition unit includes an image pickup unit, but the acquisition unit is not limited to this. For example, the acquisition unit may have a scanner device, a multifunction device having a scanner function, or the like. In this case, the terminal device transmits the scan data of the form to the management server. The management server acquires one or more image data from the scan data. When the scanner device or the like is used, the product code attached to the form may be read when the scan data of the form is generated. In this case, the scanning device or the like also functions as a reading unit of the character reading device, and the product code reading unit is not formed in the control unit. In addition, step S3 is performed before step S2.

In the above embodiment, it is determined whether or not there is a problem in the form after step S14, but the present invention is not limited to this. For example, if it is determined in step S7 that the front label is incorrect, or if it is determined in step S10 that the back label is incorrect, step S14 or the like may be omitted and the process may proceed to step S16. In this case, since it is possible to determine that there is a problem in the form without determining whether all the labels are correct or not, it is possible to speed up the inspection by the inspection device.

In the above embodiment, the product code is printed on the back label, but the present invention is not limited to this. When the product code is not printed on the back label 63B, for example, the back label may be subjected to OCR processing to recognize characters such as the product name printed on the back label. Then, the correctness of the back label may be determined depending on whether or not the character string such as the product name printed on the back label is included in the character string such as the product name associated with the specified product information. Even in this case, the correctness of the back label can be determined. Even if the product code is printed on the back label, whether or not the character string such as the product name printed on the back label is included in the character string such as the product name associated with the specified product information. May be determined.

In the above embodiment, the determination unit uses the character string of the product name as it is as the target of comparison, but the present invention is not limited to this. For example, the determination unit may delete a predetermined specific character from the character string of the product name, and may use the character string from which the specific character is deleted as a comparison target. Examples of the above-mentioned specific characters include character strings such as seasoning, Kansai style, and Kanto style.

In the above embodiment, it may be realized as a computer control method or a computer control program for causing a computer to execute a process of inspecting the correctness of a product label.

1 ... Inspection device, 3 ... Terminal device, 9 ... Management server, 11 ... Imaging unit (acquisition unit), 13 ... Display operation unit, 50 ... Form, 51 ... Product code, 53, 55-57 ... Part, 61 ... Sample Label, 61A, 63A ... Front label, 61B, 63B ... Back label, 63 ... Product label (label), 63b-63d ... Area (print field), 70 ... Control unit, 91 ... Storage unit, 95 ... Control unit, 96A ... Data acquisition unit (acquisition unit), 96B ... Product code reading unit (reading unit), 96C ... Product information specifying unit (specific unit), 96D ... Data conversion unit (conversion unit), 96E ... Data analysis unit (analysis unit) , 96F ... Judgment unit.

Claims (6)

An acquisition unit that acquires image data including characters, and
A conversion unit that changes the aspect ratio of the characters included in the image data by changing the vertical and horizontal magnifications of the image data.
An analysis unit that performs OCR processing on the image data whose magnification has been changed by the conversion unit and recognizes the characters included in the image data.
A character reader equipped with. The image data includes the first image data of the label on which the product information is printed.
The aspect ratio of at least a part of the characters printed on the label has been changed so that the character string of the product information fits in the print field of the label.
The conversion unit according to claim 1, wherein the conversion unit changes the vertical and horizontal magnifications of the first image data so that the characters whose aspect ratio has been changed become the characters having the original aspect ratio. Character reader. A specific part that identifies the product information printed on the label from the product code attached to the form, and
The character reading device according to claim 2, further comprising a determination unit for determining whether or not the character string recognized by the analysis unit includes the character string of the product information specified by the specific unit. A reading unit that reads the product code attached to the form,
Further provided with the product code and a storage unit for storing product information specified in association with the product code.
The character reading device according to claim 3, wherein the specific unit reads the product information associated with the product code read by the reading unit from the storage unit and outputs the information to the determination unit. The character reading device according to any one of claims 2 to 4, wherein the product information includes at least one of a product name, an amount of money, an expiration date, and a raw material name. An inspection device including the character reading device according to claim 3 or 4.
A label affixed to the product is affixed to the form.
The acquisition unit includes a camera that captures the form, and acquires the first image data from the imaging data of the camera.
Notifying the correctness of the product information printed on the label attached to the form and the product information specified from the product code.
Inspection equipment.

Images