JP3335265B2 - Barcode extraction device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a bar code extracting apparatus for automatically extracting a bar code area from image data.

In recent years, POS terminal devices have been introduced in small and medium-sized supermarkets and convenience stores.
Barcode payments and product management have become mainstream.
Therefore, by printing a bar code (JAN code) on a transfer form for a utility charge such as a telephone charge, an electricity charge, and a gas charge, the utility charge, which could only be paid at a bank or a post office in the past, is now replaced by You can now pay at small and medium-sized supermarkets and convenience stores.

[0003] However, when a user brings in a transfer sheet of a utility bill on which a barcode is printed to a bank, the bank has no means for reading the barcode on the transfer sheet and automatically processing it. At present, it is necessary to aggregate the amount of money in the work, and the burden on the staff is increasing at present.

In particular, in the case of a corporate company, a large amount of transfer paper (for example, 100 sheets / customer) is often brought in at one time, and the time of bringing in is often concentrated (for example, peaks occur on the 25th of every month). Therefore, there is a demand for the development of an automatic processing device for utilities such as a utility bill at a bank (for example, a certain bank processes only 400,000 bills / month using the utility bill alone).

[0005] For this reason, attention is paid to the fact that barcodes are printed on many utility bills. For example, a batch reading type O that can process a large number of forms at once can be read.
Recognizing this barcode using a CR device has also been considered. However, since it is unknown where the barcode is located in the form image data, it is necessary to extract the area where the barcode exists before barcode recognition, but this technology has not yet been developed. It is the current situation.

Therefore, if a technique for extracting the area where the barcode exists is not developed, a definition body for instructing the OCR device on the barcode reading position and the like is created for each form and input to the OCR device. Need to be performed, which requires extremely troublesome and time-consuming work. Therefore, the O
The CR device cannot be used as it is, and improvement of this point has been demanded.

[0007]

2. Description of the Related Art A conventional example will be described below with reference to FIGS. §1: Description of Conventional Example 1—See FIG. 10 FIG. 10 is an explanatory diagram of a barcode recognition process by a conventional POS terminal device, FIG.
The figure is a diagram for explaining a method of reading a barcode. Note that B
In the figure, indicates the scanning direction by the laser beam.

Conventional example 1 is an example in which a bar code is recognized by a POS terminal device. Conventionally, a POS terminal device has been known as a device for recognizing and processing a barcode. The POS terminal device 1 includes a barcode reader 2 for reading a barcode 4 of a barcode label affixed to a product 3 using the barcode reader 2.

In this case, a laser beam from the bar code reader 2 is applied to the bar code label attached to the product 3 for scanning, and the reflected light is received and converted into an electric signal. Had been done. When reading a barcode as described above, the barcode is read by scanning the barcode label from various angles as shown in FIG.

When the bar code reader 2 is a hand scan type bar code reader, the bar code is read by holding the hand scan type bar code reader and tracing the bar code label. Barcode recognition processing was performed.

§2: Description of Conventional Example 2—See FIG. 11 FIG. 11 is an explanatory diagram of bar code recognition processing by a conventional OCR device. Conventional example 2 is an example in which a barcode recognition process is performed using an OCR device.

Conventionally, it has been known to perform a barcode recognition process using an OCR device. The OCR device is a device that reads information from a form or the like with an image scanner, takes in the image data, and performs a character recognition process or the like. Like the OCR device, in the world of image data processing, characters and the like are recognized by software, and bar codes are similarly recognized.

However, in the prior art, since the recognition processing speed needs to be improved, the area in which the barcode exists is specified in advance from the host system using a definition body. For example, as shown in the figure, when the barcode on the form 9 is recognized in a state where the host system 8 is connected to the OCR device 7, the following process is performed.

First, various information of a form 9 (a form to be read is form A) is designated by a definition body 10, and the definition body 10 is input to the host system 8, and then the host system 8
Download the contents of the definition body 10 to the OCR device 7 from the server. In the OCR device 7, the definition field 10
The barcode is read from the form according to the information of (1), and the barcode recognition process is performed. The definition field is
It specifies the type of barcode and position information (coordinates) on the form, and is created for each form.

[0015]

The above-mentioned prior art has the following problems. (1): In the case of the first conventional example, since the barcode is read by scanning the barcode label with a laser beam, there is no need to extract the barcode from the image data.

However, in such a barcode recognition process, it is necessary to manually scan a barcode label affixed to each product or the like by a barcode reader, which requires time and effort.

(2): In the case of the conventional example 2, it is necessary to create a definition body for each form to be read. The created definition body is input to the upper system, and the definition body is downloaded from the upper system to the OCR device. Needed. That is, each time the type of the form changes, the operator or the like has to create a definition body suitable for the form and download it from the host system to the OCR device.

Therefore, it takes time and effort, and the work efficiency of the barcode recognition process is low. In particular, when there are many types of forms and a large number of forms are dealt with, it takes an enormous amount of time and effort to create a definition body and download it to the OCR device, which is not a practical method.

The present invention solves the above-mentioned conventional problems, and makes it possible to convert input image data without creating a definition body or the like as in the prior art and without requiring manual work.
An object of the present invention is to automatically extract a barcode rectangular area.

[0020]

FIG. 1 is a diagram illustrating the principle of the present invention. The present invention is configured as follows to achieve the above object.

(1): As shown in FIG. 1, an image memory 21 for storing image data in the barcode extraction device.
A, a barcode extraction unit 22 for extracting a barcode from the image data stored in the image memory 21A, and a pattern dictionary storage unit 2 storing a barcode pattern dictionary in advance.
And a barcode position coordinate storage unit 24 for storing (registering) the position coordinates of the newly extracted barcode rectangular area.
Was provided.

The bar code extracting unit 22 includes:
Black / white pattern extraction unit 25 and barcode determination unit 26
, A barcode rectangular range search unit 27, a left guard bar comparison unit 28, a center bar comparison unit 29, a right guard bar comparison unit 30, and a barcode area comparison unit 31.

Further, the barcode extracting device is constituted as follows. (2): The barcode extraction device sequentially scans the image memory 21A for storing image data and the entire area of the image data stored in the image memory 21A, and a black pattern and a white pattern are preset in the extraction window. Area that alternately appears at intervals within the threshold value extracted as a temporary barcode area,
A barcode extraction unit 22 is provided for determining whether barcode-specific information exists in the extracted temporary barcode area and extracting only a true barcode area.

Further , the bar code extracting section 22 determines whether or not each information of the left guard bar, the center bar, and the right guard bar exists as bar code specific information in the extracted temporary bar code area. The temporary barcode area is extracted as a true barcode area only when the above information exists.

Further , the barcode extracting section 22 searches the rectangular area of the extracted true barcode area to determine the position of the rectangular area surrounding the barcode, thereby converting the true barcode area into a barcode rectangle. It was configured to extract as a region.

[0026]

[0027]

[0028]

[0029]

The operation of the present invention based on the above configuration will be described with reference to FIG. In FIG. 1, it is assumed that the input image data is stored in the image memory 21A. In this state, the black / white pattern extraction unit 25 scans (scans) the image data (binary image data) stored in the image memory 21A in the main scanning direction, and stores the black pattern and the white pattern in the extraction window. Is extracted as a temporary barcode area in which the symbols alternately appear at intervals within a preset threshold value.

Next, the bar code determination unit 26 determines whether the extracted temporary bar code area is a bar code or not by adding a left guard bar, a center bar, and a right guard bar specific to a bar code to the temporary bar code area. It is determined whether or not exists.

In this case, the bar code determination section 26 sends the information on the extracted temporary bar code area to the left guard bar comparison section 28, the center bar comparison section 29, and the right guard bar comparison section 30 to the pattern dictionary storage section 23. Requesting comparison processing with the information in the pattern dictionary stored in.

Then, based on the comparison result information from the left guard bar comparison unit 28, the center bar comparison unit 29, and the right guard bar comparison unit 30, the bar code determination unit 26 adds a bar to the extracted temporary bar code area. It is determined whether a code-specific left guard bar, center bar, and right guard bar exist.

As a result, if a left guard bar, a center bar, and a right guard bar exist in the extracted temporary barcode area, the area is determined to be a true barcode area, and the area is extracted. However, in the extracted temporary barcode area, a left guard bar, a center bar,
If the light guard bar does not exist, it is determined that the area is not a barcode and discarded.

Next, the barcode rectangular range search section 27 searches the range of the extracted true barcode area, determines the position (coordinates) of the rectangular area (barcode rectangular area) surrounding the barcode, and Extract the barcode rectangular area.

Thereafter, the same barcode may be extracted many times in order to finely scan the image data of the entire form. To prevent this, the barcode area comparison unit 31 compares the newly extracted barcode rectangular area with the position information (coordinate information) of the registered barcode rectangular area in the barcode position coordinate storage unit 24. Thereby, it is determined whether or not the barcode rectangular area newly extracted this time overlaps with the already extracted barcode.

As a result, if they are not overlapped and are newly extracted, the barcode area comparison unit 31
Newly registers the position information (coordinate information) of the newly extracted barcode rectangular area in the barcode position coordinate storage unit 24. However, if the barcode area overlaps with the already extracted barcode rectangular area, the barcode area that has already been extracted is left, and the newly extracted barcode area is discarded.

As described above, the search line is advanced in the sub-scanning direction until the entire form is searched, and the above processing is repeated. Then, when the entire form is searched, the process ends.

As described above, it is possible to automatically extract a barcode rectangular area from input image data without creating a conventional definition body or the like and without requiring any manual work. Will be possible.

[0039]

Embodiments of the present invention will be described below with reference to the drawings. The embodiment described below is an example in which the barcode extraction device of the present invention is realized by a batch reading type OCR device. 2 to 9, the same components as those in FIGS. 10 and 11 are denoted by the same reference numerals.

§1: Description of the configuration of the embodiment apparatus ... FIG.
Reference FIG. 2 is an apparatus configuration diagram of the embodiment. As shown in FIG. 2, the OCR device 7 includes an image reading unit 20, an image memory 21, a barcode extraction unit 22, a pattern dictionary storage unit 23, a barcode position coordinate storage unit 24, a RAM 32, and the like.

The bar code extracting section 22 includes a black / white pattern extracting section 25, a bar code determining section 26, a bar code rectangular range searching section 27, and a left guard bar comparing section 2.
8, a center bar comparing section 29, a light guard bar comparing section 30, a bar code area comparing section 31, and the like. The functions and the like of the respective units are as follows.

(1): The image reading section 20 is provided with an image scanner or the like, and inputs image data (multi-valued image data) by reading a form into the apparatus and reading the information. . The image reading section 20 converts input image data (multi-valued image data) into binary image data (binary image data) and stores the converted image data in the image memory 21.

(2): The image memory 21 stores the image data (binary image data) input by the image reading section 20. (3): The barcode extraction unit 22 extracts barcode information (barcode rectangular area) from the image data stored in the image memory 21.

(4): The pattern dictionary storage unit 23 stores a pattern dictionary in which various barcode patterns are registered in advance (memory). In this pattern dictionary, for example, for each barcode type, a left guard bar (start bar) pattern, a center bar pattern, a right guard bar pattern information, and the like that constitute the barcode are registered.

(5): The barcode position coordinate storage unit 24
This is a memory (memory) for storing the position coordinates and the like of the barcode rectangular area extracted by the barcode extraction unit 22. (6): The RAM 32 is a memory accessed by each unit in the barcode extraction unit 22, and is used for work when performing barcode extraction processing.

(7): The black / white pattern extraction unit 25 scans (scans) image data (binary image data) in the image memory 21 so that a black pattern and a white pattern alternate in the extraction window. Is extracted.

(8): The barcode determination section 26 determines whether or not the area where the black pattern and the white pattern extracted by the black / white pattern extraction section 25 appear alternately is a barcode area. .

In this case, the bar code determination unit 26 sends the left guard bar and the center to the left guard bar comparison unit 28, the center bar comparison unit 29, and the right guard bar comparison unit 30 in an area where the black pattern and the white pattern alternately appear. Request a pattern comparison (comparison between an extracted pattern and a pattern registered in a dictionary) to confirm whether or not a bar and a light guard bar are present. The judgment is performed.

(9): The barcode rectangular range search section 27
The barcode determination unit 26 searches for a range determined as a true barcode area, and extracts a rectangular area surrounding the barcode.

(10): The left guard bar comparison unit 28 registers the pattern of the area where the black pattern and the white pattern appear alternately and the pattern in the pattern dictionary of the pattern dictionary storage unit 23 at the request of the bar code determination unit 26. This is to compare with the left guard bar pattern.

(11) At the request of the bar code judging unit 26, the center bar comparing unit 29 registers the pattern of the area where the black pattern and the white pattern alternately appear and registers the pattern in the pattern dictionary of the pattern dictionary storage unit 23. This is to compare with the center bar pattern.

(12) At the request of the bar code determination unit 26, the light guard bar comparison unit 30 registers the pattern of the area where the black pattern and the white pattern appear alternately and the pattern in the pattern dictionary of the pattern dictionary storage unit 23. This is to compare with the pattern of the light guard bar.

(13): The barcode area comparing section 31 compares the barcode rectangular area extracted by the barcode rectangular range searching section 27 with the position information in the barcode position coordinate storage section 24 to obtain a barcode rectangular area. It is to determine whether the barcode rectangular area extracted by the range search unit 27 has already been extracted or has been newly extracted.

When the barcode area comparing section 31 determines that the barcode rectangular area has already been extracted, the barcode rectangular area extracted by the barcode rectangular area search section 27 is discarded. If it is determined that the barcode rectangular area is newly extracted, a process of registering the barcode rectangular area as a new barcode rectangular area is performed.

§2: Outline of Processing—See FIG. 3 FIG. 3 is a processing outline flowchart of the embodiment. Less than,
The processing outline of the embodiment will be described with reference to FIG. Note that S
1 to S8 indicate each processing step.

First, it is assumed that form image data (binary image data) read by the image reading unit 20 is stored in the image memory 21. In this state, the black / white pattern extraction unit 25
Is scanned in the main scanning direction (horizontal direction), and a black pattern (for example, 1 information) and a white pattern (for example, 0 information) in the extraction window are spaced within a preset threshold value. Assuming that a range appearing alternately as a barcode area is extracted (as a temporary barcode area) and stored in the RAM 32 (S1).

Next, the barcode determination section 26 determines whether the extracted temporary barcode area in the RAM 32 is really a barcode, and stores the barcode-specific left guard bar and center bar in the temporary barcode area. To determine whether a light guard bar exists (S
2).

In this case, the bar code determination unit 26 sends the pattern information of the extracted temporary bar code area to the left guard bar comparison unit 28, the center bar comparison unit 29, and the right guard bar comparison unit 30 and the pattern dictionary storage unit. A request is made for a comparison process with the pattern information in the pattern dictionary stored in 23.

The bar code judging section 26 adds a bar code to the extracted temporary bar code area based on the information of the comparison result from the left guard bar comparing section 28, the center bar comparing section 29 and the right guard bar comparing section 30. It is determined whether a code-specific left guard bar, center bar, and right guard bar exist.

As a result, if a left guard bar, a center bar, and a right guard bar exist in the extracted temporary barcode area, the area is determined to be a true barcode area, and the area is extracted. However, in the extracted temporary barcode area, a left guard bar, a center bar,
If the light guard bar does not exist, it is determined that the area is not a barcode, and the area is discarded.

Next, if it is determined in the process of S2 that the provisional bar code area is a true bar code area, the bar code rectangular range search section 27 searches the bar code range to surround the bar code. Rectangular area (barcode rectangular area)
Is determined, and the barcode rectangular area is extracted and stored in the RAM 32 (S3).

In this case, if it is a true bar code area,
Since the black bar extends in the sub-scanning direction (vertical direction), the center of the area determined as the bar code is scanned (searched) in the vertical direction, and a position where the vertical bar of the bar code is interrupted is defined as a range in the sub-scanning direction. The barcode rectangular area (the coordinates of the rectangular position) is determined.

Thereafter, since the image data of the entire form is finely scanned, the same barcode may be extracted many times. In order to prevent this, the barcode area comparison unit 31 stores the position information of the barcode rectangular area in the RAM 32 and the barcode position coordinate storage unit 2.
By comparing the position information (coordinate information) in No. 4 with the barcode, it is determined whether or not the barcode rectangular area newly extracted this time overlaps with the already extracted barcode (S4).

As a result, if they are not overlapped and are newly extracted, the barcode area comparison unit 31
Newly registers the position information (coordinate information) of the newly extracted barcode rectangular area in the barcode position coordinate storage unit 24 (S5). However, if the barcode area overlaps with the already extracted barcode rectangular area, the already extracted barcode area is left, and the newly extracted barcode area is discarded (S6).

As described above, the search line is advanced in the sub-scanning direction (S8) until the entire form is searched (S7), and the process from S1 is repeated. Then, when the entire form is searched, the process ends. As described above, the barcode rectangular area can be automatically extracted from the image data of the form.

The barcode rectangular area extracted as described above is then subjected to recognition processing (recognition of barcode information) by an existing barcode recognition device. §3: Description of bar code extraction processing by specific example: see FIGS. 4, 5, and 6 FIG. 4 is a diagram showing an example of a form, FIG. 5 is a processing explanatory diagram of the embodiment (part 1), FIG. FIG. 9 is a diagram (part 2) for explaining the processing of the embodiment. Hereinafter, the processing of the embodiment according to the specific example will be described with reference to FIGS.

As an example of a form read by the image reading section 20, there is a form example as shown in FIG. This example of a form is a form used for paying an electricity bill out of a public utility bill, and has bar codes 34 provided at a plurality of locations.

The form is read by the image reading unit 20, the input image data is converted into binary image data (binary image data) and stored in the image memory 21. The barcode is extracted by scanning the image data in the box.

In this case, the point P, which is the first position (storage start address) of the image data storage area in the image memory 21, is set as the origin of the XY coordinates (X, Y = 0, 0). Scanning is performed with the X-axis direction (horizontal direction) of the XY coordinate set as the main scanning direction and the Y-axis direction (vertical direction) set as the sub-scanning direction.

[0070] When performing the scan, to start scanning in the main scanning direction (X axis direction) from the illustrated Y ₁ line, then performs sequential scan while advancing the line to be scanned in the sub-scanning direction (Y axis direction) since, through the Y _e line, move further Y _h line, finally terminates all scan scanning hard Y _n lines. The main scanning direction of the scan start point is X _0, the scan end point is X _m.

Hereinafter, specific processing will be described. First, in the OCR device 7, the image reading unit 20 reads the form, inputs the form image data, converts the form image data into binary image data, and then converts the image data (2
The value image data) is developed in the image memory 21.

Next, the black / white pattern extraction unit 25
Extracting the window WD (e.g., vertical 1 × 24 horizontal pixels) as shown in Set, continue to scan on Y ₁ line in the main scanning direction in FIG. 4 the extracted the window WD (X axis direction), A pattern (complex pattern area) in which black (1 information) and white (0 information) appear alternately is searched.

[0073] In the example of the form, the Y ₁ line, since the pattern as absent, scanned similarly set the extracted the window WD to the beginning of the next line.
A case where the _Ye line is scanned in this way will be described.

As shown in FIG. 5, a point where black / white patterns alternately appear is a barcode start point SP, and a point where the black / white pattern disappears in the extraction window WD is a barcode end point EP. Each X coordinate is extracted as a barcode area candidate (temporary barcode area).

Here, in order to confirm whether or not the extracted temporary barcode area (the area where the black / white pattern appears alternately) is really a barcode area, the barcode determination unit 26 determines whether or not the extracted temporary barcode area is a barcode area. In the code area, a left guard bar unique to a bar code (start information of bar code = 101 as shown in FIG. 6), a right guard bar (end information of bar code = 101 as shown in FIG. 6), and a center bar (FIG. 6)
It is determined whether or not barcode center information = 001010) exists.

Incidentally, the left guard bar, the center bar, and the right guard bar are configured as shown in FIG. That is, the left guard bar (or start bar) is provided on the bar code start point SP side (left side), is configured by a pattern in which black bars and white bars are alternately arranged, and “101” is used as bar code start information. This is a pattern in which information is set.

The center bar is provided at the center position of the bar code, and is constituted by a pattern in which black bars and white bars are alternately arranged.
This is a pattern in which information “0” is set. The light guard bar (or end bar) has a bar code end point EP.
This pattern is provided on the side (right side), and is a pattern in which black bars and white bars are alternately arranged, and "101" is set as barcode end position information.

As described above, the left guard bar (information of 101), the right guard bar (information of 101), and the center bar (01010) are added to the extracted temporary barcode area.
As a result of determining whether or not the extracted temporary barcode area does not exist, it is determined that the extracted temporary barcode area is not a barcode area.

In this case, the extraction window WD is further advanced in the main scanning direction (X-axis direction), and an area where the next black pattern and white pattern appear alternately is extracted. When the processing is performed as described above and the main scanning direction is the end point of the X coordinate, the extraction window WD is set at the head of the next sub-scanning direction (Y-axis direction) and the same search is performed.

[0080] Similarly, as it follows when scanning a Y _h line. As shown in FIG. 6, a point at which the black / white pattern starts to appear alternately is defined as a barcode start point SP, and a point at which the extracted window WD has no black / white pattern is defined as a barcode end point EP. Each X coordinate is extracted as a code area (barcode area candidate).

As described above, the barcode determination section 26 determines whether or not the extracted temporary barcode area is really barcode information. As a result, if it can be determined that the area is the barcode area, even if there is dust information before the left guard bar and dust information after the right guard bar, the start point SP of the barcode is set to the coordinates of the left guard bar. By setting the bar code end point EP to the coordinates of the light guard bar, the dust information can be removed.

Next, the extraction window WD is set at the middle point between the barcode start point SP and the barcode end point EP, and the extraction window WD is moved in the upper side sub-scanning direction UD, so that the vertical bar of the barcode is interrupted. Let UE be the upper end of the barcode rectangular area. Next, the extraction window WD is moved in the lower side sub-scanning direction LD, and the position LE where the vertical bar of the barcode is interrupted is similarly set as the lower end of the barcode rectangular area.

By the above processing, the position information where the first barcode exists can be extracted as a rectangular area of the start point and end point of the X coordinate, the start point of the Y coordinate, and the end point. The code rectangle position information (barcode rectangle area) is temporarily stored in the RAM 32.

Subsequently, the extraction window WD is further advanced in the main scanning direction (X-axis direction) from the position extracted in the above processing, and the next bar code information is similarly extracted. Here, since scanning is sequentially performed in the sub-scanning direction (Y-axis direction), the same barcode information may be extracted twice.

To prevent this, the newly extracted RA
The barcode rectangular area (position information) in M32 is compared with the information in the barcode position coordinate storage unit 24. By this processing, if the newly extracted barcode rectangular area overlaps with the already extracted barcode rectangular area, the newly extracted barcode rectangular area is discarded, and if it does not overlap, another The bar code rectangular area (bar code position information) is newly registered in the bar code position coordinate storage unit 24.

[0086] In this manner, it continues to sequentially scan up to the last line of the document image (Y _n lines), to extract all of the barcode rectangular area (barcode position information).
As described above, by scanning the input image data (binary information), only the true barcode can be automatically extracted from the image data. Therefore, for example, when a bill for payment of a utility bill such as an electricity bill, telephone bill or the like on which a barcode is printed is brought to a bank or the like, if the bill is read by an image scanner, the barcode of the form is read by a barcode extraction device. Can be automatically extracted.

For this reason, if the barcode is recognized by the existing barcode recognition device based on the information of the barcode rectangular area extracted by the barcode extraction device, the payment of the utility charge using the barcode can be made. Automatically and easily.

§4: Detailed explanation of bar code extraction processing by flowcharts ... refer to FIGS. 7 to 9 FIG. 7 is a processing flowchart (part 1) of the embodiment, and FIG. 8 is a processing flowchart (part 2) of the embodiment. FIG. 9 is a processing flowchart (part 3) of the embodiment. Hereinafter, FIGS.
The processing of the embodiment will be described based on the flowchart of FIG. In addition, S11 to S34 indicate each processing step.

First, in the OCR device 7, the image reading section 20 reads a form (see FIG. 4) with a scanner (S1).
1) After converting the form image data into binary image data (binary image data), the image memory 2
1 (S12).

Thereafter, the black / white pattern extracting section 25 scans the image data (binary image data) in the image memory 21 to extract the black / white pattern. In this process, an extraction window WD (see FIG. 5) is prepared,
Scanning is performed in the main scanning direction (X-axis direction) of the image memory 21 to search for an area where a black pattern (1 information) and a white pattern (0 information) alternately appear.

First, the black / white pattern extraction unit 25 advances the extraction window (extraction window) WD by one in the main scanning direction (X-axis direction) (S13). Then, it is determined whether or not all scanning has been performed in the main scanning direction (S14). If not all scanning has been performed, whether or not a black pattern (1 information) and a white pattern (0 information) are present in the extraction window WD. Is determined (S15).

As a result, if there is no black pattern and white pattern information, the processing is repeated from the processing in S13. However, if there is black pattern and white pattern information in the process of S15, the position is temporarily stored in the RAM 32 as the start point of the barcode area (S16).

Then, the extraction window WD is advanced by one in the main scanning direction (X-axis direction) of the image memory 21 (S17), and a black pattern (1 information) and a white pattern information (0 information) are included in the extraction window WD. It is determined whether or not there is (S18).

As a result, if there is a black pattern (1 information) and a white pattern information (0 information), the processing is repeated from the processing of S17. If there is no black pattern (1 information) and no white pattern information (0 information), the position is temporarily stored in the RAM 32 as the end point of the barcode area (S1).
9).

On the other hand, in the processing of S14, when all the scans have been performed in the main scanning direction, the black / white pattern extraction unit 25 sets the search position in the main scanning direction to advance the line to be searched in the sub-scanning direction (Y-axis direction). the return to the starting point X ₀ (S20). Then, it is determined whether or not the entire form has been searched (S2).
1) When the entire form is searched, the process ends. However, when the entire form is not searched, the processing is repeated from the processing of S13.

When the form is searched as described above and the black / white pattern extraction unit 25 extracts the temporary barcode area where the black pattern and the white pattern alternately appear, the temporary barcode area is stored in the RAM 32. Then, the barcode determination unit 26 determines whether the extracted temporary barcode area is a true barcode area.

In this processing, the bar code determination section 26
The left guard bar comparison unit 28 is requested to compare the left guard bar, the center bar comparison unit 29 is requested to compare the center bar, and the right guard bar comparison unit 30 is requested to compare the right guard bar. Then, it is determined whether or not the extracted temporary barcode area is a true barcode area based on the comparison result of each of the comparison units.

In this case, the barcode determination section 26 first determines whether or not the extracted temporary barcode area has a left guard bar (S22). If there is no left guard bar, the temporary barcode area is true. , The information (coordinates) of the start point and end point of the temporary bar code stored in the RAM 32 is cleared, and the processing is repeated from the above-mentioned S13.

If it is determined in step S22 that there is a left guard bar, there is a possibility of a barcode, so it is determined whether or not a center bar exists in the extracted temporary barcode area (S23). . As a result, if there is no center bar, the temporary barcode area is not a true barcode area. Therefore, the information (coordinates) of the start point and the end point of the temporary barcode area stored in the RAM 32 is cleared, and Repeat from processing.

Furthermore, if there is a center bar in the temporary barcode area extracted in the process of S23, there is a possibility of a barcode, so it is determined whether or not a light guard bar exists in the extracted temporary barcode area. (S24). as a result,
If there is no light guard bar in the extracted temporary barcode area, since the temporary barcode area is not a true barcode area, the information (coordinates) of the start point and end point of the temporary barcode area stored in the RAM 32 is cleared. It repeats from the process of S13.

However, if there is a light guard bar in the processing of S24, the provisional barcode area can be determined to be a true barcode area, so that the barcode rectangular area search unit 27 searches for the barcode rectangular area. I do.

In this process, the barcode rectangular range search unit 27 first determines the start point SP and the end point EP of the barcode for a barcode determined by the barcode determination unit 26 as described above. The extraction window WD is placed in the vicinity of the center of, and the search is performed in the upward direction (the upward direction of the barcode in the sub scanning direction) (S26).

Then, it is determined whether or not the black dot of the vertical bar is interrupted (S27). Until the black dot is interrupted, the extraction window WD is located near the center between the start point SP and the end point EP of the bar code.
And search upward (in the sub-scanning direction, above the barcode) (S26). When the black dots on the vertical bar are interrupted as described above, the upper end position of the bar code area is determined (S28).

Next, the barcode rectangular range search section 27
The extraction window WD is placed near the center between the barcode start point and the end point, and a search is made in a downward direction (downward in the sub-scanning direction) (S29).

Then, it is determined whether or not the black dot on the vertical bar is interrupted (S30). Until the black dot is interrupted, the extraction window WD is placed near the center between the start and end points of the bar code.
The search is performed in the downward direction (downward in the bar code in the sub-scanning direction) (S29). When the black dots on the vertical bar are interrupted as described above, the lower end position of the bar code area is determined (S3).
1).

Thereafter, based on the position information in the bar code position coordinate storage unit 24, the bar code area comparison unit 31 determines whether the extracted bar code rectangular area overlaps with the already extracted bar code rectangular area. It is determined whether or not it is (S32). As a result, if they overlap, the barcode area already extracted is left, and the newly extracted barcode area is discarded (S34). And the S1
The processing is repeated from the processing of step 3.

However, if it is determined in the processing of S32 that they do not overlap, the newly extracted barcode area is newly stored in the barcode position coordinate storage unit 24 because the barcode area is extracted for the first time. Register (S3
3). Then, the process is repeated from the process of S13.

The barcode rectangular area (position coordinate information) extracted in the above processing is stored in the barcode position coordinate storage unit 2.
4, the barcode rectangular area (position coordinate information) is read out in the subsequent processing, and barcode recognition processing is performed.

(Other Embodiments) Although the embodiments have been described above, the present invention can be implemented as follows. (1): In the above-described embodiment, the scanning in the sub-scanning direction (Y-axis direction) is described for each line. However, by utilizing the feature that the vertical bar of barcode information is long (at least 50 lines), for example, , Every 20 lines. In this case, the number of times of scanning is reduced, and the barcode can be extracted more quickly.

(2): In the above-described embodiment, the entire scanning start line in the sub-scanning direction (Y-axis direction) was searched from the beginning to the end of the form, but the position of the bar code printed on the form is Regularity (not at the top / bottom)
Therefore, by narrowing the width in the sub-scanning direction for scanning, the number of times of scanning can be reduced, so that barcode extraction can be performed at higher speed.

(3) In the above-described embodiment, one vertical pixel of the extraction window is used. However, the barcode information uses a characteristic that a black bar is long in the vertical direction, and the vertical pixels of the extraction window are divided into a plurality of pixels. And A between vertical pixels in the extraction window
By taking ND, it is also possible to extract a barcode. In this case, it is possible to perform a process of not extracting a pattern other than the barcode feature.

(4): The barcode extraction device may be realized by an OCR device, but may be realized by any other similar device. For example, an image scanner is connected to a computer such as a personal computer or a work station. The image scanner reads form information, converts the form image data into binary data, and stores it in an image memory. Then, similarly to the above embodiment, the barcode may be extracted from the form image data in the image memory.

Further, the image data can be similarly implemented by using image data input from a facsimile machine or the like.

[0114]

As described above, the present invention has the following effects. (1): By scanning input image data (binary information), only true barcodes can be automatically extracted from the image data.

Therefore, for example, when a form for paying a utility bill such as an electricity bill or telephone bill on which a barcode is printed is brought into a bank or the like, the form is read by an image scanner, and the form is read by a barcode extraction device. Can be automatically extracted.

For this reason, if barcode recognition is performed by an existing barcode recognition device based on the information of the barcode rectangular area extracted by the barcode extraction device, payment of a utility charge or the like using the barcode can be made. Automatically and easily.

(2): Since the barcode can be automatically extracted from the image data, the barcode can be extracted without creating a definition body as in the related art and without requiring any manual work. And the operation of the operator becomes easy.

(3): After extracting the true barcode rectangular area from the image data, the barcode is recognized from the extracted barcode rectangular area. Therefore, the barcode recognition processing is not performed for the non-barcode area. Thus, high-speed processing can be performed as compared with the case where barcodes are recognized at once from the entire image data.

In addition to the above-described effects, the following effects are provided corresponding to each claim. (4) In the first aspect, the entire area of the image data stored in the image memory is sequentially scanned, and an area where a black pattern and a white pattern alternately appear is extracted as a temporary barcode area. A barcode extraction unit is provided for determining whether or not barcode-specific information exists for a code area and extracting only a true barcode area.

Therefore, by scanning the image data (binary information), a true bar code can be automatically extracted from the image data. For this reason, the barcode can be automatically extracted without creating a definition body as in the related art and without requiring any manual operation, thereby facilitating the operation of the operator.

(5): In the second aspect, the barcode extraction unit determines whether or not each information of the left guard bar, the center bar, and the right guard bar exists as the barcode-specific information in the extracted temporary barcode area. Then, only when the information of each bar exists, the temporary barcode area is extracted as a true barcode area. Therefore, only the true barcode area can be reliably extracted from the temporary barcode area.

(6): In the third aspect, the bar code extracting section searches the rectangular range of the extracted true bar code area to determine the position of the rectangular area surrounding the bar code, thereby obtaining the true bar code area. The area is extracted as a barcode rectangular area.

Therefore, all barcode information can be reliably extracted based on the position of the rectangular area surrounding the barcode, so that subsequent barcode recognition processing can be performed reliably. (7): In claim 4, in order to prevent the same barcode from being registered twice, the barcode extracting unit compares the newly extracted barcode rectangular area with the already extracted barcode rectangular area. Only when there is no overlap, the newly extracted barcode rectangular area is registered as a new barcode rectangular area.

Therefore, double registration of the same bar code can be reliably prevented. For this reason, in the barcode recognition process performed thereafter, unnecessary barcode recognition processing is not required, thereby improving processing efficiency.

(8) In claim 5, the image memory and the black / black
It includes a white pattern extraction unit, a barcode determination unit, a barcode rectangle range search unit, and a barcode area comparison unit. Therefore, by scanning the image data (binary information), a true barcode can be automatically extracted from the image data. For this reason, the barcode can be automatically extracted without creating a definition body as in the related art and without requiring any manual operation, thereby facilitating the operation of the operator.

(9): In claim 6, the image memory is a memory for storing binary image data obtained by converting image data of a form into binary data. Therefore, by scanning the form image data (binary information), a true barcode can be automatically extracted from the form image data. For this reason, the barcode can be automatically extracted without creating a definition body as in the related art and without requiring any manual operation, thereby facilitating the operation of the operator.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating the principle of the present invention.

FIG. 2 is an apparatus configuration diagram of an embodiment.

FIG. 3 is a processing outline flowchart of the embodiment.

FIG. 4 is a diagram showing an example of a form in the embodiment.

FIG. 5 is an explanatory diagram (1) of a process according to the embodiment;

FIG. 6 is an explanatory diagram (part 2) of the process according to the embodiment.

FIG. 7 is a processing flowchart (part 1) of the embodiment.

FIG. 8 is a processing flowchart (part 2) of the embodiment.

FIG. 9 is a process flowchart (part 3) of the embodiment.

FIG. 10 is an explanatory diagram of a barcode recognition process performed by a conventional POS terminal device.

FIG. 11 is an explanatory diagram of a barcode recognition process performed by a conventional OCR device.

[Explanation of symbols]

 Reference Signs List 20 image reading unit 21 image memory 22 barcode extraction unit 23 pattern dictionary storage unit 24 barcode position coordinate storage unit 25 black / white pattern extraction unit 26 barcode determination unit 27 barcode rectangular range search unit 28 left guard bar comparison unit 29 center Bar comparison unit 30 Light guard bar comparison unit 31 Barcode area comparison unit

──────────────────────────────────────────────────続 き Continuing from the front page (72) Inventor Hideyuki Inaoka 1015 Uedanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture Inside Fujitsu Limited (72) Inventor Eiichi Watanabe 1015 Kamikodanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture Fujitsu Limited (72) Inventor Shunji Sakane 1015 Uedanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture Inside Fujitsu Limited (72) Inventor Satoshi Naoi 1015 Ueodanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture Examiner in Fujitsu Limited Shun Umezawa (56) Reference Reference JP-A-4-263381 (JP, A) JP-A-5-233867 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) G06K 7/00 G06K 7/10

Claims (1)

(57) [Claims] 1. An image memory for storing image data, and an entire area of the image data stored in the image memory is sequentially scanned, and a black pattern and a white pattern alternately appear at an interval within a preset threshold value. extracting the area as a temporary barcode area, the extracted temporary bar coding region to determine whether or not the bar code specific information is present, a bar code extracting unit for extracting only true barcode region , The barcode extraction unit stores the extracted temporary barcode area
Left guard bar, center as barcode specific information
Bar and light guard bar information.
Judge, and only when the information of each bar is present,
The temporary barcode area is extracted as a true barcode area, and the rectangular area of the extracted true barcode area is searched.
By determining the position of the rectangular area surrounding the barcode
And extract the true barcode area as a barcode rectangular area.
A bar code extraction device characterized by having a function of outputting a bar code.