JP2007066000A - Personal digital assistance and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a personal digital assistance and an image processing method capable of obtaining and outputting clear image data even if a captured image of an information code is distorted. <P>SOLUTION: When capturing the image of the information code such as a bar code and a QR (Quick Response) code, a control section of this personal digital assistance detects the alignment of the information code and a bar width or a data cell size, or an information unit, from bright and dark patterns of the image, normalizes the bar width or the data cell size based on the sizes and normalizes the bar code or QR code image based on the normalized information unit. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention is a portable device comprising imaging means for capturing an image, image processing means for processing data of the captured image, and data output means for outputting the processed image data to a predetermined output destination. The present invention relates to an information terminal and an image processing method for capturing an image, processing data of the captured image, and outputting the processed image data to a predetermined output destination.

In recent years, in addition to barcodes, two-dimensional codes such as QR codes (registered trademark) have been widely used, and the situation where they are used in daily life is increasing. As a result, a barcode or a two-dimensional code is imaged by, for example, a mobile phone with a camera function, and the code is displayed on a display or output to a printer or the like to be printed by a code reader. There is a case of reading.
However, assuming the above situation, if the image of the captured information code is unclear, the information code displayed or printed on the display is unclear, so that the code reader can read the information code. Will fail. The reason why the image of the information code becomes unclear is that, for example, camera shake or defocusing occurs when the image is taken, or the reading surface of the area sensor is greatly inclined with respect to the information code arrangement surface so that the two are not parallel. This is probably because the image of the captured information code is distorted.

Here, as a technique for displaying the image of the captured information code on the display means, for example, as disclosed in Patent Document 1, numeric information such as an account number and a deposit balance is displayed on the automatic transfer terminal side as a QR code. Are converted to a bit string based on this arrangement rule and transmitted to a mobile phone, and the mobile phone converts the transmitted bit string into a light and dark pattern to display a QR code image on an LCD.
Japanese Patent Laid-Open No. 2004-228688 discloses a display of a bar code acquired by a keyboard, a scanner, a data reading device, a browser that can download information from the Internet, and the like. A technique for creating and arranging barcodes according to a layout according to display specifications is disclosed.
JP 2002-111809 A JP 2002-117372 A

However, none of these conventional techniques assumes that the information code image that is the display source is in an unclear state, and the display is performed on the assumption that the information code image (or data) is normal. Is related to the control of Therefore, it cannot be said that these conventional techniques contribute to the solution of the above technical problem.
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a portable information terminal capable of obtaining and outputting clear image data even when an image of a captured information code is distorted, and image processing. It is to provide a method.

According to the portable information terminal of claim 1, when the image pickup means picks up the image of the information code, the pattern detection means of the image processing means inspects the light / dark pattern of the image and detects the arrangement of the light pattern and the dark pattern. Then, when the information unit setting unit detects the size of the information unit based on the arrangement of the light and dark patterns, the information unit setting unit sets a predetermined shape and a normalized information unit having a predetermined size based on the size of the information unit.
Further, the normalized image generating means generates a normalized image by replacing each of the bright and dark patterns with the set normalization information unit, and the data output means outputs the generated normalized image to a predetermined value. Output to the output destination. Therefore, even when the captured image of the information code is distorted or unclear, the distortion is corrected by obtaining the shape and size of the information unit of the information code image and normalizing the image. Information code image data can be generated and output.

  According to the portable information terminal of the second aspect, the code type setting means presets the type of information code to be normalized, and the specific pattern detection means of the image processing means is determined by the type of information code. The specific specific pattern is detected from the array of light and dark patterns detected from the captured image. Further, the code type discriminating unit discriminates the type of information code included in the image captured based on the position or size of the specific pattern, and the information unit setting unit has a shape corresponding to the discriminated code type. Set the normalized information unit. That is, since the information code has a specific pattern specific to each type, the type of the information code included in the image can be easily determined by detecting the specific pattern. Since the normalized information unit can also be set according to the determined type of information code, the normalization process can be performed quickly.

According to the portable information terminal of the third aspect, since the code type setting means sets at least one type of information code to be subjected to normalization processing, the type of information code assumed as a reading target in advance is set. By specifying, it is possible to more quickly determine the type.
According to the portable information terminal of claim 4, when the information unit setting means sets the normalized information unit, the normalized specific pattern image configured by a pattern having a size of the normalized information unit and a predetermined size. And a normalized specific pattern image is arranged at a position corresponding to the detected specific pattern. That is, depending on the type of information code, there is a specific pattern that is configured to have a size of a unit of information and a predetermined ratio. Therefore, by configuring as described above, the normalization process of the specific pattern is easier. Can be done.

  According to the portable information terminal of the fifth aspect, the code type setting unit sets the arrangement reference direction according to the type of the information code, and the image processing unit sets the information code image detected by the arrangement direction detection unit. The arrangement direction of the normalized image is corrected so that the arrangement direction matches the arrangement reference direction. Therefore, even when the image of the information code captured by the user is tilted with respect to the set arrangement reference direction, the normalized information code image data can be output in a state matched with the arrangement reference direction. it can.

  According to the portable information terminal of claim 6, the image processing means is configured to detect 90 degrees with respect to the reference direction when the angle formed by the detected arrangement direction with respect to the arrangement reference direction exceeds ± 90 degrees, or The arrangement direction of the normalized image is corrected so as to coincide with the direction rotated by 180 degrees or 270 degrees. Therefore, no matter what state the image of the captured information code is tilted, the direction of the normalized image is either the array reference direction or any direction rotated by 90 degrees on the basis of it Can match.

  According to the portable information terminal of the seventh aspect, when correcting the arrangement direction of the normalized image, the image processing means matches the direction in which the angle for rotating the image is the smallest. Therefore, when the direction of the captured information code image is tilted by more than ± 90 degrees with respect to the array reference direction, the image is picked up from any of the directions rotated by 90 degrees with respect to the array reference direction. The direction of the normalized image can be matched with the direction closest to the state.

According to the portable information terminal of claim 8, the operation control means corrects the arrangement direction to the image processing means when an operation instruction is issued to cause the arrangement direction to be corrected via the operation instruction means from the user. Therefore, the user can select whether or not to correct the arrangement direction for each captured image.
According to the portable information terminal of the ninth aspect, since the operation control means outputs and displays the data of the image captured by the imaging means on the display means, the user confirms the image displayed on the display means. Images can be captured.

According to the portable information terminal of the tenth aspect, when the operation control unit displays the image captured by the imaging unit on the display unit, the operation control unit also determines whether the normalized image generation unit executes the normalization process. When a message for prompting the user to select is displayed, and when there is an operation instruction to be executed by the user, normalization processing is executed. Therefore, when the captured information code image is clear, normalization processing is not performed, and normalization processing can be performed only when the information code image is unclear.
According to the portable information terminal of the eleventh aspect, the data output means outputs and displays the normalized image on the display means, so that a clear information code image can be displayed on the display means.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. FIG. 6 schematically shows an electrical configuration of a part related to image data processing in the portable information terminal.
As shown in FIG. 6, the portable information terminal 1 includes LEDs 2 and 3 that project illumination light onto a recording surface R of an information code to be read, a lens 4 that captures an image of the recording surface R, and An image pickup means for picking up an image composed of a CCD 5 (Charge Coupled Device) is provided. The control unit 6 for performing the overall control is configured to include a CPU, a ROM, a RAM, an I / O, and a bus (not shown) for connecting them, and is set in advance. Various controls such as image processing are performed based on the program.

The above-described image signal output terminal of the CCD 5 is connected to the memory 10 via the amplifier circuit 7 and the A / D conversion circuit 8. The image signal picked up by the CCD 5 is amplified in an analog manner by the amplifier circuit 7, converted into a digital signal through the A / D conversion circuit 8, and then output to the memory 10 and stored therein.
The synchronization signal generation circuit 11 provides a synchronization signal to the CCD 5 and address generation circuit 12. The address generation circuit 12 outputs an address signal based on the synchronization signal to the memory 10. The LEDs 2, 3, amplifier circuit 7, A / D conversion circuit 8, memory 10, and synchronization signal generation circuit 11 are configured to receive a control signal from the control unit 6 and to exchange information.

The portable information terminal 1 is provided with an operation switch 13 (corresponding to an operation instruction unit) for performing various operation inputs, and an input is received by the controller 6. In addition, the control unit 6 includes an LED 14, a buzzer 15, a liquid crystal display 16 (corresponding to display means) for displaying a control state and a notification operation, a communication interface 17 for communicating with an external device, and the like. It is connected. A battery 18 is provided as a drive source for each circuit.
In the present embodiment, the control unit 6 has various functions as an image processing means (pattern detection means, information unit setting means, normalized image generation means, specific pattern detection means, code type discrimination means, array direction detection means). Have. The control unit 6 also functions as data output means, code type setting means (reference direction setting means), and operation control means.

Next, the operation of this embodiment will be described with reference to FIGS. The term “normalization” used herein refers to an image whose shape is distorted or whose contrast is unclear, such as the image shown on the left side of FIG. As shown, it means that the image is converted into a clear image without distortion.
Information codes to be subjected to normalization include bar codes (JAN, Code 39, Code 128), PDF417, QR code, micro QR code, data matrix, maxi code, and the like. The control unit 6 includes specific patterns specific to these representative information codes, for example, in the data matrix, an L-shaped alignment pattern (L-shaped guide cell) arranged on the outer frame of the code, a dotted timing cell, a maxi- mum. The code is set in advance so that the type of the information code can be discriminated from the double circle finder pattern arranged in the center.

  FIG. 3 is a flowchart showing information code image normalization processing performed mainly by the control unit 6 of the portable information terminal 1. First, when illumination light from the LEDs 2 and 3 is projected from a plurality of directions onto a recording surface R such as a sheet on which an information code is recorded, the reflected light is incident on the imaging surface of the CCD 5 via the lens 4. Imaged. In FIG. 3, the control unit 6 captures the image signal picked up by the CCD 5 into the memory 10 as image data via the amplifier circuit 7 and the A / D conversion circuit 8 (step S <b> 1). However, before the image is captured by the user's operation, the control unit 6 sequentially outputs the image data in the memory 10 to the liquid crystal display 16 so that the image captured by the CCD 5 is directly in real time. Displayed (so-called viewfinder function). As an example, FIG. 7 shows a state in which the viewfinder function is operating when the portable information terminal 1 is configured as a mobile phone.

Then, the control unit 6 estimates the area where the information code exists from the light and dark levels of the image data taken into the memory 10 (step S2), and various information in the area where the information code exists. A specific pattern specific to the code is detected (step S3). Next, the control unit 6 determines the type of the information code from the detected specific pattern, and if the determined information code is a one-dimensional code such as a barcode (“YES” in step S4), the process proceeds to step S6. Then, the normalization process of the one-dimensional code image is executed.
On the other hand, if the determined information code is a two-dimensional code such as a QR code (“YES” in step S5), the process proceeds to step S11, and normalization processing of the two-dimensional code image is executed. If none of the information codes correspond (NO in steps S4 and S5), the process ends. If the information code is a bar code, the type is also determined in step S3.

First, a process for normalizing a barcode as shown in FIG. As shown in FIG. 2A, the control unit 6 detects the bar arrangement direction so as to obtain the vertical bisector of the bar of the barcode image (step S6). When the widths of the bars and spaces are detected along the bar arrangement direction, the ratio between the widths of the detected bars and spaces is obtained, and rounding processing is performed so that the ratio becomes an integer value.
For example, the ratio of the widths obtained when the minimum width (reference dimension) is the reference “1” is (1.2) :( 1.2) :( 1.1) :( 2.4): If (2.4) :( 2.3) :( 1.1):..., The ratio is 1: 1: 1: 2: 2: 2: 1: is set (step S7). Then, the width of each bar and space is calculated according to the calculated integer ratio (step S8), and the average value is calculated from the length of each bar (step S9). The width reference in step S8 is also set to be equivalent to the average of each width. Then, the control unit 6 generates bar image data and space image data having the calculated integer ratio width and the calculated average bar length, that is, normalized image data (step S10). Data is output and displayed on the liquid crystal display 16 (step S11).

  Next, a process for normalizing a two-dimensional code such as the QR code shown in FIG. First, the control unit 6 specifies the type of information code from the detected graphic feature of the specific pattern (step S12). That is, in the case of a QR code, the specific pattern is a “cutout symbol”. Further, the shape of information units constituting each information code is also determined based on the specific pattern. That is, in the case of QR code, it is a rectangular data cell, and in the case of maxi code, it is a hexagonal data cell. Then, the average data cell size (reference dimension) and the number of vertical and horizontal data cells are estimated from the size and position of the specific pattern (step S13). In the case shown in FIG. 1, it is determined that the QR code is 21 × 21 cells from the size of the cut symbol.

Next, as shown in FIG. 1B, information code image data in which specific patterns and data cells are arranged at predetermined positions is generated (step S14). In the case of the QR code, the width ratio of the cut symbol is 1: 1: 3: 1: 1 with the cell size being “1”. Therefore, image data of the cut symbol is generated according to the ratio, It is placed at the position (three places, upper left corner, lower left corner, upper right corner in the figure). However, at this time, the data cells are only positioned, and the value (white / black) of each cell is blank (blank). In FIG. 1B, squares are displayed to show the arrangement of the data cells, but an image in which squares are drawn is not generated as actual processing.
Then, as shown in FIG. 1C, the control unit 6 detects the brightness of each data cell based on the position and size of the specific pattern (that is, binarizes the image data of each cell). Then, the blank data cell at the corresponding position is replaced with a light or dark data cell image (step S15), and the normalized image data is output and displayed on the liquid crystal display 16 (step S16).

As described above, according to the present embodiment, when an image of an information code is captured by the portable information terminal 1, the control unit 6 determines the arrangement of the information code and the data that is the information unit from the bright and dark patterns of the image. The cell size or bar width is detected, the data cell size or bar width is normalized based on the size, etc., and the information code image is normalized based on the normalized information unit.
Therefore, even when the image of the captured information code is distorted or unclear, the distortion is corrected by obtaining the shape and size of the information unit of the information code image and normalizing the image. Information code image data can be generated and the image data can be output to the liquid crystal display 16. That is, since a clear information code image without distortion can be displayed on the screen of the liquid crystal display 16, if the information code image is read by an information code reader or the like and decoded, the information in the code is displayed. Can be obtained.

Further, when the control unit 6 detects a specific pattern of the information code from the bright and dark patterns of the captured information code image data, the control unit 6 sets in advance and determines the type of the information code from the specific pattern. Normalization processing was performed by setting the shape, size, or bar width of the data cell corresponding to the type of information code.
Therefore, the type of the information code included in the image can be easily determined by detecting only a specific specific pattern that the information code has for each type. Since the shape, size, or bar width of the data cell as the normalized information unit can be set according to the determined information code type, the normalization process can be performed quickly. Furthermore, since the control unit 6 has set in advance a typical information code type that is supposed to be subjected to normalization processing, it can determine the information code type more quickly.

  Further, the control unit 6 generates a specific pattern image normalized so as to have a predetermined ratio from the data cell size or bar width as a normalization information unit, and the specific detection detected from the captured image data Since the normalized specific pattern image is arranged at the position corresponding to the pattern, normalization processing of the specific pattern can be performed more easily. In addition, since the control unit 6 sequentially outputs the image data captured in the memory 10 to the liquid crystal display 16 for display, the user confirms the image displayed on the liquid crystal display 16. Images can be captured.

(Second embodiment)
7 to 10 show a second embodiment of the present invention. The same parts as those in the first embodiment are denoted by the same reference numerals and the description thereof is omitted, and only different parts will be described below. Usually, when an image of an information code is captured using a portable information terminal with a camera function or the like, the image is captured while the user holds the portable information terminal 1 with his / her hand. When the image is displayed on the liquid crystal display 16 as it is, the image is inclined as shown in FIGS. 8 and 10 in most cases. Therefore, in the second embodiment, a direction correction process when displaying an information code image will be described.

First, the case of correcting the arrangement direction of the barcode image will be described with reference to the flowchart shown in FIG. This flowchart is a partial equivalent diagram of FIG. 4 in the first embodiment, in which step S17 is added between steps S10 and S11. In the second embodiment, the control unit 6 sets the directions parallel to the upper and lower sides of the rectangular display screen of the liquid crystal display 16 as the arrangement reference direction when displaying the information code image. .
Then, the control unit 6 corrects the arrangement direction of the bars detected in step S6, that is, the arrangement direction of the barcode image so as to coincide with the above arrangement reference direction (step S17), and corrects the arrangement direction. The converted image data is output and displayed on the liquid crystal display 16 (step S11). For example, as shown in FIG. 8, when the arrangement direction of the bar and space of the captured barcode image is inclined at an angle α with respect to the arrangement reference direction indicated by a broken line in the figure, Rotate them so that their directions match (become parallel).

Next, the case of correcting the arrangement direction of a two-dimensional code image such as the QR code shown in FIG. 10 will be described with reference to the flowchart shown in FIG. This flowchart is also a partial equivalent diagram of the first embodiment, in which step S18 is added between steps S12 and S13, and step S19 is added between steps S15 and S16.
First, by the same processing as in the first embodiment, the control unit 6 determines that the captured information code image is a QR code of 21 × 21 cells (step S12), and the arrangement direction of this QR code image (ie, the QR code image) The two-dimensional arrangement direction of the data cells is detected (step S18). Note that the two arrows shown in FIG. 10A indicate the arrangement direction of the QR code image. Thereafter, processing similar to that in the first embodiment is performed from step S13 to step S15, and normalized QR code image data is generated as shown in FIG. At this time, the arrangement direction of the images is the same as the captured state.

  In step S19, the control unit 6 corrects the arrangement direction of the QR code image (here, the direction in which the two cut-out symbols are arranged side by side) so as to coincide with the arrangement reference direction, and FIG. As shown in FIG. 5, the normalized image data whose arrangement direction is corrected is output to the liquid crystal display 16 and displayed (step S16). That is, as shown in FIG. 10A, when the two-dimensional arrangement direction of the data cells of the captured QR code image is inclined by an angle β with respect to the arrangement reference direction indicated by a broken line in the figure, The QR code image is rotated by an angle β so that the directions coincide with each other.

  As described above, according to the second embodiment, the control unit 6 detects the arrangement direction of the image of the captured barcode or QR code, and the arrangement direction is inclined with respect to the set arrangement reference direction. If so, the arrangement direction of the normalized barcode or QR code image is corrected so as to coincide with the arrangement reference direction. Accordingly, the barcode or QR code image is displayed without tilting with respect to the display screen of the liquid crystal display 16, and the displayed barcode or QR code image is read by a barcode reader or the like. It is not necessary to incline the liquid crystal display 16 with respect to the bar code reader.

(Third embodiment)
11 and 12 show a third embodiment of the present invention. The same parts as those of the second embodiment are designated by the same reference numerals and the description thereof is omitted. Only different parts will be described below. In the third embodiment, the correction process of the arrangement direction of the barcode and the QR code image is executed according to the flowchart shown in FIG. 12 instead of step S17 in FIG. 7 and step S19 in FIG. 9 in the second embodiment.
For example, a process for correcting the arrangement direction of a QR code image as shown in FIG. 11 will be described. First, as shown in the left diagram of FIG. 11A, when the arrangement direction of the captured images is inclined by 100 degrees with respect to the reference direction, this inclination is not less than 45 degrees and less than 135 degrees (in step T1). “NO”, T2 is “YES”) Proceeding to step T5, the control unit 6 rotates the image arrangement direction by 90 degrees with respect to the arrangement reference direction as shown in the right diagram of FIG. Modify to match

Next, as shown in the left diagram of FIG. 11B, when the QR code image is inclined by 195 degrees, this inclination is not less than 135 degrees and less than 225 degrees (“NO” in steps T1 and T2, T3 The process proceeds to step T6, and the control unit 6 matches the image arrangement direction to the direction rotated 180 degrees with respect to the arrangement reference direction, as shown in the right figure of FIG. 11B. Correct it. Further, as shown in the left diagram of FIG. 11C, when the QR code image is inclined by 280 degrees, this inclination is not less than 225 degrees and less than 315 degrees (“NO” in steps T1, T2, and T3). Proceeding to step T7, as shown in the right diagram of FIG. 11C, the control unit 6 corrects the arrangement direction of the images so as to coincide with a direction rotated by 270 degrees with respect to the arrangement reference direction.
Although not shown, when the tilt of the captured image is −45 degrees or less (315 degrees or more) and less than 45 degrees (“YES” in step T1), the process proceeds to step T4, and the control unit 6 Similar to the embodiment, correction is performed so that the arrangement direction of the images matches the arrangement reference direction.

As described above, according to the third embodiment, the control unit 6 rotates the array direction of the normalized barcode or QR code image by 90 degrees with reference to the array reference direction or the array reference direction. In order to correct the inclination, the direction in which the image is rotated becomes the smallest direction in order to correct the inclination.
That is, the normalized barcode or QR code image arrangement direction can be matched with the arrangement direction closest to the imaged state, and the normalized barcode can be displayed with less discomfort for the user. A code or a QR code image can be displayed on the liquid crystal display 16.

(Fourth embodiment)
FIG. 13 shows a fourth embodiment of the present invention, and only the parts different from the first embodiment will be described below. The fourth embodiment shows a case where the user is configured to select whether or not to execute the information code image normalization process. FIG. 13 is a partial equivalent diagram of FIG. 3 in the first embodiment, in which step S20 is inserted between step S1 and step S2.
That is, the control unit 6 captures a bar code or QR code and captures the image data in the memory 10, and then executes normalization processing of the captured image data on the liquid crystal display 16 in step S20. A message for prompting the user to select whether or not is displayed. If the user gives an instruction to execute the operation via the operation switch 13 or the like (“YES” in step S20), the processes after step S2 are executed. On the other hand, if the user gives an instruction not to execute the normalization process (“NO” in step S20), the process ends as it is.

  As described above, according to the fourth embodiment, in the portable information terminal 1, a message for prompting the user to select whether or not to perform the normalization process is displayed on the liquid crystal display 16, and the user operates the operation switch 13 The normalization process is executed when an instruction to execute the above is given. Therefore, for example, the user can select not to perform the normalization process when the captured information code image is clear, but to perform the normalization process only when the information code image is unclear.

The present invention is not limited to the embodiments described above and shown in the drawings, and the following modifications or expansions are possible.
Although the output destination of the normalized information code image is the liquid crystal display 16, the normalized image data may be output to a printer or the like and printed on paper or the like to output the normalized information code image.
In the process of correcting the inclination of the information code image in the second and third embodiments, the control unit 6 executes the correction process on the liquid crystal display 16 as in the fourth embodiment before performing the correction process. A message for prompting the user to select whether or not to perform the operation may be displayed, and the tilt of the image may be corrected when the user gives an instruction to operate and operate the operation switch 13 or the like. In this way, when the user intentionally captures the information code image in a tilted state, the normalized image can be displayed on the liquid crystal display 16 as it is.
In the process of correcting the inclination of the information code image in the third embodiment, the boundary “determining the degree of inclination of the captured image is changed to“ exceeding ”and“ less than ”is changed to“ below ”. Also good.
In the third embodiment, for example, when the inclination of the captured image with respect to the reference direction relative to the reference direction is 0 degree to 90 degrees, the arrangement direction of the images is matched with the reference direction, and when the inclination direction is 90 degrees to 180 degrees. Match the direction rotated 90 degrees with respect to the reference direction. If 180 degrees to 270 degrees, match the direction rotated 180 degrees with respect to the reference direction. If 270 degrees to 360 degrees, match the reference direction. It is also possible to match the direction rotated by 270 degrees.

The control unit 6 generates the specific pattern image normalized so as to have a predetermined ratio with the data cell size or bar width as the normalized information unit. A plurality of data cell sizes or bar widths may be set, and a specific pattern image normalized based on these may be generated.
The controller 6 may specify only one type of information code immediately before reading the information code. Moreover, it is good also as always reading object, without specifying the information code made into reading object.
The viewfinder function may be provided as necessary.
In each embodiment, the processing is performed by software with the control unit 6 as the center, but the processing content may be realized by hardware such as a gate array.
The control unit 6 may have a function of decoding the information code.

The figure which is 1st Example of this invention and shows the normalization process of QR Code image The figure which shows the normalization processing of the barcode image The flowchart which shows the processing content which the control part of a portable information terminal normalizes an information code image Diagram explaining the concept of normalization processing Diagram explaining the viewfinder function The block diagram which shows the electric constitution regarding the image processing of the portable information terminal The partial equivalent figure corresponding to the barcode processing of FIG. 3 which shows 2nd Example of this invention Fig. 2 (a) equivalent diagram Partial equivalent diagram corresponding to the two-dimensional code processing of FIG. FIG. 1 equivalent view showing a second embodiment of the present invention FIG. 10 equivalent view showing the third embodiment of the present invention. FIG. 7 corresponds to step S17 in FIG. 7 or step S19 in FIG. FIG. 3 equivalent view showing a fourth embodiment of the present invention.

Explanation of symbols

  In the drawing, 1 is a portable information terminal, 2 and 3 are LEDs (imaging means), 4 is a lens (imaging means), 5 is a CCD (imaging means), and 6 is a control unit (image processing means, data output means, code type). Setting means, operation control means), 13 is an operation switch (operation instruction means), and 16 is a liquid crystal display (display means).

Claims (19)

In a portable information terminal configured to include an imaging unit that captures an image, an image processing unit that processes data of the captured image, and a data output unit that outputs the processed image data to a predetermined output destination.
The image processing means includes
Pattern detecting means for inspecting the light / dark pattern of the image and detecting the arrangement of the light pattern and the dark pattern when the image pickup means picks up an image of the information code;
The size of the information unit that is the reference dimension of the light pattern and / or the dark pattern is detected based on the detected arrangement of the light / dark pattern, and the normalization information of the predetermined shape and the predetermined size is detected based on the detected size of the information unit An information unit setting means for setting a unit;
Normalization for generating a normalized image by replacing each of the bright and dark patterns with the normalized information unit set by the information unit setting means based on the arrangement of the light and dark patterns detected by the pattern detection means A normalized image generating means for performing processing,
The data output means outputs the generated normalized image to a predetermined output destination. The normalized image generating means includes code type setting means for setting the type of information code to be subjected to normalization processing,
The image processing means includes
A specific pattern detection unit for detecting a specific specific pattern determined by the type of information code set in the code type setting unit, from an array of light and dark patterns detected by the pattern detection unit from the captured image;
Code type discriminating means for discriminating the type of information code included in the captured image based on the position or size of the detected specific pattern;
2. The portable information terminal according to claim 1, wherein the information unit setting unit sets a normalized information unit having a shape corresponding to the determined code type.   3. The portable information terminal according to claim 2, wherein the code type setting unit sets at least one information code type to be normalized by the normalized image generation unit. When the information unit setting unit sets the normalized information unit, the information unit setting unit generates a normalized specific pattern image including a pattern having a size of the normalized information unit and a predetermined ratio,
The portable information terminal according to claim 2 or 3, wherein the normalized image generation unit arranges the normalized specific pattern image at a position corresponding to the specific pattern detected by the specific pattern detection unit. The code type setting means includes a reference direction setting means for setting the arrangement reference direction according to the type of information code,
The image processing means includes
Comprising an arrangement direction detecting means for detecting the arrangement direction of the imaged information code image;
The portable information terminal according to claim 2, wherein the arrangement direction of the normalized image is corrected so that the detected arrangement direction matches the arrangement reference direction.   The image processing means is a direction rotated by 90 degrees, 180 degrees, or 270 degrees with respect to the reference direction when the angle formed by the detected arrangement direction with respect to the array reference direction exceeds ± 90 degrees. The mobile information terminal according to claim 5, wherein the arrangement direction of the images that have been normalized so as to match is corrected.   7. The portable information terminal according to claim 6, wherein the image processing means matches the direction in which the angle at which the image is rotated becomes the smallest when correcting the arrangement direction of the normalized images. Operation control means for operating and controlling the image processing means;
An operation instruction means for a user to input an operation instruction;
The operation control means causes the image processing means to execute the correction when there is an operation instruction for executing the correction of the arrangement direction via the operation instruction means. 8. The portable information terminal according to any one of 7. Operation control means for operating and controlling the image processing means and the data output means;
Display means for displaying an image,
The portable information terminal according to any one of claims 1 to 8, wherein the operation control unit outputs and displays data of an image captured by the imaging unit on the display unit. Comprising an operation instruction means for a user to input an operation instruction;
The operation control unit prompts the user to select whether or not to cause the normalized image generation unit to perform normalization processing when the image captured by the imaging unit is displayed on the display unit. The portable information according to claim 9, wherein the normalization process is executed by the normalized image generation unit when an operation instruction to execute the message is displayed via the operation instruction unit. Terminal.   The portable information terminal according to claim 9 or 10, wherein the data output means outputs the image data normalized by the normalized image generation means to the display means for display. In an image processing method for capturing an image, processing data of the captured image, and outputting the processed image data to a predetermined output destination.
Inspecting the light / dark pattern of the captured image to detect the arrangement of the light pattern and the dark pattern,
The size of the information unit that is the reference dimension of the light pattern and / or the dark pattern is detected based on the detected arrangement of the light / dark pattern, and the normalized information unit having a predetermined shape and a predetermined size is detected based on the detected size of the information unit Set
Based on the detected arrangement of light and dark patterns, normalization processing is performed to generate a normalized image by replacing each of the light and dark patterns with a set normalization information unit,
An image processing method, comprising: outputting a generated normalized image to a predetermined output destination. A type of information code to be subjected to the normalization process is set in advance,
A specific specific pattern determined by the set information code type is detected from an array of light and dark patterns detected from the captured image,
Based on the position or size of the detected specific pattern, the type of information code included in the captured image is determined,
13. The image processing method according to claim 12, wherein a normalized information unit having a shape corresponding to the determined code type is set.   14. The image processing method according to claim 13, wherein at least one information code type to be subjected to the normalization process is set. When the normalized information unit is set, a normalized specific pattern image composed of a pattern having a size of the normalized information unit and a predetermined ratio is generated.
15. The image processing method according to claim 12, wherein the normalized specific pattern image is arranged at a position corresponding to the detected specific pattern. When the arrangement reference direction is set according to the type of information code and the arrangement direction of the captured information code image is detected,
16. The image processing method according to claim 12, wherein the arrangement direction of the normalized image is corrected so that the detected arrangement direction coincides with the arrangement reference direction.   When the detected array direction is more than ± 90 degrees with respect to the array reference direction, it is normalized so as to coincide with a direction rotated 90 degrees, 180 degrees, or 270 degrees with respect to the reference direction. The image processing method according to claim 16, wherein the arrangement direction of the processed image is corrected.   18. The image processing method according to claim 17, wherein when the arrangement direction of the normalized images is corrected, the image rotation method is made to coincide with a direction in which the rotation angle of the image is minimized. The image processing method according to claim 12, wherein the normalized image is output and displayed on a display unit.

Images