JP4211613B2 - Optical information reader - Google Patents

Description

The present invention relates to a method for reading a sign having optical information such as a one-dimensional bar code using an area image sensor and restoring the information carried by the sign, a bar code reader used in POS, etc., and a two-dimensional code. The present invention relates to an optical information reader such as a reader, a handy terminal, and a camera-equipped mobile phone .

  Today, for example, for application to a POS system or the like, a method and an apparatus in which product information is converted into a barcode and read by a barcode reader are widely used. This barcode is widely used in fields such as inventory management, distribution management, and sales volume management.

  However, barcode reading is performed one-dimensionally by scanning in the bar arrangement direction, and the amount of information is limited.

  Therefore, in recent years, as a device capable of carrying more information, for example, a two-dimensional code in which black and white mosaic patterns are two-dimensionally arranged and a two-dimensional code reader for reading the two-dimensional code have been developed. This two-dimensional code can record a large amount of information in a small space. For example, it can record even detailed information such as the product name and number of products in a packing box, and the destination. This two-dimensional code reader generally uses an area image sensor in which a large number of light receiving elements are arranged so as to spread two-dimensionally in the horizontal and vertical directions.

  As a method of using and operating such a barcode reader, 2D code reader, handy terminal, etc., the barcode or 2D code is printed on a product catalog, etc., and data such as mail-order sales, door-to-door sales, or questionnaire surveys. Businesses and businesses that are used for collection are appearing.

  In addition, a mobile phone with a camera function using an area image sensor has been developed. A camera with an area image sensor built into this mobile phone is used to add a function to decode a two-dimensional code. By doing so, you can read the 2D code, read the address and other information necessary for Internet connection, print the 2D code in the catalog, and read / decode this 2D code with the mobile phone with camera function. There are also businesses that offer catalog mail order sales and door-to-door sales by using wireless communication functions and Internet communication functions of mobile phones.

  As described above, since a two-dimensional code reader has been developed in addition to a bar code reader, a situation where a bar code and a two-dimensional code are mixed is expected. For this reason, the bar code and the two-dimensional code are read respectively. An optical information reader capable of this is desired. A method of reading a one-dimensional barcode using a camera with an area image sensor built in a mobile phone is also desired.

  However, a relatively inexpensive area image sensor has a horizontal pixel count and a vertical pixel count of about 400 to 800 pixels at most. Here, the number of pixels is the number of light receiving elements arranged in the area image sensor. FIG. 50 shows an example of the light receiving elements arranged in the area image sensor. Each light receiving element is arranged in a square lattice pattern. FIG. 51 shows a state of the area image sensor arranged in a bar code reader (two-dimensional code reader) using the area image sensor as viewed from the reading port direction.

  This is because in a matrix code which is a representative code of a two-dimensional code, the maximum number of symbols called cells, which are basic constituent elements, is about 100 vertical and 100 horizontal, so that one cell can be recognized by image processing. Since the number of pixels is about 5 × 5 pixels, the area image sensor having the number of pixels as described above is often used. FIG. 52 shows a state in which a one-dimensional barcode is formed on the light receiving elements arranged in the horizontal direction of the area image sensor. The area image sensor of FIGS. 50 and 52 is a sensor in which light receiving elements are arranged at intervals of 6 μm on a square lattice. Elements of 800 pixels are arranged in both the horizontal direction and the vertical direction, and are formed from light receiving elements of 640,000 pixels in total.

  Such an area image sensor in which light receiving elements are arranged in a square lattice shape is very common. The light received by the 800 × 800 = 640000 light receiving elements is converted into an electrical signal, further converted into digital data, developed in a memory unit called a frame memory, and necessary digital data is accessed from the memory unit, The code is decoded by the calculation process.

  The one-dimensional barcode in FIG. 52 has an overall width of 65 mm including the left and right white margins, and is composed of 300 modules. The white margin is a margin portion provided on the left and right of the symbol portion of the one-dimensional barcode. The module here is a minimum unit of a one-dimensional barcode. In contrast, a linear image sensor (line image sensor) used in a one-dimensional barcode dedicated reader generally has 1000 pixels or more. Since one-dimensional scanning is performed for signs that have information in one dimension, the one-dimensional barcode is designed so that reading is possible even if the sign is tilted within a certain range in consideration of readability. Have height.

  FIG. 53 shows the relationship between the one-dimensional barcode and linear image sensor scanning. 53, the one-dimensional information of the one-dimensional barcode can be read by operating the linear image sensor within the range of the height h and the angle Θ shown in FIG. 53, and the one-dimensional barcode has the height h. It can also be said that there is reading redundancy in the range of angle Θ. FIG. 54 shows an example of light receiving elements arranged in a straight line on a linear image sensor used in a one-dimensional barcode reader. As shown in FIG. 54, in the linear image sensor, light receiving elements of 1000 pixels or more are arranged on a straight line.

This is because a one-dimensional barcode having a width of about 300 to 400 of a module which is the smallest unit of the one-dimensional barcode is actually used frequently, and recognition of one module which is the smallest unit is recognized. For this reason, about 3 pixels are required, and it is difficult to recognize and decode the one-dimensional barcode as described above unless there is a light receiving element of 1000 pixels or more. In the example shown in FIG. 52, a one-dimensional barcode of 300 modules forms an image on a light receiving element having 800 pixels in the horizontal direction, but the number of light receiving elements for one module is less than 3 pixels. Decoding has become difficult.

  From the above, when reading a one-dimensional barcode using an area image sensor, the reading performance is as high as that of a one-dimensional barcode reading-only device, especially a one-dimensional barcode composed of a larger number of modules. It was difficult to obtain the decoding performance.

As an apparatus for reading both a one-dimensional barcode and a two-dimensional code, a reading apparatus having both an area image sensor for reading a two-dimensional code and a linear image sensor for reading a one-dimensional barcode has been studied. (For example, Patent Document 1). In addition, as a method of reading a one-dimensional barcode with an area image sensor, a method has been studied in which the area of the image is obtained for each bar or space of the barcode, and the barcode is restored from the ratio of the areas. (For example, Patent Document 2).

  In addition, a mobile phone with a camera function using an area image sensor and a catalog mail order business using a two-dimensional code cannot be used by a user who uses a mobile phone that does not have a camera function. Inexpensive one-dimensional bar code reading devices that are connected to a mobile phone for wired communication or data communication with the mobile phone by infrared communication or the like are actually sold.

  On the other hand, a two-dimensional code reader that communicates with a mobile phone by wired connection or data communication with the mobile phone by infrared communication or the like is not actually sold. In general, a two-dimensional code reader is much more expensive than a one-dimensional barcode reader. In addition, in consideration of the use of people who do not have a mobile phone or who are outside the mobile phone communication area, such as remote islands, communication using the normal analog telephone line network (stationary telephone line network) A method of using a unit and a one-dimensional barcode reading-only device for mail order sales has also been proposed.

  For this reason, as a catalog mail order user who uses a mobile phone that does not have a camera function, if the two-dimensional code is printed in the catalog, It is necessary to purchase a two-dimensional code reading device for data communication separately, and the merit is reduced as a user. In addition, there is a method in which a merchant such as a mail-order distributor distributes a two-dimensional code reader to a user such as a mail-order seller or sells or lends it at a low cost, but the two-dimensional code reader is expensive. Merits for merchants such as mail-order sellers are reduced.

  In addition, when using people who do not have a mobile phone or who are out of the mobile phone communication area, such as remote islands, consider using a normal analog phone network (stationary phone network) for communication. For example, for those who have a mobile phone with a camera, a two-dimensional code is printed because a method for mail order sales using a combination of a communication unit to perform and a one-dimensional barcode read-only device is also proposed. Prepare a catalog that has a one-dimensional barcode printed on it for all people, rather than a catalog with a one-dimensional barcode printed for others. There are also merits for mail order dealers. If the one-dimensional barcode printed on the catalog is a catalog mail order user who uses a cellular phone that does not have a camera function, the one-dimensional barcode that communicates data with a cellular phone that can be obtained at low cost Mail order sales are available using read-only devices.

  A communication unit that uses a normal analog telephone network (stationary telephone network) to communicate with people who do not have a mobile phone or who are outside the mobile phone communication area such as remote islands There has also been proposed a method of using mail order by combining a one-dimensional barcode reading-only device. As a catalog mail order user using a camera-equipped mobile phone, mail order can be used if the one-dimensional barcode can be read and decoded by the camera-equipped mobile phone.

However, since the cellular phone with camera function uses an area image sensor, when reading a one-dimensional barcode, it is configured with a sufficient reading performance, especially a larger number of modules than a one-dimensional barcode reading-only device. It was difficult to obtain the performance of reading and decoding a one-dimensional barcode. A JAN code is an example of a one-dimensional bar code that can be easily read and decoded by a mobile phone with a camera function. This JAN code is marked on almost all products distributed in stores, and is used in POS systems that are widely used mainly in convenience stores.

  Since the JAN code has a fixed number of digits and the number of modules constituting it is relatively small, it can be easily read and decoded even by a mobile phone with a camera function. However, since the width of the entire symbol and the height of the entire symbol are defined, if printed on a printed matter such as a catalog in a form that is paired with a product, the space on the paper is considerably large. Although a two-dimensional code can be printed even in a small space, it is desirable to use a one-dimensional barcode for the reasons described above.

Therefore, if the amount of information is the same, the barcode size can be reduced compared to other one-dimensional barcodes, and barcodes such as ITF and code128, which are effective when you want to attach barcodes in narrow spaces, can be used for further barcodes. It is conceivable to reduce the space for printing on the catalog paper surface by reducing the width and space width. Therefore, in a mobile phone with a camera function that uses an area image sensor, the entire symbol is reduced by comprising sufficient reading performance comparable to a one-dimensional barcode reading-only device, in particular, a narrower bar width and space width. In addition, it is desired to obtain the performance of reading and decoding a one-dimensional barcode composed of a larger number of modules.
JP-A-9-34972 JP-A-6-309485

  However, in the reading apparatus provided with both the area image sensor and the linear image sensor as described above, two types of sensors are required, and thus there are problems such as an increase in cost and an increase in the apparatus.

  In addition, the method for obtaining the area of an image of each component such as each bar and each space, or a method similar thereto, has a problem that it takes a long time for the processing for obtaining the area. In addition, in order to obtain the area, it was necessary to capture not only the width direction of the barcode but also the entire height in the field of view that can be captured by the area image sensor. An example of this is shown in FIG.

  In view of the above-described problems, the present invention uses only an area image sensor and displays a marker having one-dimensional information carrying more information, that is, a one-dimensional barcode composed of a larger number of modules in a shorter time. An object of the present invention is to provide a method, an apparatus, and a system for reading with the above.

To achieve the above object, the optical information reader of the present invention has a plurality of light receiving elements arranged on a matrix in the horizontal direction and the vertical direction, and reflects from a sign having one-dimensional information in at least one direction. An area image sensor that receives light or transmitted light and converts it into an electrical signal; and a decoding unit that restores information included in the sign based on a signal from the area image sensor, wherein the area image sensor includes the image The one-dimensional direction of the one-dimensional information of the marker imaged on the area sensor is arranged at a position where the diagonal line of the area image sensor is parallel, and at least two light receiving elements are used across the diagonal line. Receiving the reflected light or transmitted light from the sign and calculating the average value of the data of the two or more light receiving elements. It is obtained so as to generate a signal from Mejisensa.

  With the above configuration, in the optical information reading apparatus and the optical information reading method of the present invention, when a sign carrying one-dimensional information is read and the information carried by the sign is decoded, the sign with a larger number of pixels is used. Therefore, the reading performance is improved correspondingly, and the label having more information can be read / decoded.

Hereinafter, as an example of an optical information reading apparatus, a hand-held bar code reader (two-dimensional code reader) and a mobile phone with a camera function will be described as an example, and an embodiment of the present invention will be described. However, the embodiments described below exemplify an optical information reading apparatus that embodies the idea of the present invention, and include a reading method, a reading sign, a communication method, a device shape, an illumination method, a mark shape, and a reading method. The angle of the mouth is not specified as follows. In addition, the present invention is not limited to a hand-held reader, but a stationary reader, a reader / system in which an imaging camera and a decoder are separated, a handy terminal, and a built-in camera It can also be applied to a method of reading a barcode with a mobile phone. The optical information reading method, the optical information reading device, the mobile phone, the information processing system, and the like according to the present invention can be variously modified within the scope of the claims.
(Embodiment 1)
A first embodiment of the present invention will be described with reference to FIGS.

  As an example of a label having one-dimensional information, a barcode (one-dimensional barcode) is taken as an example.

1 to 26, 1 is a barcode reader using an area image sensor, 2 is a barcode label to be read, 3 is an area image sensor, 4 is an image (reflected light) from the barcode label to the area image sensor. An imaging lens 5 for imaging is a circuit unit formed on the substrate, and 6 is a light projecting unit using, for example, an LED or a semiconductor laser for a barcode label. 7 is a light receiving element arranged on a square lattice in an area image sensor, 8 is a waveform processing unit such as an amplification unit or AD conversion unit, 9 is an image memory unit for storing digital data converted by the waveform processing unit, and 10 is This is a recognition unit composed of a microcomputer or a work memory that performs barcode recognition / decoding processing (information restoration processing) based on the contents of data stored in the memory unit. 11 is a reading opening for receiving reflected light from the barcode label, 12 is an outer case of the barcode reader 1, 13 is a holding portion for holding the barcode reader 1 with one hand, and 14 is a press Thus, the trigger switch 15 starts the reading operation of the barcode reader 1, and 15 is a cable.

  An outline of the configuration of the barcode reader of this embodiment will be described. As shown in FIG. 1, the barcode reader 1 has an exterior case in which a reading opening 13 for reading optical information such as a barcode and a two-dimensional code is provided at one end (front portion) of the exterior case 12 in appearance. A trigger switch 14 that is pressed at the other end (rear part) of the handle 12 to be gripped by the operator with a hand when the gripper 13 starts reading is provided at the rear end of the outer case 12 with optical information. An outlet for the cable 15 for transferring data from the computer to the host computer is arranged.

  The reading opening 11 has a shape that is slightly longer in the direction perpendicular to the longitudinal direction of the gripping portion 13, and the operator grips the gripping portion 13 and brings the reading opening 11 close to the barcode for the barcode reading operation. In this case, the longitudinal direction of the reading opening 11 is in a shape that easily matches the width direction, which is a direction having one-dimensional information of the barcode.

In the schematic diagram of the internal configuration of the barcode reader 1 shown in FIG. 2, the barcode reader 1 has a circuit unit 5 configured as a printed circuit board, and the area image sensor 3 is mounted on the circuit unit 5, that is, the printed circuit board. Has been. This has the imaging lens 4 for imaging the light reflected from the bar code label 2 to an area image sensor 3, there is a light projecting unit 6 for projecting light to the bar code label 2. As shown in the block diagram of FIG. 5, the circuit unit 5 includes a waveform processing unit 8 such as an amplification unit and an AD conversion unit, an image memory unit 9 for storing digital data converted by the waveform processing unit 8, and a storage in the image memory unit 9. Recognition unit 10 constituted by a microcomputer or work memory for performing barcode recognition / decoding processing (information restoration processing) based on the contents of the read data, and sending the read (restored) information to a host computer or the like (not shown) A communication unit and the like are configured.

  The one-dimensional barcode of the barcode label 2 has an overall width (length) of 65 mm including the left and right white margin portions, and is composed of 300 modules. The area image sensor 3 is a sensor in which the light receiving elements are arranged in a matrix having a row direction or a horizontal direction and a column direction or a vertical direction orthogonal thereto, and the light receiving elements are arranged at intervals of 6 μm in a square lattice shape. is there. Such an area image sensor in which light receiving elements are arranged in a square lattice shape is very common. A horizontal charge transfer path (not shown) is provided adjacent to the light receiving element in parallel with either side of the square lattice, and the transfer destination of the horizontal charge transfer path is connected to a vertical charge transfer path (not shown).

  The light receiving elements are arranged of 800 pixel elements in both the horizontal and vertical directions, and are formed from light receiving elements of 640,000 pixels in total. The overall shape of the light receiving element group of the area image sensor, that is, the outer peripheral shape of the area image sensor all light receiving element group is because the arrangement of the light receiving elements is on a square lattice and the number of light receiving elements in the horizontal and vertical directions is 800 pixels. Will form a square shape.

In the area image sensor 3, as shown in FIGS. 3 and 4, the arrangement direction of the light receiving elements in the sensor is at an angle of approximately 45 ° with respect to the horizontal and vertical directions of the reading opening of the barcode reader 1. So that it is tilted. As a result, the diagonal line of the square lattice of the light receiving element is substantially orthogonal to the horizontal direction of the bar code reader, and the bar width having the one-dimensional information, that is, the horizontal direction of the bar code label to be imaged during bar code reading. The direction of the space width is substantially orthogonal to or substantially parallel to the diagonal line of the square lattice of the light receiving element. In addition, a square diagonal line that is the shape of the light receiving element group of the area image sensor 3 crosses the bar code image in the width direction, that is, the direction having one-dimensional information.

  Next, the operation of the barcode reader of this embodiment will be described. The illumination light emitted from the light projecting unit 6 is reflected by the barcode label 2. The reflected light reflected is imaged as a one-dimensional barcode image on the area image sensor 3 by the imaging lens 4 as shown in FIGS. The area image sensor 3 converts the reflected light (barcode image) received by each light receiving element into an electric signal and sends it to the circuit unit 5. The waveform processing unit 8 in the circuit unit 5 converts the electrical signal into digital data by analog-digital conversion, for example, and stores it as digital data in the image memory unit 9.

  The digital data at this time is, for example, 8 bits. Data of all the light receiving elements received by the area image sensor 3 is stored in the image memory unit 9, and a location (address) for storing the data obtained by each light receiving element corresponds to each light receiving element on a one-to-one basis. The recognition unit 10 receives light from the digital data of all the light receiving elements stored in the image memory unit 9 at the positions shown in FIGS. 7 and 8, that is, the light receiving elements that are intended to be used for reading / decoding one-dimensional barcodes. The digital data of the obtained image is extracted as shown in FIG. At this time, as shown in FIGS. 7 and 8, the position of the light receiving element intended to be used for reading / decoding the one-dimensional bar code is located on the diagonal of the square formed by the light receiving element group, and the arrangement of the elements is a staircase. Located so as to be continuous.

  Or it is located on the diagonal line on the square lattice which a light receiving element arrange | positions, and the number of light receiving elements becomes the largest, and it arrange | positions so that the arrangement | sequence of elements may be continuous in steps. Alternatively, two columns positioned as a row on a diagonal line on a square lattice in which the light receiving elements are arranged and having the largest number of light receiving elements and positioned as a column on a diagonal line on an adjacent square lattice of the column Located as. The digital data is, for example, 8-bit data, and is represented by 0 to 255 in decimal. From the extracted digital data, the threshold value is set to 128, for example, 128 or more is a space portion without a bar, and less than 128 is a bar portion, and the continuous number of pixels indicating the space portion and the continuous number of pixels indicating the bar portion are calculated. Then, the bar width and space width are further calculated therefrom, and the thin bar, thick bar, thin space, and thick space are recognized, and information such as alphanumeric characters is restored therefrom.

  At this time, as shown in FIG. 8, the light receiving element group corresponding to the portion extracted from the image memory unit 9 for use in reading the barcode is the width direction of the barcode including the white margin, that is, the portion having one-dimensional information. The entire barcode including the height direction need not be captured within the field of view of the area image sensor 3. Compared with FIG. 54 of an example of calculating and decoding the barcode area shown in the background art, it can be understood well. Further, if the width direction of the barcode including the white margin, that is, the portion having one-dimensional information is captured, the light receiving element group corresponding to the portion extracted from the image memory unit 9 for use in reading the one-dimensional barcode, The relative position / direction with respect to the width direction of the one-dimensional barcode image, that is, the direction having one-dimensional information may be inclined. This is the same as the case of reading / decoding a one-dimensional barcode using the linear image sensor described above.

When a bar code is read using the area image sensor 3 as shown in FIG. 49, which is a conventional example, the bar code is read using 800 pixels in the horizontal direction. However, as in the above example, the light receiving element (for reading a one-dimensional barcode with the barcode reader of the present invention)
The number of light receiving element data) is [number of pixels in the horizontal direction] + [number of pixels in the vertical direction] −1, and the barcode can be read using 1599 pixels. The number of pixels used for reading is almost doubled, and the reading performance is greatly improved even if the same area image sensor is used. As a specific example, it is possible to read a bar code consisting of more modules and restore information. In other words, a barcode having more information can be read and information can be restored. In addition, the ability to read a one-dimensional barcode composed of a larger number of modules means that a one-dimensional barcode composed of a smaller module, that is, a smaller bar width and space width, can be read. become.

  In the above example, since 1599 pixels are used for a 300-module one-dimensional barcode, a light receiving element of about 5 pixels is used for one module, and sufficient reading performance can be expected. If one module can be read by a light receiving element of three pixels, a one-dimensional bar code composed of 500 or more modules can be read. In addition, the number of pixels (pixel data) required for the processing can be reduced compared to the processing for obtaining the area of the bar or space or the processing similar thereto, and the reading processing can be performed in a shorter time. In addition, since it is not necessary to perform area calculation, it is not necessary to capture the entire area including the height direction of the barcode in the field of view of the area image sensor.

Further, in order to obtain a one-dimensional barcode reading performance equivalent to that of the present invention by a conventional method, when compared with a pixel using an area image sensor with 1500 pixels in both the horizontal and vertical directions, first, the pixels of the area image sensor itself The number of the numbers is 800 × 800 = 640000 in the example of the present invention, and 1500 × 1500 = 22250000 in the example of the conventional method. In general, the number of pixels and the cost are proportional to each other. Cost can be low. The light received by the sensor is converted into an electrical signal and further converted into digital data and then developed in the image memory unit. The required memory capacity is proportional to the number of pixels of the sensor. In general, since the cost of the image memory unit is proportional to the memory capacity, the cost of the image memory unit can be reduced.

  Further, FIG. 10 shows that the number of horizontal pixels is 800 pixels and the number of vertical pixels is 600 pixels, the outer periphery of the light receiving element group is a rectangle, and the light receiving elements are arranged in a row direction or a horizontal direction and a column direction orthogonal thereto. An example in the case of an area image sensor in which light receiving elements are arranged at intervals of 6 μm in the form of a square lattice and arranged in a matrix formed in the vertical direction will be described.

  As shown in FIG. 10, the positions of the light receiving elements intended to be used for reading and decoding the one-dimensional bar code are such that the light receiving elements are arranged in a staircase pattern, and the light receiving elements correspond to one end of the continuous arrangement. Is positioned at one of the long sides of the outer periphery of the rectangle formed by the light receiving element group, and the light receiving element corresponding to the other end of the continuous array is positioned at the other of the long sides of the outer periphery of the rectangle formed by the light receiving element group. Alternatively, it is located on a diagonal line on a square lattice in which the light receiving elements are arranged, and the number of light receiving elements is the largest, and the elements are arranged so that the arrangement of elements is continuous in a staircase pattern. The light receiving element that hits one end is located on one of the long sides of the outer periphery of the rectangle formed by the light receiving element group, and the light receiving element that hits the other end of the continuous array is the other of the long sides of the outer periphery of the rectangle formed by the light receiving element group Located in.

  Alternatively, two columns positioned as a row on a diagonal line on a square lattice in which the light receiving elements are arranged and having the largest number of light receiving elements and positioned as a column on a diagonal line on an adjacent square lattice of the column And the light receiving element corresponding to the end of the row is located on the long side of the outer periphery of the rectangle formed by the light receiving element group.

If the data of the light receiving element in the portion as shown in FIG. 10 is used for reading the one-dimensional barcode, the one-dimensional barcode is read using 1199 pixels, which is compared with reading by 800 pixels in the horizontal direction. Thus, approximately 1.5 times as many light receiving elements can be used, and in this case, the reading performance is remarkably improved. For the 300-module one-dimensional barcode in the above example, a light receiving element having three or more pixels is used, and sufficient reading performance can be expected. Further, the same effect can be expected by reading the one-dimensional bar code using the light receiving element near the portion located on the diagonal of the rectangle formed by the light receiving element group.

  As shown in FIG. 11, even when reading a one-dimensional barcode using data obtained by light receiving elements located on the diagonal of the entire area image sensor in which the outer periphery of the light receiving element group forms a rectangle, It goes without saying that the same effect as in the above example can be obtained.

  Furthermore, in order to cope with blurring and dirt on the barcode, missing prints, etc., the light receiving element in the portion shown in FIG. 12 is further used.

  Using the light receiving element shown in FIG. 12, for example, an average value of data of a plurality of light receiving elements forming a column in the other direction on the square lattice is used as shown in FIG. That is, [pixel 1] = ([pixel 1a] + [pixel 1b]) / 2, [pixel 2] = ([pixel 2c] + [pixel 2d] + [pixel 2e]) / 3, [pixel 3] = ([Pixel 3a] + [pixel 3b]) / 2,..., For example, the average value of data of two or three light receiving elements is calculated, and this average value is compared with a threshold value. Bars and spaces may be determined, and barcode recognition / decoding may be performed.

  In the above embodiment, the average value is calculated from data of two pixels or three pixels in order to calculate the average value, but the average value may be calculated from data of four pixels or more. Further, the pixel data calculated by this method can be regarded as the data of the light receiving elements arranged in one line, which is convenient for measuring the bar width and the space width. Even with respect to the tilt, it becomes easier to measure the bar width and the space width as described above, and the reading performance is further improved.

  In the above embodiment, the light receiving element having the highest resolution is used. However, in the range as shown in FIG. 14, a resolution larger than 800 horizontal pixels can be obtained. The reading performance is improved accordingly. Within this range, it is also effective to read a stack code in which a plurality of one-dimensional barcodes are combined in the vertical direction.

  Even if the arrangement of the light receiving elements of the area image sensor is not a square lattice in which the arrangement of each element is a square, but a rectangular lattice in which the arrangement is a rectangle, bar code reading is possible as shown in FIG. At this time, if the horizontal direction of the bar code label, that is, the direction of the bar width and the space width having one-dimensional information is substantially orthogonal to the diagonal of the rectangular rectangle of the lattice, the same effect as in the above embodiment can be obtained. be able to.

  Note that the light source that irradiates the bar code may include, for example, an LED lamp or the like in the bar code reader, or may include a halogen lamp or the like outside the bar code reader, for example. If it is outdoors, sunlight may be used as it is as a light source.

In the above embodiment, an optical system using a lens is taken as an example of an imaging optical system that forms a one-dimensional barcode image on the light receiving element of the area image sensor. The type of this lens is glass. Needless to say, it may be made of plastic, may be spherical or aspherical, and may be a single lens or a lens group. Needless to say, the imaging optical system may be other than the lens, for example, using an optical fiber.

  The range most suitable for reading a one-dimensional barcode is limited to the whole range captured by the area image sensor as in the above-described embodiment of the present invention. The reading position of the one-dimensional bar code may be indicated by illuminating the side of the reading position or the like. In addition, for example, illumination light for reading a one-dimensional barcode may have a band shape and may indicate a reading position of the one-dimensional barcode. Also, the illumination light for illuminating a barcode or two-dimensional code is illumination light as shown in FIG. 16 having two angles in the horizontal direction. When reading a one-dimensional barcode, the two angles in the horizontal direction of the illumination light are A one-dimensional barcode may be captured on the connected line. Further, the illumination light has an elliptical shape with a long axis in the horizontal direction, and a one-dimensional barcode may be captured on the long axis of the elliptical illumination light. Further, as shown in FIG. 17, a mark such as a triangle may be put beside the reading port to indicate the reading position of the one-dimensional barcode. Further, the shape of the reading port and the shape of the housing around the reading port may be elongated in the horizontal direction as shown in FIG. 18 to indicate the reading position of the one-dimensional barcode.

  It goes without saying that the area image sensor may be a CCD image sensor or a CMOS image sensor. In addition, the area image sensor and the waveform processing unit of the above embodiment may be a semiconductor built in one package, and further, the semiconductor built in one package including the image memory unit and the recognition unit. It goes without saying that it may be.

  In the above example, only the reading of the one-dimensional barcode is mentioned, but since the area image sensor is used, it goes without saying that the two-dimensional code reading function can be applied simultaneously with the one-dimensional barcode reading function. Needless to say, the present invention can be applied even if an OCR character reading function is provided at the same time. In addition, a biometric function for performing authentication based on differences in human fingerprints, retinas, and irises may be provided at the same time. Further, the present invention can be applied to reading optical information including density information and color information in addition to one-dimensional information such as bar width and space width.

  In the above embodiment, in order to read the one-dimensional bar code, after storing the data of all the light receiving elements of the area image sensor in the image memory unit, as shown in the examples of FIGS. The data of the light receiving element used for recognition / decoding is extracted from the image memory unit and the barcode is recognized / decoded. At the stage of output from the waveform processing unit or the image sensor, which is the preceding stage from the image memory unit, 1 Only the data and signals of the light receiving elements used for reading / decoding of the dimension bar code may be output.

  FIG. 19 shows an example of the block diagram, and FIG. 20 shows a flowchart of the operation example. The area image sensor 23 captures some signs, converts the electrical signals of all the light receiving elements into digital data by the waveform processing unit 27, and sends the digital data to the image memory unit 28 (step 1). The recognition unit 29 determines whether the sign is a one-dimensional barcode or a two-dimensional code (step 2). This determination process does not have to be a fine image enough to decode a one-dimensional bar code or a two-dimensional code. As a result of the determination, if the captured sign is a two-dimensional code, the process proceeds to a two-dimensional code decoding process (step 7). If the captured sign is a one-dimensional barcode, a one-dimensional barcode reading command 21 is output from the microcomputer of the recognition unit 29 to the area image sensor 23 (step 3).

The one-dimensional barcode reading command 21 may be, for example, a command format signal or a Hi or Low digital signal for the input port of the area image sensor 23. Upon receiving the one-dimensional bar code reading command 21, the area image sensor 23 outputs only the signal of the light receiving element used for reading / decoding the one-dimensional bar code to the waveform processing unit 27, which is further converted into digital data and the image memory unit. 28 (step 4). The recognition unit 29 performs a one-dimensional barcode decoding process based on the data in the image memory unit 28 (steps 5 to 6). By performing such an operation, it is possible to reduce the signal and data output from the area image sensor to the waveform processing unit and the image memory unit at the time of reading the one-dimensional barcode, thereby reducing the processing time.

  Normally, the arrangement is as in the conventional example of FIG. 48. However, a rotating mechanism is provided on the lower part of the area image sensor or on the printed circuit board on which the area image sensor is arranged, for example, as shown in FIG. For example, the rotation mechanism section below the area image sensor is rotated or the unit including the area image sensor and the imaging lens is rotated so that the area image sensor is arranged as shown in FIG. A one-dimensional barcode may be read.

  It should be noted that a one-dimensional barcode having a number of modules that can be recognized / decoded even outside the recommended one-dimensional barcode reading range in the embodiment of the present invention is recognized / recognized even outside the recommended one-dimensional barcode reading range. It goes without saying that decoding may be performed. Further, even if the direction of image formation on the sensor of the one-dimensional barcode is different from that of the embodiment of the present invention, the one-dimensional barcode having the number of modules that can be recognized and decoded by the conventional method and apparatus. Needless to say, recognition and decoding may be performed if there are any.

  In the above embodiment, the entire range imaged on all the light receiving elements of the area image sensor is illuminated with illumination light. FIG. 24 shows a state where the entire range captured by the area image sensor and its surroundings are illuminated with illumination. However, in the case of reading a one-dimensional bar code, it is only necessary to illuminate only the portion imaged on the light receiving element used in the one-dimensional bar code reading described in the above embodiment with illumination light. It can be turned off and power consumption can be reduced.

  FIG. 22 is a diagram showing an image of a portion formed on the light receiving element used for recognition and decoding of the one-dimensional barcode in the barcode reader of the present invention. FIG. 23 is a flowchart showing an operation of turning off the extra portion of illumination light when reading a one-dimensional barcode. When the area image sensor catches any sign (step 1a), it determines whether the sign is a one-dimensional barcode or a two-dimensional code (step 2a). This determination process does not have to be a fine image enough to decode a one-dimensional bar code or a two-dimensional code. As a result of the determination, if the captured sign is a two-dimensional code, the process proceeds to a two-dimensional code decoding process (step 7). If the sign to be captured is a one-dimensional barcode, the illumination light that illuminates a portion other than the range imaged on the light receiving element for reading the one-dimensional barcode is turned off (step 3a).

  FIG. 25 shows a state where the illumination of unnecessary portions is turned off when the one-dimensional barcode is read. The operator operates the barcode reader so that the illumination light captures the one-dimensional barcode, captures the one-dimensional barcode on the light-receiving element for reading the one-dimensional barcode, and performs one-dimensional barcode decoding processing (step 4a). ~ 6a). By performing such an operation, it is possible to turn off the extra illumination at the time of reading the one-dimensional barcode and reduce the power consumption. Further, illumination light at the time of reading a one-dimensional barcode as in the example of FIG. 25 can be used as guide light for capturing the one-dimensional barcode as described above.

In the above embodiment, as shown in FIG. 3, the area image is such that the arrangement direction of the light receiving elements in the sensor is at an angle of about 45 ° with respect to the horizontal and vertical directions of the reading opening of the barcode reader 1. It is assumed that the sensor is mounted at an angle, but the arrangement of the sensor is as described above using a lens, a reflecting mirror, a curved mirror, a prism, an optical fiber, etc. for imaging a one-dimensional barcode on the area image sensor. The one-dimensional barcode may be imaged in the direction as in the above-described embodiment on the light receiving element portion in the above-described embodiment without being tilted as in FIG. FIG. 26 shows an example in which a mirror 45 is used to form a one-dimensional barcode image on a predetermined light receiving element of the area image sensor.

  In addition, by using the barcode reader according to the above embodiment together with an information processing apparatus, for example, a POS system frequently used in a convenience store or the like, for example, in a convenience store, a one-dimensional barcode indicating a product in a product sales process The JAN code, which is one of the above, and the one-dimensional bar code printed on the slips used for payment of electricity and telephone charges, are used for sales processing and processing of electricity charges. It is also possible to read a two-dimensional code or a one-dimensional bar code displayed on the liquid crystal screen of a mobile phone that is being used and perform a settlement process with a single bar code reader of the above-described embodiment.

  In the above embodiment, the discrimination between the one-dimensional barcode and the two-dimensional code is automatically performed. However, the discrimination between the one-dimensional barcode and the two-dimensional code and the switching between the reading and the reading are manually performed by an operation switch or the like. You may go.

  In the above embodiment, the barcode is read by reflected light. However, the same applies to reading by transmitted light as well as reading by reflected light.

The present invention described in the above embodiments may be realized by software such as a microcomputer used in the barcode reader exemplified in the above embodiments. The software may be downloaded to a memory in the barcode reader by communication or the like. The software may be stored in a storage medium such as a memory card.
(Embodiment 2)
A second embodiment of the present invention will be described with reference to FIGS.

  27 to 49, reference numeral 102 denotes a bar code displayed on a liquid crystal display unit of a mobile phone, 103 denotes a camera area image sensor, 107 denotes a light receiving element arranged on a square lattice in the camera area image sensor, 108 Is a waveform processing unit such as an amplification unit or an AD conversion unit, 109 is an image memory unit for storing digital data converted by the waveform processing unit, and 110 is a barcode recognition / decoding process based on the contents of the data stored in the memory unit. For example, a recognition unit composed of a microcomputer or a work memory, 121 is a mobile phone with a camera function, 122 is a camera built in the mobile phone, and 123 is a liquid crystal display built in the mobile phone. , 124 is a peripheral portion of the liquid crystal, and 125 is a half of a bar code reading recommended range displayed on the liquid crystal display unit 123. An excessively red belt-shaped mark, 126 is a semi-transparent red line mark indicating a recommended barcode reading range displayed on the liquid crystal display unit 123, and 127 is a parenthesis indicating the recommended barcode reading range displayed on the liquid crystal display unit 123. A type mark 128 is a triangular mark indicating a bar code reading recommended range provided in the liquid crystal peripheral part 124.

  An outline of the configuration of the mobile phone with a camera function of this embodiment will be described. The mobile phone 121 with a camera function shown in FIG. 27 has a substantially rectangular parallelepiped as a base, and its sides are curved, and has a generally smooth shape. The dimensions are about 90 mm in length in the longitudinal direction, 45 mm in width, and 23 mm in thickness. One surface serving as the surface is provided with a liquid crystal display unit 123 and a key switch unit (not shown). Further, a window 122 of a camera with a built-in mobile phone is provided on the other surface corresponding to the back surface of the surface on which the liquid crystal display unit 123 is arranged. In addition, an antenna for performing wireless communication is provided at the upper end.

  The cellular phone 121 with a camera function shown in FIGS. 27 and 28 is similar to the barcode reader of (Embodiment 1), and includes an optical system such as a lens and an area image sensor 103, and a block diagram of FIG. The waveform processing unit 108 that processes the signal from the area image sensor 103, the image memory unit 109 that stores the digital data converted by the waveform processing unit 108, and the content of the data stored in the image memory unit 109 Recognition unit 110 configured by a microcomputer or work memory that performs recognition / decoding processing (information restoration processing), and reads (restored) information to a host computer or the like via a wireless communication network or the Internet network A wireless communication unit (not shown) for sending is provided. The mobile phone 121 with a camera function includes a liquid crystal display unit 123, and the liquid crystal display unit 123 is 600 pixels wide × 800 pixels high.

  The area image sensor 103 has 600 pixels in the horizontal direction and 800 pixels in the vertical direction, and the light receiving elements are arranged in a square lattice, and the outer periphery of all the light receiving elements forms a rectangle. The area image sensor 103 is arranged so that the longitudinal direction of the rectangle which is the outer periphery of all the light receiving elements substantially coincides with the longitudinal direction of the mobile phone 121 with a camera function. The video captured by the normal area image sensor 103 is displayed on the liquid crystal display unit 123 as it is. That is, each light receiving element of the area image sensor 103 corresponds to each display pixel of the liquid crystal display unit 123. FIG. 30 shows an example of light receiving elements arranged in a square lattice pattern in the area image sensor 103.

  Next, the operation of the mobile phone with a camera function of this embodiment will be described. When the operator reads the one-dimensional barcode with the camera-equipped mobile phone 121, the operator reads and decodes it using the light receiving element of the area image sensor 103 at the position shown in FIG. That is, from the long side of the light receiving element group of the rectangular area image sensor 103 to the other long side, it is a line of about 600 pixels of light receiving elements that form a diagonal line of the square lattice of the array. The position is such that a plurality of continuous shapes form a belt shape.

  In order for the operator to read the one-dimensional barcode with the mobile phone 121 with a camera function, an image captured by the camera, that is, the area image sensor 103 is displayed on the liquid crystal display unit 123. The liquid crystal display unit 123 has a bar code reading recommended range in a straight line from the upper left part to the lower right part of the liquid crystal display part 123 as shown in FIG. A mark 125 appears. The display pixels of the liquid crystal display unit 123 that displays the translucent red belt-like mark 125 include display pixels corresponding to at least the light receiving elements used for reading the barcode shown in FIG. While viewing the liquid crystal display unit 123, the operator captures the one-dimensional barcode 102 with the camera so that the strip-shaped mark 125 crosses the portion including the one-dimensional information of the one-dimensional barcode 102 as shown in FIG.

  Illumination light of camera photographing illumination provided in the mobile phone is reflected by the bar code label. The reflected light reflected is imaged as a barcode image on the area image sensor 103 by an imaging lens or the like, as shown in FIG. 6, as in the barcode reader exemplified in the first embodiment.

The area image sensor 103 converts the received reflected light (barcode image) into an electrical signal and sends it to the circuit unit. The waveform processing unit 108 in the circuit unit converts the electrical signal into digital data by analog-digital conversion, for example, and stores the digital data in the memory unit 109 as digital data. Data of all light receiving elements received by the area image sensor 103 is stored in the memory unit 109. The recognizing unit 110 converts the digital data of the image received by the light receiving element at the position shown in FIG. 31 from the digital data stored in the memory unit 109, as in the example shown in (Embodiment 1). 9 or as shown in FIG. The digital data is, for example, 8-bit data, and is represented by 0 to 255 in decimal. For example, the threshold value is set to 128 from the extracted digital data, 128 or more is a space portion without a bar, and less than 128 is a bar portion, and the bar width or space width is detected to restore information such as alphanumeric characters.

  When a bar code is read using the area image sensor 103 as shown in FIG. 49, which is a conventional example, the bar code is read using 600 pixels in the horizontal direction. However, since the barcode reader of the present invention can read the barcode using 1199 pixels as in the above example, compared to the one-dimensional barcode reading in the horizontal direction (lateral direction) of the mobile phone, The number of pixels used for barcode reading will increase greatly, and the reading performance will be greatly improved even if the same area image sensor is used.

  Note that the same effect as in the above example can be obtained even when reading a one-dimensional barcode using data obtained by a light receiving element located on the diagonal line of the entire area image sensor in which the outer periphery of the light receiving element group forms a rectangle. Needless to say, is obtained in the same manner as in the first embodiment.

  In the above embodiment, the area image sensor arranged in the cellular phone is arranged so that the horizontal / vertical direction of the cellular phone and the horizontal / vertical direction of the area image sensor coincide with each other as usual. When the barcode is read, the horizontal and vertical directions of the area image sensor are inclined at an angle of about 45 ° with respect to the horizontal and vertical directions of the mobile phone, as in the barcode reader shown as an example in 1). The recommended direction may coincide with the horizontal direction of the mobile phone. FIG. 33 shows an example in which the horizontal and vertical directions of the area image sensor are inclined at an angle of about 45 ° with respect to the horizontal and vertical directions of the mobile phone. In such a case, when displaying an image captured by the area image sensor at the normal time on the liquid crystal display unit of the mobile phone, for example, the portion shown in FIG. 31 is used for display. When the display pixels of the liquid crystal display unit are, for example, 120 pixels long × 160 pixels wide, the image is displayed on the liquid crystal display unit using the image of the range of 480 pixels × 640 pixels shown in FIG. To do. At this time, since the resolutions of the liquid crystal display unit and the imaging camera are different, for example, processing is performed such that data of one pixel out of four pixels in the horizontal direction and the vertical direction captured by the imaging camera is used for display. When reading a one-dimensional bar code or two-dimensional code, the entire image captured by the imaging camera is displayed on the liquid crystal display unit, for example, as shown in FIG. 35, and the light receiving elements up to the end of the imaging camera are effectively used. Make it usable. Also in this case, for example, as shown in FIG. 36, a mark indicating the recommended reading range may be displayed on the liquid crystal display unit. This method can be used not only for a mobile phone with a camera function but also for a handy terminal with a bar code reading function and a handy terminal with a camera function having a display function such as a liquid crystal display unit.

  Note that the mobile phone with a camera function and the handy terminal with a barcode reading function in the above example may have a function of reading and decoding a two-dimensional code using the area image sensor. Further, it may have a biometric function for recognizing fingerprints, retinas, irises and the like.

  By using such a mobile phone with a camera function according to the present invention, a one-dimensional barcode printed in a catalog or the like with a product is read and communicated with the server computer of the seller using the wireless communication function of the mobile phone. It can be used as a form of mail order sales or door-to-door sales.

  Next, the operation in the mail-order sales of the mobile phone with a camera function of this embodiment will be described with reference to FIG.

The barcode 162 is printed or affixed on a flyer or catalog printed with a product, for example, and is paired with a product printed on a flyer / catalog. Flyers and catalogs are distributed to general households by sellers. The width of the module constituting this barcode 162, that is, the width of the narrowest bar or space is 0.125 mm, for example, 14 digits to indicate the catalog number, product type, color, size, version, etc. Is encoded with alphanumeric information. The number of modules including the left and right white margins is 112 modules, and the entire width of the barcode 162 including the left and right white margins is 14 mm. When the barcode 162 is read / decoded by the area image sensor 103 of the mobile phone 121, the barcode 162 can be decoded if the barcode 162 can be captured by a light receiving element of about 350 pixels. However, since the bar width and the space width of the barcode 162 are very thin as 0.125 mm, it is necessary to read the subject in the vicinity of the focal point of the imaging lens 104 that forms an image on the area image sensor 103. FIG. 38 shows a state in which the barcode 162 is imaged on the area image sensor 103 by the imaging lens 104. At this time, from the angle of view of the imaging lens 104, the 14 mm barcode 162 cannot form an image on 350 pixels in the horizontal direction of the area image sensor 103, and can form an image only on the light receiving elements for 200 to 250 pixels. However, by the method shown in FIG. 31 described above, the barcode 162 can be captured by the light receiving elements for about 400 to 500 pixels, and can be sufficiently decoded.

  The leaflet catalog printed with the barcode 162 is placed on a table, desk or kotatsu. The orderer selects, for example, a carbonated drink from the flyer / catalog as a desired product, and selects a barcode that is paired with the desired product. The orderer points the camera unit 122 of the mobile phone 121 toward the barcode 162 while placing the leaflet on the table. At this time, an image captured by the camera unit 122 is displayed on a liquid crystal display unit 123 provided in the mobile phone 121, and a band-shaped mark 125 indicating a recommended range for reading a barcode is also displayed. As shown in FIG. 32, the orderer operates the cellular phone 121 so that the band-shaped mark 125 indicating the recommended range for reading the barcode crosses the barcode image 102 displayed on the liquid crystal display unit 123. A predetermined operation for reading a barcode is performed by the key input unit or the like. The reflected light from the barcode 162 is imaged on the area image sensor 103 by an imaging lens in the mobile phone 121 or the like. The area image sensor 103 converts the formed image into an electrical signal. The recognition unit 110 in the mobile phone 121 restores information included in the barcode based on the electrical signal converted by the area image sensor 103. The restored information is stored in a restoration information storage unit in the mobile phone 121. Further, the information in the barcode restored as necessary is converted into, for example, a product name stored in another memory in the mobile phone 121. At this time, the quantity desired to be purchased or the like may be performed using the numeric keypad input unit provided in the mobile phone 121. The restored information, product name, and the like are displayed on the liquid crystal display unit 123. The restored information, product name, and the like are transmitted to the seller's host server 175 and the like via the wireless communication unit, the mobile phone base station, the mobile phone wireless network 160, the Internet network 170, and the like provided in the mobile phone 121. The host server 175 collates the received information with the database in the server, and performs processing such as specifying a purchase requester, specifying a purchase desired product, and specifying a desired purchase quantity. The seller sends a desired quantity of the desired product 178 to the specified purchase requester, and the purchase requester pays by cash on delivery when receiving the product. In this way, the purchase applicant can purchase the product printed on the flyer. At this time, if the mobile phone 121 has an electronic money function by incorporating an IC having an electronic money function, payment can be made on the spot. In addition, if the mobile phone owner's name, address, telephone number, etc. are stored in the IC or mobile phone storage unit having the electronic money function, when placing an order with the mobile phone in the above example, Information such as name, address, phone number, etc., which is the delivery destination of the product to the mobile phone owner who wants to purchase, can be added automatically when performing the order processing in the above example, and it takes time to input information Convenient to save.

Since the operation of such an order receiving operation becomes possible, there is no need for the telephone operator who receives the order on the seller side, which leads to cost reduction. In addition, by automating orders, orders can be placed at night, especially at midnight, so that users can place orders even at midnight without worrying about time zones. In addition, since an item to be ordered is input by reading a barcode, erroneous input due to key input or the like can be prevented.

  In addition, the code printed on the product catalog to be paired with the product can be a one-dimensional barcode, particularly a one-dimensional barcode having a small module width and a small overall width. Even users who have telephones can use catalog mail-order sales using mobile phones by using inexpensive one-dimensional bar code reading dedicated devices, etc. There are advantages such as being able to be unified.

  In the above example, the catalog number, product type, color, size, version, etc. are coded together, but the catalog number, product type, color, size, version, etc. Needless to say, it may be coded separately and each bar code may be read one by one with a camera-equipped mobile phone.

  In the above embodiment, when the seller's home page access to the host server is required via the Internet, the home page address (hereinafter referred to as URL) information is converted into a barcode or two-dimensional code, and the barcode or two-dimensional code is converted into the barcode. After reading / decoding and accessing the host server, that is, the seller's homepage, the purchase processing of each product may be performed as in the above example.

  Note that the light source that illuminates the barcode may be provided with, for example, an LED lamp in the mobile phone 121 or may be provided outside the mobile phone 121. If it is outdoors, sunlight may be used as it is as a light source.

  In the above example, a product with a shape such as carbonated drink is taken as an example of a product desired to be purchased. However, as a desired product, a product with no shape such as some information, some music data, some program, etc. It may be.

  In addition, as an example of how to use the numeric keypad input unit of the mobile phone, the above example uses the input of a quantity, but the user's password may be registered in a server computer or the like and used for the input of the password.

  In the above example, as the information displayed on the liquid crystal display unit 123 of the mobile phone 121, the read information or the information stored in the memory is taken as an example. However, for example, the information sent from the seller's host server computer is received. Display, the processing result of the seller's host server computer for the information sent from the mobile phone 121 can be visually confirmed in a state where the user has performed the reading operation. In addition, it is obvious that the printed matter of the barcode is the same even if it is in the form of a book such as a product catalog.

  Note that the host server computer in the above embodiment is composed of, for example, a computer device body that is hardware, a program and data that are software, and most of the information processing functions are independent of hardware. For example, if there is a need to change some functional specifications due to the convenience of the seller, or if maintenance is required, there is no need to change the computer device itself. It can respond.

Next, this embodiment will be described by taking operation in door-to-door sales as an example. Since the operation of the mobile phone 121 itself is similar to the above-described operation, it is omitted.

  A visiting salesperson carries out sales activities with a mobile phone 121 and a product catalog for recommending products to customers who visit. The product catalog describes product specifications and the like, and a barcode that is paired with the product is printed. When you have a business talk with a customer at a visit, you will have a business talk at the entrance in the house. The product catalog is spread out on the floor and hallway of the entrance, and customers and visiting salespersons hold business negotiations while viewing the expanded product catalog. If there is a product that the customer likes, the visiting salesperson brings the camera unit 122 of the mobile phone 121 close to the barcode of the product catalog and performs a predetermined operation. Information read by the mobile phone 121 is sent to a server computer at a remote location via a mobile phone base station, a wireless network, the Internet network, etc., and product inventory information is obtained. The server computer transmits the obtained inventory information to the mobile phone of the visiting salesperson, and the stock quantity and whether the order can be received are displayed on the liquid crystal display unit of the mobile phone. The visiting salesperson confirms that the order can be received, and reads the barcode for ordering / printing, which is printed on the product catalog, by the mobile phone 121. The read data is sent to a server computer at a remote location by a mobile phone, and order processing for the product is performed. The server computer transmits the information on the completion of the order processing to the mobile phone of the visiting salesperson, and the information on the completion of the order processing is displayed on the liquid crystal display unit of the mobile phone.

  In the above example, the information read by the mobile phone 121 is sent to the server through the mobile phone without being stored in the memory. After reading the information to the extent that it can be stored in the memory, for example, the mail communication function of the mobile phone For example, the information stored in the memory may be sent to the server computer.

  In the above example, sales and purchases of products were taken as an example. However, when reading the barcode or 2D code printed on the delivery list placed on the desk and selecting the item you want to deliver But the same is true. In addition, in order to investigate the purchase trends of the general public, we recruited monitor members and read the barcodes and 2D codes printed on the products purchased by the monitor members in their normal lives. The survey can also be conducted by sending it to the investigator's host computer. The same applies to the case where a questionnaire is used for answering a question, and a questionnaire sheet in which a barcode or a two-dimensional code is printed in the answer column is used to answer a questionnaire sheet placed on a desk or the like. The same applies to a case where a bar code or a two-dimensional code printed on an examination ticket placed on a desk at a window is read and a patient chart is searched from the restored information.

  In the above example, only the reading of the one-dimensional barcode is mentioned, but since the area image sensor is used, it goes without saying that the two-dimensional code reading function can be applied simultaneously with the one-dimensional barcode reading function. Needless to say, the present invention can be applied even if an OCR character reading function is provided at the same time. In addition, a biometric function for performing authentication based on differences in human fingerprints, retinas, and irises may be provided at the same time.

As an example of the bar code reading recommended range on the liquid crystal display unit of the mobile phone, in the above embodiment, a semi-transparent red band mark is used. For example, from the upper left to the lower right of the liquid crystal display as shown in FIG. A red line or a blue line may be used. For example, a bracket-type mark “[” is displayed at the upper left of the liquid crystal display section as shown in FIG. 40, and “]” is displayed at the upper right. May be captured. In the case of black and white type liquid crystal, a mark indicating a bar code reading recommended range may be blinked. In addition, for example, the barcode reading position may be indicated by a mark such as a triangle on a housing portion around the liquid crystal display portion instead of the liquid crystal display portion as shown in FIG. Further, the direction of the recommended barcode reading range may be, for example, a direction as shown in FIG. 42, that is, a linear direction from the lower right part to the upper left part of the liquid crystal display unit, for example, both as shown in FIG. It goes without saying that there may be a bar code reading recommended range in the direction of. Further, the illumination light incorporated in the mobile phone is, for example, a strip-like illumination like the barcode reader of (Embodiment 1), and may also serve as a guide light indicating a recommended barcode reading range.

  It should be noted that the translucent red band-shaped mark or the bracket-shaped mark in the above-mentioned embodiment, which is an example showing the recommended reading range of the barcode on the liquid crystal display unit of the cellular phone, must be displayed from the beginning when reading is started. There is no. First of all, it recognizes the sign and determines whether the sign is a one-dimensional bar code or a two-dimensional code. If the result of the determination is a two-dimensional code, the mark is not displayed. If it is a one-dimensional bar code, the mark is displayed. May be performed. In addition, even if it is determined that the barcode is a one-dimensional barcode, if the barcode has the number of modules that can be read and decoded even if it is not within the barcode reading recommended range described in the present invention, the above mark is displayed. The reading / decoding process may be performed without performing the process. By such processing, reading can be performed without displaying the mark on the display unit when it is unnecessary, and it is possible to prevent “noisy” when the display unit is visually recognized.

  In the above embodiment, a mobile phone with a camera function in which the camera unit is built in the mobile phone is taken as an example. However, the camera unit is a separate unit and is connected to, for example, a connector unit of the mobile phone, or a mobile unit. It may be a camera unit that communicates with a telephone by wired connection, or a camera unit that communicates with a mobile phone by infrared communication or wireless communication. In this case, the function of decoding the one-dimensional barcode may be on the camera unit side or on the mobile phone side.

  The present invention described in the above embodiments may be realized by software such as a microcomputer program used in the mobile phone with a camera function exemplified in the above embodiments. As shown in FIG. 44, the software of the present invention may be downloaded to a memory in a mobile phone with a camera function by communication or the like. In FIG. 44, the software of the present invention is distributed from the server 460 to each mobile phone through the Internet network 470. The software itself may be a product and distributed to each mobile phone as a business. The software may be stored in a storage medium such as a memory card. In this case, maintenance such as program upgrade can be easily performed. Further, the storage medium is not limited to the above-described ones, and any storage medium that can store and record programs, such as a CD-ROM, an IC card, a ROM cassette, and a DVD, can be similarly implemented. By adopting such a system, the user of the mobile phone can arbitrarily use the software of the present invention.

The present invention can be applied not only to a mobile phone but also to a handy terminal having an area image sensor and an information processing system using the handy terminal. An example is shown in FIG.
This information processing system includes a plurality of handy terminals 501 with wireless communication functions, a plurality of wireless base stations 502, a PBX 503, a public line network 570, and a server 560. A plurality of radio base stations 502 are connected to the PBX 503 and form a local radio network together with a plurality of handy terminals. Each handy terminal 501 can read a two-dimensional code, and at the same time, can read a one-dimensional barcode by the method of the present invention. The read information is transmitted to the wireless base station 502 by wireless communication, and further transmitted to the server 560 via the PBX 503 and the public line network 570, and is used for various information processing. Even if the handy terminal does not have a wireless communication function, a similar information processing system can be constructed by assembling the system together with a communication unit or the like. By constructing such an information processing system using a handy terminal embodying the present invention, it is possible to construct a system that is more excellent in input processing capability for one-dimensional barcodes than conventional systems.

In the first embodiment and the second embodiment, which are the above examples, an image pickup unit that takes an image using an area image sensor in order to read a barcode, and a barcode from the taken image data. The decoding means for decoding is assumed to be in one device. For example, the imaging is a camera using an area image sensor, and information such as video captured from the camera is transmitted to another decoding device by wired / optical / wireless communication. The decoding device may recognize and decode the barcode from the received video by the method of the present invention. Information sent from the camera to the decoding device at this time may be analog or digital. FIG. 46 shows a camera 650 using an area image sensor 603. FIG. 47 shows a state in which the barcode label 602 attached to the cardboard box moving on the belt conveyor is being read by the method of the present invention using the camera 650 of FIG. Further, the camera itself may be a camera that implements the method of the present invention, or the camera itself may be a conventional one, and the decoding device side may be an apparatus that implements the method of the present invention. Also, as shown in FIG. 48, the image capturing device and the decoding device are in a remote location, and information such as video sent from the image capturing device 650 to the decoding device 680 is transmitted to a public line such as the Internet network 670 or a wireless communication network. You may transmit using. The decoding device itself may be a general personal computer, and the decoding means for recognizing and decoding the barcode from the image data may be a program using the method of the present invention. When the decoding device is a general personal computer, it is cheaper than a dedicated device, so that the system can be made inexpensive. The program may be stored and recorded in a storage medium such as a flexible disk or a CD-ROM, and may be executed by another independent computer system. In this case, maintenance such as program upgrade can be facilitated. Further, the storage medium is not limited to the above-described ones, and any storage medium that can store and record programs, such as an IC card, a ROM cassette, and a DVD, can be similarly implemented. Further, this program includes, for example, a program provided by the Internet.

  Needless to say, the mobile phone terminal, camera device, and decoding device in the above embodiment may be simultaneously provided with a two-dimensional code reading function and an OCR character reading function.

  In the above embodiment, the barcode is read by reflected light. However, the same applies to reading by transmitted light as well as reading by reflected light.

  If the number of pixels on one side of the area image sensor is 1000 pixels or more, the conventional method can read a one-dimensional barcode with a considerable resolution. However, the method for reading a one-dimensional barcode according to the present invention is further described. If used, it goes without saying that further improvement can be made with respect to the reading performance of the one-dimensional barcode.

  Note that, as shown in FIG. 49, from the beginning, the plurality of light receiving elements constituting the even-numbered rows are arranged in the respective light-receiving element rows with respect to the plurality of light-receiving elements constituting the odd-numbered rows from the beginning. The light receiving elements are shifted in the column direction by about ½ of the pitch between the light receiving elements, and each of the plurality of light receiving elements constituting the even-numbered row is different from each other in each light-receiving element row. When an area image sensor that is shifted in the row direction by about ½ of the pitch between the light receiving elements is used, the same effect as that of the present invention described in the above embodiment can be obtained. However, it cannot be denied that the area image sensor having a special arrangement as described above is expensive in terms of the cost of the sensor itself as compared with a general area image sensor arranged in a square lattice pattern.

  Needless to say, the method of reading a one-dimensional bar code that has been studied and implemented conventionally and the method of the present invention may be used in combination.

With the above configuration, the optical information reading apparatus and the optical information reading method of the present invention can improve the reading performance, and are used in a method of reading a one-dimensional barcode using an area image sensor, a POS, or the like. It is useful for an optical information reader such as a barcode reader, a two-dimensional code reader, and a handy terminal, an optical information reading method, and a system.

1 is an external perspective view of a barcode reader according to a first embodiment of the present invention. Schematic sectional view showing the configuration of the barcode reader in the first embodiment of the present invention The figure expressing arrangement | positioning of the area image sensor when it sees from the reading opening part of the barcode reader in the 1st Embodiment of this invention The figure which expanded the arrangement | sequence of each light receiving element of the area image sensor of FIG. 3 which concerns on the 1st Embodiment of this invention. 1 is a functional block diagram showing a schematic configuration of a circuit unit of a barcode reader according to the first embodiment of the present invention. The figure which shows a mode that the one-dimensional barcode which concerns on one embodiment of this invention forms an image on an area image sensor The figure which shows the example (1) of the light receiving element used at the time of the recognition and decoding of a one-dimensional barcode in the area image sensor of the barcode reader in the 1st Embodiment of this invention The figure which shows a mode that the part which has the one-dimensional information of a one-dimensional barcode is image-forming on the light receiving element group used at the time of the recognition and decoding of the one-dimensional barcode concerning the 1st Embodiment of this invention The figure showing contrast with the image data obtained from the light receiving element of Drawing 7 concerning a 1st embodiment of the present invention, and an imaged barcode The light receiving element which concerns on the 1st Embodiment of this invention, Comprising: The figure which shows the light receiving element used with respect to the area image sensor of 800 pixels of horizontal directions, and 600 pixels of vertical directions The figure which shows the example which reads the image of a barcode using the light receiving element on the diagonal of the rectangular area image sensor based on 1st Embodiment of this invention The figure which shows the example (2) of the light receiving element used at the time of the recognition and decoding of a one-dimensional barcode in the area image sensor of the barcode reader in the 1st Embodiment of this invention The figure which represents that the average value of the data of a some light receiving element is calculated from each data of the light receiving element shown in FIG. 12 which concerns on the 1st Embodiment of this invention, and it is set as pixel data The figure which shows the range from which the resolution becomes larger than the number of horizontal pixels in the 1st Embodiment of this invention. The figure which shows the case where the arrangement | sequence of the light receiving element of the area image sensor is a rectangular lattice which makes a rectangle based on the 1st Embodiment of this invention The figure which shows an example of the illumination light which shows the reading position of the one-dimensional barcode which concerns on the 1st Embodiment of this invention The figure which shows having provided the mark for showing the reading position of the one-dimensional barcode based on the 1st Embodiment of this invention beside the reading port. The figure which shows the example which lengthened the housing shape of the periphery of a reading opening | mouth horizontally in order to show the reading position of the one-dimensional barcode based on the 1st Embodiment of this invention 1 is a block diagram of a barcode reader using an area image sensor that outputs only data and signals of a light receiving element used for reading and decoding a one-dimensional barcode, showing a first embodiment of the present invention. The flowchart which shows an example of operation | movement of the barcode reader shown in FIG. 19 which concerns on the 1st Embodiment of this invention. The figure which shows the example which showed a mode that the area image sensor based on the 1st Embodiment of this invention rotates. The figure showing the image of the part image-formed on the light receiving element used at the time of recognition and decoding of the one-dimensional barcode based on the 1st Embodiment of this invention The flowchart which shows the operation | movement which extinguishes the illumination light of the excess part when reading the one-dimensional barcode which concerns on the 1st Embodiment of this invention. The figure which shows a mode that the whole area which an area image sensor captures in the 1st Embodiment of this invention is illuminated with illumination. The figure which shows a mode that the illumination of the unnecessary part was turned off when reading a one-dimensional barcode in the 1st Embodiment of this invention. The figure which shows an example which forms the image of a one-dimensional barcode on the predetermined light receiving element of an area image sensor using a mirror in the 1st Embodiment of this invention. External view of mobile phone terminal with camera function provided with bar code reading means in the second embodiment of the present invention The figure expressing arrangement | positioning of the area image sensor of the mobile telephone terminal with a camera function provided with the barcode reading means in the 2nd Embodiment of this invention The block diagram which shows schematic structure of the barcode reading part in the circuit part of the mobile telephone terminal with a camera function in the 2nd Embodiment of this invention The figure expressing the mode of arrangement of the light receiving elements of the area image sensor of the mobile phone terminal with a camera function provided with the barcode reading means in the second embodiment of the present invention The figure showing the light receiving element used for reading and decoding of a one-dimensional barcode in the area image sensor of the cellular phone terminal according to the second embodiment of the present invention The figure which shows the example (1) which displayed the mark which shows the range which recommends reading of a barcode on a liquid crystal display part, when reading a barcode with the mobile telephone terminal in the 2nd Embodiment of this invention. The figure which shows the example arrange | positioned in the mobile telephone terminal in the 2nd Embodiment of this invention inclining the horizontal and vertical direction of an area image sensor at an angle of 45 degrees with respect to the horizontal and vertical direction of a mobile telephone. The figure which shows the example of the light receiving element of the part used for a display among all the images caught with the area image sensor of the mobile telephone shown in FIG. 33 which concerns on the 2nd Embodiment of this invention. The figure which shows an example which the liquid crystal display part has shown the whole image caught with the imaging camera at the time of barcode reading with the mobile telephone shown in FIG. 33 concerning the 2nd Embodiment of this invention. The figure which further displayed the mark which shows barcode reading recommendation range in the example of a display shown in Drawing 35 concerning the 2nd embodiment of the present invention. The information processing system using the mobile telephone in the 2nd Embodiment of this invention, and the block diagram which shows the purchase and sale method of goods The figure which shows a mode that the barcode of 14 mm width is imaged on the area image sensor by the imaging lens in the 2nd Embodiment of this invention. The figure which shows the example (2) which displayed the mark which shows the range which recommends reading of a barcode on a liquid crystal display part, when reading a barcode with the mobile telephone terminal in the 2nd Embodiment of this invention The figure which shows the example (3) which displayed the mark which shows the range which recommends reading of a barcode on a liquid crystal display part, when reading a barcode with the mobile telephone terminal in the 2nd Embodiment of this invention The figure which shows the example which displayed the mark which shows the range which recommends reading barcode on the liquid-crystal peripheral part, when reading barcode with the mobile telephone terminal in the 2nd Embodiment of this invention The figure which shows the example (4) which displayed the mark which shows the range which recommends reading of a barcode on a liquid crystal display part, when reading a barcode with the mobile telephone terminal in the 2nd Embodiment of this invention The figure which shows the example (5) which displayed the mark which shows the range which recommends reading of a barcode on a liquid crystal display part, when reading a barcode with the mobile telephone terminal in the 2nd Embodiment of this invention. The figure which shows an example which is distributing the software in the 2nd Embodiment of this invention from a server computer to each mobile phone via the Internet network The figure which shows an example of the information processing system by the handy terminal in the 2nd Embodiment of this invention The figure which shows an example of the imaging device of this invention which uses an area image sensor in the 2nd Embodiment of this invention. The figure which shows a mode that the barcode label stuck on the cardboard box which moves on a belt conveyor is read using the imaging device of FIG. 46 based on the 2nd Embodiment of this invention. The figure which shows an example of the system which transmits information, such as a video sent to the decoding apparatus from the imaging device in the 2nd Embodiment of this invention using a public line. The figure which shows the example of the area image sensor of the light-receiving element based on the 2nd Embodiment of this invention of a special arrangement | sequence. The figure which shows the example of the light receiving element arranged in the area image sensor The figure which looked at the state of the area image sensor arranged in the conventional bar code reader using the area image sensor from the reading opening direction. The figure which shows a mode that a one-dimensional barcode is imaged on the light receiving element arranged in the horizontal direction of the area image sensor The figure which shows the example which shows the relationship between a one-dimensional barcode and a linear image sensor scan The figure which shows the example of the light receiving element arranged on the straight line in the linear image sensor The figure which shows the example which caught not only the width direction of the barcode but the whole including the height in the field of view that can be captured by the area image sensor

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Barcode reader using area image sensor 2 Barcode label 3,23 Area image sensor 4 Imaging lens 5 Circuit part 6 Light emitting part 7 Light receiving element 8, 28 Waveform processing part 9, 29 Memory part 10, 30 Recognition part DESCRIPTION OF SYMBOLS 11 Reading opening part 13 Rectangular area image sensor 20 Illumination light which has two corners in the horizontal direction 21 Triangular mark 22 Convex part 41 Illumination light which illuminates all the range which an area image sensor captures, and its circumference | surroundings 42 One-dimensional bar Only the part that forms an image on the light receiving element used when reading the code
Illuminating illumination light 45 Mirror 102 Bar code 103, 203 displayed on the liquid crystal display unit of the mobile phone Camera area image sensor 107 Light receiving elements arranged on a square lattice in the camera area image sensor 108 Amplification unit and AD conversion unit 109 Waveform processing unit 109 Memory unit for storing digital data converted by the waveform processing unit 121 Mobile phone with camera function 122 Camera window built into the mobile phone 123 Liquid crystal display unit built into the mobile phone 124 Liquid crystal periphery Part 125 A semi-transparent red band mark indicating a bar code reading recommended range displayed on the liquid crystal display part 123,
126 Indicates a bar code reading recommended range displayed on the liquid crystal display unit 123.
Translucent red line mark,
127 A bar code reading recommended range displayed on the liquid crystal display unit 123 is shown.
Parenthesis-shaped mark 128 Indicates the recommended barcode reading range provided on the liquid crystal periphery 124
Triangular mark 160 Wireless communication network 162 Bar code 170 Internet network 175 Seller host server computer 177 Purchase / sales information 178 Product 421 Mobile phone with camera function 460 Server 470 Internet network 501 Handy terminal 502 Wireless base station 503 PBX
560 Server 570 Public network 602 Bar code label 603 Area image sensor 650 Camera 660 Monitor 670 Internet network 680 Decoding device 901 Bar code reader 902 Bar code label 903 Area image sensor 904 Imaging lens 907 Light receiving element 912 Bar code image 990 Light receiving Element (Linear image sensor)

Claims (1)

An area image sensor in which a plurality of light receiving elements are arranged on a matrix in a horizontal direction and a vertical direction, and receives reflected light or transmitted light from a sign having one-dimensional information in at least one direction and converts it into an electrical signal; A decoding unit that restores information included in the sign based on a signal from the area image sensor, wherein the area image sensor is a one-dimensional direction of the one-dimensional information of the sign that forms an image on the image area sensor And the diagonal of the area image sensor are arranged in parallel to each other, and the reflected light or transmitted light from the marker is received using at least two light receiving elements across the diagonal, and the two or more optical, characterized by generating a signal from the area image sensor by calculating an average value of data of the light-receiving element of the Broadcast reader.

Images