JP2006344066A - Figure code reading device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a figure code reading device capable of deciding a position relationship, etc. of a distance between a figure code and an imaging lens to an appropriate distance when the figure code reading fails, based on one or two or more of a cell size calculation result, history information of the decision result in the degree of focusing, and both the cell size calculation result and the history information of the decision result in the degree of focusing, and capable of outputting an appropriate instruction for adjusting the positions based on the above results. <P>SOLUTION: Based on one or a plurality of the cell size calculation result, the history information of the decision result in the degree of focusing, and both the cell size calculation result and the history information of the decision result in the degree of focusing; the position relationship, etc. are decided on the distance between the figure code and the imaging lens to the appropriate distance. Based on the above results, the appropriate instruction of the position adjustment is output. By outputting the appropriate instruction of the position adjustment to a user, the time required for reading the figure code can be reduced. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a graphic code reading device in a portable terminal device.

Currently, it is possible to read a graphic code by using a camera function of a mobile phone which is one of mobile terminal devices. In order to correctly read the graphic code, the graphic code to be read needs to be at an appropriate distance from the imaging lens. The appropriate distance is a distance in which the graphic code is in the in-focus range where the imaging lens is focused, and a cell, which is the minimum structural unit of the graphic code, is input from the imaging lens with a certain number of pixels or more. Conventionally, in the case of a handy type barcode reader, a positioning illumination device such as an LED installed around the camera is used, and the projection light of the illumination is overlapped when the distance is appropriate, so that the user can We have provided a guide to facilitate positioning. On the other hand, in general, it is difficult to set up such illumination for positioning when reading a figure code on a camera-equipped mobile phone. Therefore, the mobile phone display unit is used as a viewfinder and a frame is displayed in it. Then, the user is adjusted so that the figure code can be entered.
JP 5-128292

  However, in mobile phones, the resolution of the display unit is lower than the resolution of the camera, so the image will be reduced and displayed, and it is difficult to determine whether the image is in focus by looking at the viewfinder There is. Therefore, when the distance is not appropriate, reading of the graphic code fails. The figure code is read continuously, and if it can be adjusted to an appropriate position, the reading will be successful, but if the reading fails, it will be determined whether the user should be closer or farther away. There is a problem that reading will not be successful and reading will take time unless it is adjusted many times, such as not touching, approaching, or moving away.

  In order to solve the above-described problem, the present invention provides a cell size calculation result, an in-focus degree determination result history information, a cell size calculation result history information, and an in-focus degree determination result history information when graphic code reading fails. Graphic code that can determine the positional relationship of the distance between the graphic code and the imaging lens relative to the appropriate distance based on one or two or more and output an appropriate instruction for position adjustment based on the result A reader is provided.

  According to the present invention configured as described above, when the distance between the graphic code and the imaging lens is not within the readable distance of the graphic code, an appropriate instruction for position adjustment is output. It becomes easy, the operability of the graphic code reading is improved, and the time required for reading can be shortened.

  In the following, an embodiment of the present invention will be described with reference to the drawings, taking graphic code reading in a mobile terminal device as an example of QR code reading by a camera-equipped mobile phone. QR code (registered trademark) is a graphic code developed by DENSO WAVE INCORPORATED as a two-dimensional code that emphasizes high-speed reading. It is JIS standard, and QR code reading by mobile phones is common. Note that the present invention is not limited to these embodiments, and can be implemented in various modes without departing from the spirit of the present invention.

  FIG. 1 is a diagram for explaining an example of the concept of the graphic code reader shown in the present invention. The QR code reading in the case where the imaging lens (0103) is installed at the bottom of the back surface of the cellular phone (0101) is shown. When trying to read the QR code (0102), as shown in the left of FIG. 1, since the video is displayed on the finder (0106) of the mobile phone, the mobile phone is moved up and down until the user can read the QR code while watching the video. Will do. At this time, the relationship between the QR code (0102) printed on paper or the like (0105) and the imaging lens (0103) and the QR code reading are as shown on the right in FIG. In (a), since the distance between the QR code (0102) and the imaging lens (0103) is too short, the QR code image (0104) is not in focus. Conversely, in (c), the QR code (0102) and the imaging lens (0103) are too far away, so that the QR code image (0104) is smaller than the readable size and the code is unclear. Therefore, in the cases (a) and (c), reading of the QR code fails. On the other hand, as shown in (b), when the QR code (0102) and the imaging lens (0103) are at an appropriate distance, reading is successful, and information in the QR code is displayed on the finder (0106). The present invention provides a graphic code that is output to the user so that the imaging lens is moved in an appropriate direction when the cause of the failure in reading the graphic code is the distance between the graphic code and the imaging lens, such as (a) and (c). It is a reading device. For example, position adjustment information (0107) such as “Please move away” in the case of (a) and “Please move closer” in the case of (c) is output to the finder (0106).

In the first embodiment, claims 1, 8, and 9 will be mainly described. The second embodiment will mainly describe claims 2 and 10. The third embodiment will mainly describe claims 3 and 11. In more detail, Embodiment 3-1 explains Claims 4 and 12. In the embodiment 3-2, claims 5 and 13 will be mainly described. The embodiment 3-3 will mainly describe claims 6 and 14. Embodiment 3-4 will mainly describe claims 7 and 15. FIG. 26 summarizes the concept of each embodiment. The graphic code reader of Embodiment 1 can determine whether the imaging lens is in the unreadable area (A1) or in the readable area (A2, A3, A4). The graphic code reading apparatus according to the second embodiment can determine whether it is further moved in the in-focus direction within the readable area (B1) or not in the in-focus direction (B2). The graphic code reader according to the third embodiment further determines whether the distance between the graphic code and the imaging lens is shorter (C1, C4) or longer (C2, C3) than the in-focus area. it can. Further, FIG. 27 shows the configuration requirements in each claim.
Embodiment 1
<Outline of Embodiment 1>

FIG. 2 shows an example of the concept of this embodiment. When the distance between the graphic code printed on paper or the like and the imaging lens of the mobile terminal device is longer than the readable distance as shown in FIG. 2A, the finder displays as shown in FIG. 2B. The graphic code image is small and unclear, and graphic code reading fails. In the present embodiment, based on the calculation result that the cell size from the cell size calculation unit is smaller than the set minimum value, it is determined that the graphic code is too far from the appropriate distance, and the imaging lens is brought closer to the user. Thus, for example, it is a portable terminal device having a graphic code reading device that outputs position adjustment information such as “Please move closer”.
<Configuration of Embodiment 1>

  FIG. 3 shows an example of functional blocks in the present embodiment. The “graphic code reading device” (0300) of the present embodiment includes a “camera unit” (0301), a “graphic code information output unit” (0302), a “cell size calculation unit” (0303), and “readability”. It has a “determination unit” (0304) and an “adjustment information output unit” (0305).

  The “camera unit” (0301) is configured to output an image signal of an image of a graphic code input from the imaging lens. The imaging lens forms an optical image of the graphic code on the photosensitive surface of the imaging device. Any type of imaging lens may be used as long as it can provide an image quality capable of effectively reading a graphic code. For example, a plastic lens or a glass lens can be used. Moreover, what has a zoom function and a macro function is preferable. As the imaging device, a CMOS (complementary metal oxide semiconductor), a CCD (electrically coupled device), or the like can be used. The figure code is a figure including information such as numbers, symbols, characters, images, and the like, which is a reading target of the present invention. For example, there are a barcode represented by a JAN code and a two-dimensional code represented by a QR code. In the present invention, the type is not limited. The image signal means a digital signal obtained by converting a captured image.

  The “graphic code information output unit” (0302) is configured to output graphic code information based on the image signal output from the camera unit (0301). The figure code information refers to information obtained by extracting only the image signal of the finder pattern from the image signal output from the camera unit. A finder pattern is a figure that is known from the type of figure code and for specifying the position, size, etc. of the figure code. FIG. 4 shows a QR code finder pattern. The QR code finder pattern (0400) is a square figure consisting of 7 cells on one side, and the ratio of black: white: black: white: black width when moving laterally through the center is 1: 1: 3: 1: 1. A cell is the smallest structural unit of a figure code, and is a cell that is 1 both vertically and horizontally in the ratio. Although shown in black or white in FIG. 4, the cell color is not limited to a combination of black and white as long as the cell color can be binarized. Since the image signal output from the camera unit includes all the signals in the captured viewfinder, it may also include signals such as surrounding characters that are not necessary for graphic code reading. The unit has a function of extracting and outputting only the image signal of the finder pattern from among them. The figure code information is extracted by detecting a ratio of black: white: black: white: black width 1: 1: 3: 1: 1 which is characteristic of the finder pattern.

  The “cell size calculation unit” (0303) is configured to calculate the cell size based on the graphic code information output from the graphic code information output unit (0302). Since the ratio of the width of the finder pattern does not change even if the length of one side of the QR code or the number of cells constituting one side changes, the cell size can always be calculated by using graphic code information. The cell size refers to the number of pixels of the image sensor that constitutes one cell. The cell size is obtained by calculating from the number of pixels of the cells constituting the finder pattern that is graphic code image information. For example, it can be obtained by calculating the width of one cell from the width of the finder pattern, or it can be obtained from the number of pixels for nine cells forming a black square with one side of the center part. Any other method may be used as long as it can efficiently calculate the number of pixels constituting one cell. Therefore, the cell size increases as the cell width of the graphic code increases, and the cell size decreases as the cell width of the graphic code decreases. That is, when the cell size is large, the graphic code and the imaging lens are at a short distance, and when the cell size is small, the graphic code and the imaging lens are at a long distance.

  In the above description of the function, the QR code is used as an example. In the present invention, the same function is used when the finder pattern is a start code or stop code, and the cell is a bar code such as a bar or module. Including the meaning of the term.

  The “readability determination unit” (0304) determines whether the calculated cell size is smaller than the set minimum value from the cell size calculation result calculated by the cell size calculation unit (0303). It is configured to determine whether reading is impossible. The distance at which the graphic code can be read refers to the distance at which the graphic code information can be read. The minimum cell size that can be read is 2 pixels according to the sampling theorem, but it is preferable to set 2 pixels + several pixels in order to suppress the influence of noise and blur of the input image. For example, the minimum cell size can be 3 pixels (Patent Document 1). When the readability determination unit of the present embodiment determines that the cell size is smaller than the set minimum value and cannot be read, the readability determination unit determines that the imaging lens is not within a distance where the graphic code can be read.

  The “adjustment information output unit” (0305) outputs position adjustment information for imaging to the user based on the determination result of the readability determination unit (0304). If it is determined by the readability determination unit that the graphic code is not within a distance where the graphic code can be read, position adjustment information is output so that the distance between the graphic code and the imaging lens is closer. The output method of the adjustment information is not limited to display by characters, but may be graphics, voice, vibration, light, screen color, or the like. An example of the output method is shown in FIG. When outputting in characters as in (a), it can be displayed on the viewfinder so as not to interfere with imaging, such as “Please move closer” or “DOWN”. You may make it blink etc. so that a user may notice easily. It can also be represented by a figure such as an arrow as shown in (b). In the case of outputting by vibration or light, the interval of vibration, change in color of light, or the like may be set, or may be set by the user himself / herself.

A “portable terminal device” refers to a portable device having a graphic code reading function. For example, there are mobile phones and PDAs.
<Processing flow of Embodiment 1>

  FIG. 6 shows an example of the flow of processing in the first embodiment. As shown in this figure, first, an image of a graphic code input by photographing is output (graphic code image output step S0601), and graphic code information is output from the obtained image information (graphic code information output step S0602). Next, the cell size is calculated based on the graphic code information obtained in the graphic code information output step (cell size calculation step S0603). Subsequently, it is determined from the cell size calculation result calculated in the cell size calculation step whether or not the calculated cell size is unreadable (readability determination step S0604). Finally, position adjustment information for imaging is output based on the readability determination result determined in the readability determination step (adjustment information output step S0605).

  Each of the above processes will be described with specific examples. The following specific processing methods are examples, and embodiments of the present invention are not limited to these. In the graphic code image output step (S0601), the graphic code image captured from the imaging lens is coupled to an image sensor such as a CCD, converted from an analog signal to a digital signal by A / D conversion, and output. Next, in the graphic code information output step (S0602), pattern matching is performed, and a signal having a specified ratio of 1: 1: 3: 1: 1 is selected from the image information output in the graphic code image output step. Only the image signal of the finder pattern is extracted and only the graphic code information is output. In the cell size calculation step (S0603), based on the graphic code information output in the graphic code information output step (S0602), the position coordinates of each cell are calculated from the coordinates of the contour, and the number of pixels constituting one side, Alternatively, the cell size is calculated by calculation from the number of pixels constituting nine black cells in the center. At this time, if the cell size calculated in the cell size calculation step (S0603) is smaller than the set minimum value, the image pickup lens is not within a distance where the graphic code can be read in the readability determination step (S0604). In the adjustment information output step (S0605), position adjustment information is output so as to bring the imaging lens closer.

The above processing can be executed by a program for causing a computer to execute, and this program can be recorded on a recording medium readable by the computer. (The same applies throughout the specification.)
<Effect of Embodiment 1>

Conventionally, when graphic code reading fails, the user cannot determine what is the cause, and it has been difficult to determine whether it is better to move the imaging lens closer to or away from the graphic code. . However, in the graphic code reader according to the present embodiment, if the graphic code reading fails because the distance between the graphic code and the imaging lens is too long, an instruction is output from the adjustment information output unit to bring the imaging lens closer. Therefore, the user can easily adjust the distance between the graphic code and the imaging lens.
<< Embodiment 2 >>
<Outline of Embodiment 2>

FIG. 7 shows an example of the concept of this embodiment. In the present embodiment, when the graphic code reading fails due to being out of focus, whether or not the direction in which the user's mobile terminal device is moving is the correct direction or the wrong direction It is a graphic code reading device that determines whether or not the mobile terminal device should be moved thereafter, for example, “Please move it as it is”.
<Configuration of Embodiment 2>

  FIG. 8 shows an example of functional blocks of the present embodiment. Based on the first embodiment, it further includes an in-focus degree determination unit and an in-focus degree history information holding unit. The “graphic code reading device” (0800) of this embodiment includes a “camera unit” (0801), a “graphic code information output unit” (0802), a “cell size calculation unit” (0803), and “readability”. “Determining unit” (0804), “Focus degree determination unit” (0805), “Focus degree determination result history information holding unit” (0806), “Appropriate direction determination unit” (0807), “Adjustment information” Output section "(0808).

  The “focusing degree determination unit” (0805) is configured to determine the degree of focusing of the graphic code image in the camera unit (0801). The degree of focus refers to the degree of focus and is determined by the contrast ratio (brightness / darkness ratio between bright and dark areas). For example, a large degree of focus means that the contrast ratio is large. Further, when the contrast ratio is equal to or greater than a threshold value necessary for reading the graphic code, it is referred to as an in-focus state (in-focus state). That is, when the distance between the graphic code and the imaging lens is too close or too far, the degree of focus is small, and when the distance is within a certain distance range, the degree of focus is large. In the case of a mobile terminal having a macro function, since it is set to focus at a certain distance, the degree of focusing decreases as the distance from the distance increases. The distance at which the image is in focus and information such as numbers and characters incorporated in the graphic code can be read is called an appropriate distance. If the imaging lens and the graphic code are too close, the focus cannot be achieved and the graphic code information cannot be read, which is not an appropriate distance. On the other hand, when the imaging lens and the graphic code are too far from each other, a resolution sufficient to read the graphic code information cannot be obtained, and it cannot be said that the distance is appropriate. In other words, an appropriate distance is a distance where the imaging lens and the graphic code are neither too close nor too far away.

  The “in-focus degree determination result history information holding unit” (0806) is configured to hold in-focus degree determination result history information that is a history of changes in the in-focus degree from the in-focus degree determination unit (0805). ing. FIG. 9 shows an example of the relationship between time and the degree of focus. In the case of (a), the in-focus degree determination result history information that the focus is achieved is held, and in the case of (b), the in-focus degree determination result history information that the focus is lost is retained. .

  The “appropriate direction determination unit” (0807) is based on the in-focus degree determination result history information recorded in the in-focus degree determination result history information holding unit (0806). It is configured to determine whether the movement is in the in-focus direction or not in the in-focus direction. If the in-focus degree determination result history information is information that the degree of in-focus is large, it is determined that the in-focus direction is moving, and conversely, the in-focus degree determination result history information has an in-focus degree. If the information is smaller, it is determined that the movement is not in the in-focus direction.

  The adjustment information output unit (0808) captures images based on the determination result from the readability determination unit (0804) and the determination result from the appropriate direction determination unit (0807) in addition to the function described in the first embodiment. Is configured to output position adjustment information. If it is determined that the image pickup lens is within a distance where the graphic code can be read by the readability determination unit, and the appropriate direction determination unit determines that it is moving in the in-focus direction, the user is currently moving the image pickup lens. Output to continue moving in the direction. In addition, when the readability determination unit determines that the graphic code is within the distance that the graphic code can be read, and the appropriate direction determination unit determines that it has not moved in the in-focus direction, the user moves the imaging lens now. The output is made to move in the direction opposite to the current direction. The adjustment information output method uses characters, graphics, voice, vibration, light, screen color, and the like, as in the first embodiment. For example, in the case of characters as shown in FIG. 5C, “Please move as it is” or “Please move in the opposite direction” is displayed.

Other processes are the same as those in the first embodiment.
<Processing flow of Embodiment 2>

  FIG. 10 shows the processing flow of the second embodiment. First, an image of the captured graphic code is output (graphic code image output step S1001), and graphic code information is output based on the obtained image information (graphic code information output step S1002). Next, the cell size is calculated from the figure code information obtained in the figure code information output step (cell size calculation step S1003), and the cell calculated from the cell size calculation result calculated in the cell size calculation step is calculated. It is determined whether the size is readable (readability determination step S1004). When it is determined that reading is possible in the readability determination step, the degree of focus of the graphic code image output in the graphic code image output step is determined (focusing degree determination step S1005), and the degree of focusing is determined. Result history information is held (focusing degree determination result history information recording step S1006). Further, based on the in-focus degree determination result history information recorded in the in-focus degree determination result history information recording step, whether the past relative movement between the imaging lens and the figure code is a movement in the in-focus direction. It is determined whether the movement was in the focal direction (appropriate direction determination step S1007). Finally, based on the determination result determined in the appropriate direction determination step, position adjustment information for imaging is output (adjustment information output step S1008).

Each of the above processes will be described with specific examples. The graphic code image output step, graphic code information output step, cell size calculation step, and readability determination step are the same as in the first embodiment. When it is determined in the readability determination step (S1004) that the imaging lens is at a distance where the graphic code can be read, by calculating the contrast ratio of the graphic code image output in the graphic code image output step, The degree of focus is determined (focus level determination step S1005), and the change is held in the recording medium as focus level determination result history information (focus level determination result history information recording step S1006). At this time, if the in-focus degree determination result history information is history information that the in-focus degree increases, it is determined in the appropriate direction determination step (S1007) that the in-focus direction is moving, In the adjustment information output step (S1008), output is performed so as to continue the movement in the currently moving direction. On the other hand, if the in-focus degree determination result history information is history information that the in-focus degree is decreasing, it is determined in the appropriate direction determination step (S1007) that the movement is not in the in-focus direction, and adjustment is performed. In the information output step (S1008), output is performed so as to move in the direction opposite to the currently moving direction. If the graphic code is successfully read, the data recorded on the recording medium is erased.
<Effect of Embodiment 2>

In the graphic code reading apparatus of the present embodiment, when the graphic code reading fails because the graphic code image is not focused, an instruction for the position adjustment direction of the imaging lens is given to the adjustment information output unit in accordance with the movement of the user. Since it is output, the user can easily adjust the position of the imaging lens.
<< Embodiment 3 >>
<Outline of Embodiment 3>

FIG. 11 shows an example of the concept of the present embodiment. In the present embodiment, when reading of the graphic code fails due to the fact that it is not in focus, the graphic code and imaging are added by adding cell size calculation result history information to the determination result of whether or not the movement is in the in-focus direction. The distance from the lens can be determined. Based on the perspective determination result, for example, it is a graphic code reading device that outputs position adjustment information in more detail than in the second embodiment, such as “Please move closer as it is” or “Please move closer”.
<Configuration of Embodiment 3>

  FIG. 12 shows an example of functional blocks of this embodiment. The present embodiment is based on the second embodiment, and further includes a cell size calculation result history information holding unit. The “graphic code reading device” (1200) of the present embodiment includes a “camera unit” (1201), a “graphic code information output unit” (1202), a “cell size calculation unit” (1203), and “readability”. A “determination unit” (1204), a “cell size calculation result history information holding unit” (1205), a “focus degree determination unit” (1206), and a “focus degree determination result history information holding unit” (1207). , “Appropriate direction determination unit” (1208), “Perspective determination unit” (1209), and “Adjustment information output unit” (1210).

  The “cell size calculation result history information holding unit” (1205) is configured to record history information of the cell size calculation result calculated by the cell size calculation unit (1203). The cell size calculation result history information refers to a cell size change history. For example, when the image pickup lens is brought close to a graphic code, the cell size increases from 20 pixels to 25 pixels and 40 pixels. In addition, when the imaging lens is moved away from the graphic code, the change history information indicates that the cell size is reduced from 50 pixels to 45 pixels and 30 pixels.

  The “distance determination unit” (1209) is based on the determination result from the appropriate direction determination unit (1208) and the cell size calculation result history information recorded in the cell size calculation result history information holding unit (1205). The distance between the imaging lens and the graphic code is determined with respect to an appropriate distance. When the determination result from the appropriate direction determination unit (1208) is information that the movement is in the in-focus direction, the cell size calculation result history information recorded in the cell size calculation result history information holding unit (1205) When the information indicates that the cell size is small, it is determined that the imaging lens is close to an appropriate distance. When the information indicates that the cell size is large, the imaging lens is set at an appropriate distance. On the other hand, it determines with being in a long distance. Further, when the determination result from the appropriate direction determination unit (1208) is information that the movement is not in the in-focus direction, the cell size calculation result history information recorded in the cell size calculation result history information holding unit (1205). However, when the information indicates that the cell size is small, it is determined that the imaging lens is far from the appropriate distance, and when the information indicates that the cell size is large, the imaging lens is appropriate. It is determined that there is a short distance with respect to the distance.

  The adjustment information output unit (1210) outputs position adjustment information for imaging to the user based on the determination result of the perspective determination unit (1209) in addition to the functions shown in the first and second embodiments. It is configured. When the distance determination unit (1209) determines that the imaging lens is close to an appropriate distance, position adjustment information is output so that the distance between the graphic code and the imaging lens is further increased. Conversely, if it is determined that the imaging lens is far away from the appropriate distance, position adjustment information is output so that the distance between the graphic code and the imaging lens is closer. For example, when it is determined that it is a long distance, it is output as shown in FIG. An example of the output method when it is determined that the distance is short is shown in FIG. When outputting in characters as in (a), characters such as “Please keep away” and “UP” are displayed. It can also be represented by a figure such as an arrow as shown in (b). When outputting by vibration or light, it can be performed in the same manner as in the first embodiment. In addition, since the judgment result of the perspective judgment unit also includes the appropriate direction judgment result, it outputs more detailed information than the one shown above, such as “Please keep it as it is” or “Please keep it away” It is also possible to do.

Other processes are the same as those in the first embodiment.
<Processing flow of Embodiment 3>

FIG. 13 shows the processing flow of the third embodiment. First, an image of the captured graphic code is output (graphic code image output step S1301), and graphic code information is output based on the obtained image information (graphic code information output step S1302). Next, the cell size is calculated from the figure code information obtained in the figure code information output step (cell size calculation step S13303), and the calculated cell size is larger than the set minimum value from the calculated cell size calculation result. (Readability determination step S1304). When it is determined that reading is possible in the readability determination step, history information of the cell size calculation result calculated in the cell size calculation step is recorded (cell size calculation result history information recording step S1305). Subsequently, the degree of focus of the figure code image output in the figure code image output step is determined (focus degree determination step S1306), and history information of the focus degree determination result is recorded (focus degree determination result). History information recording step S1307). Further, based on the in-focus degree determination result history information recorded in the in-focus degree determination result history information recording step, whether the past relative movement between the imaging lens and the figure code is a movement in the in-focus direction. It is determined whether the movement was in the focal direction (appropriate direction determination step S0908). Next, based on the determination result determined in the appropriate direction determination step and the cell size calculation result history information recorded in the cell size calculation result history information holding unit, the distance between the imaging lens and the graphic code The perspective of the appropriate distance is determined (perspective determination step S0909). Finally, based on the determination result acquired in the perspective determination step, position adjustment information for imaging is output to the user (adjustment information output step S0910).
<< Embodiment 3-1 >>
<Outline of Embodiment 3-1>

Embodiment 3 will be described below with a more specific example. FIG. 14 shows an example of the concept of this embodiment. In the drawing, an appropriate distance between the graphic code and the imaging lens is indicated by a hatched portion. As shown in FIG. 14 (a), when the graphic code is read by the portable terminal device, the distance between the graphic code printed on the paper or the like and the imaging lens is large, but the graphic code can be read. If it is close to an appropriate distance, it is displayed on the finder as shown in FIG. 14B, and the graphic code image is too large and blurred, so that the graphic code reading fails. The present embodiment is based on the second embodiment, and obtains history information that the cell size is larger than the set minimum value and the cell size becomes smaller, and history information that the degree of focusing becomes larger. In such a case, the graphic code reader determines that the distance between the graphic code and the imaging lens is too close to the appropriate distance, and outputs position adjustment information to move the imaging lens further away from the user as shown in FIG. is there.
<Configuration of Embodiment 3-1>

  FIG. 15 shows an example of functional blocks of this embodiment. The present embodiment is characterized in that, based on the third embodiment, the perspective determination unit further includes first perspective determination means. Here, a case where the perspective determination unit has only the first perspective determination means will be described. The “graphic code reading device” (1500) of the present embodiment includes a “camera unit” (1501), a “graphic code information output unit” (1502), a “cell size calculation unit” (1503), and “readability”. A “determination unit” (1504), a “cell size calculation result history information holding unit” (1505), a “focus degree determination unit” (1506), and a “focus degree determination result history information holding unit” (1507). , “Appropriate direction determination unit” (1508), “perspective determination unit” (1509), and “adjustment information output unit” (1510), and the perspective determination unit further includes “first perspective determination unit” (1511). ).

The “first perspective determination means” (1511) constitutes the perspective determination unit (1510), information indicating that it is moving in the in-focus direction from the appropriate direction determination unit (1508), and cell size calculation result history When the information that the cell size is decreasing from the information holding unit (1505) is acquired, the graphic code has a function of determining that the graphic code is close to an appropriate distance. FIG. 16A is an example showing the relationship between the degree of focusing and the cell size. In this figure, the minimum cell size that can be read is C _min , and the focusing threshold is F _min . When the cell size is equal to or _larger than the cell size minimum value C _min and the in-focus level is equal to or larger than the focusing threshold value F _min, it is an appropriate distance between the graphic code and the imaging lens, and the graphic code can be read. (The same applies to FIGS. 19, 22, and 25). When the first perspective determination unit acquires information that the imaging lens is in the readable region and the degree of focus increases as the cell size decreases, that is, the point X in FIG. 16 indicates the direction of the arrow. When the information indicating that the graphic code is moving is acquired, the graphic code has a function of determining that the graphic code is close to an appropriate distance.
<Processing Flow of Embodiment 3-1>

The processing flow of the embodiment 3-1 is the same as that of FIG. In this embodiment, the cell size recorded in the cell size calculation result history information recording step (S1305) is a determination result that the imaging lens is moving in the in-focus direction in the appropriate direction determination step (1308). If the calculation result history information is history information indicating that the cell size is decreasing, it is determined in the perspective determination step (S1309) that the graphic code is close to an appropriate distance. In this case, in the adjustment information output step (S1310), position adjustment information is output so as to move the imaging lens away.
<Effect of Embodiment 3-1>

If the graphic code reading fails because the distance between the graphic code and the imaging lens is too close to the appropriate distance, an instruction is output to the adjustment information output unit to move the imaging lens away, so the user can easily The position of the imaging lens can be adjusted.
<< Embodiment 3-2 >>
<Outline of Embodiment 3-2>

FIG. 17 shows an example of the concept of this embodiment. As shown in FIG. 17 (a), when the graphic code is read by the mobile terminal device, the distance between the graphic code printed on the paper or the like and the imaging lens is large, but the focus degree is large, but the appropriate distance. If it is at a long distance, it will be displayed on the viewfinder as shown in FIG. 17B, and the graphic code image will be small and unclear, and graphic code reading will fail. In the present embodiment, when the history information that the cell size is larger than the set minimum value and the cell size becomes larger and the history information that the degree of focusing becomes larger is acquired, the graphic code and the imaging are acquired. It is a graphic code reading device that determines that the distance of the lens is too far from an appropriate distance and outputs position adjustment information so as to bring the imaging lens closer to the user.
<Configuration of Embodiment 3-2>

  FIG. 18 shows an example of functional blocks of the present embodiment. The present embodiment is based on the third embodiment, and the perspective determination unit further includes second perspective determination means. Here, a case where the perspective determination unit has only the second perspective determination means will be described. The “graphic code reader” (1800) includes a “camera unit” (1801), a “graphic code information output unit” (1802), a “cell size calculation unit” (1803), and a “readability determination unit” ( 1804), “cell size calculation result history information holding unit” (1805), “focus degree determination unit” (1806), “focus degree determination result history information holding unit” (1807), “appropriate direction” It has a “determination unit” (1808) and an “adjustment information output unit” (1809), the appropriate direction determination unit has a “perspective determination unit” (1810), and the perspective determination unit is “second perspective determination means”. (1811). The present embodiment is not limited to the third embodiment, and may be based on the embodiment 3-1.

  "Second perspective determination means" (1811) constitutes a perspective determination unit (1810), information indicating that it is moving in the in-focus direction from the appropriate direction determination unit (1808), and cell size calculation result history information When the information that the cell size increases from the holding unit (1805) is acquired, the graphic code has a function of determining that the graphic code is at a long distance from an appropriate distance. When history information that the imaging lens is in a readable range and the cell size increases as the degree of focus increases, that is, the point X in FIG. 19 moves in the direction of the arrow. When such information is acquired, it has a function of determining that the graphic code is at a long distance with respect to an appropriate distance.

The processing of other parts is the same as in the first and second embodiments.
<Processing Flow of Embodiment 3-2>

The processing flow of the embodiment 3-2 is the same as that of FIG. 13 of the embodiment 3. In this embodiment, the cell size recorded in the cell size calculation result history information recording step (S1305) is a determination result that the imaging lens is moving in the in-focus direction in the appropriate direction determination step (1308). If the calculation result history information is history information indicating that the cell size is increasing, it is determined in the perspective determination step (S1309) that the graphic code is far from an appropriate distance. In this case, position adjustment information is output so as to bring the imaging lens closer in the adjustment information output step (S1310).
(Effect of Embodiment 4)

When the figure code reading fails because the distance between the figure code and the imaging lens is too far from the appropriate distance, an instruction is output to bring the imaging lens closer to the adjustment information output unit, so that the user can easily The position of the imaging lens can be adjusted.
<< Embodiment 3-3 >>
<Outline of Embodiment 3-3>

FIG. 20 shows an example of the concept of this embodiment. As shown in FIG. 20A, when the graphic code is read by the portable terminal device, the distance between the graphic code printed on the paper or the like and the imaging lens is far from an appropriate distance, and further focusing is performed. When the degree is also small, it is displayed on the finder as shown in FIG. 20B, and the graphic code image becomes small and unclear, and the graphic code reading fails. In the present embodiment, when the history information that the cell size is larger than the set minimum value and the cell size becomes smaller and the history information that the degree of focusing becomes smaller is acquired, the graphic code and the imaging are acquired. It is a graphic code reading device that determines that the distance to the lens is too far from an appropriate distance and outputs position adjustment information so that the imaging lens is closer to the user.
<Configuration of Embodiment 3-3>

  FIG. 21 shows an example of functional blocks of the present embodiment. The present embodiment is based on the third embodiment, and the perspective determination unit further includes a third perspective determination unit. Here, a case where the perspective determination unit has only the third perspective determination means will be described. The “graphic code reading device” (2100) of the present embodiment includes a “camera unit” (2101), a “graphic code information output unit” (2102), a “cell size calculation unit” (2103), and “readability”. “Determining unit” (2104), “Cell size calculation result history information holding unit” (2105), “Focus degree determination unit” (2106), “Focus degree determination result history information holding unit” (2107) , “Appropriate direction determination unit” (2108), “perspective determination unit” (2109), and “adjustment information output unit” (2110), and the perspective determination unit is “third perspective determination unit” (2111) Have The present embodiment is not limited to the third embodiment, and may be based on the embodiment 3-1 or 3-2.

  The “third perspective determination means” (2111) has information indicating that it has not moved in the in-focus direction from the appropriate direction determination unit (2108) and the cell size from the cell size calculation result history information holding unit (2105). When the information indicating that the size is getting smaller is acquired, the graphic code has a function of determining that the figure code is far away from an appropriate distance. When information is obtained that the imaging lens is in a readable range and the cell size is reduced as the degree of focus is reduced, that is, the point X in FIG. 22 is moving in the direction of the arrow. When the information is acquired, it has a function of determining that the graphic code is at a long distance with respect to an appropriate distance.

The processing of other parts is the same as in the first and second embodiments.
<Flow of Embodiment 3-3>

The processing flow of the embodiment 3-2 is the same as that of FIG. 13 of the embodiment 3. In the present embodiment, the cell size recorded in the cell size calculation result history information recording step (S1305) is a determination result that the imaging lens has not moved in the in-focus direction in the appropriate direction determination step (1308). If the calculation result history information is history information indicating that the cell size is decreasing, it is determined in the perspective determination step (S1309) that the graphic code is far from an appropriate distance. In this case, position adjustment information is output so as to bring the imaging lens closer in the adjustment information output step (S1310).
(Effect of Embodiment 3-3)

When the figure code reading fails because the distance between the figure code and the imaging lens is too far from the appropriate distance, an instruction is output to bring the imaging lens closer to the adjustment information output unit, so that the user can easily The position of the imaging lens can be adjusted.
<< Embodiment 3-4 >>
<Outline of Embodiment 3-4>

FIG. 23 shows an example of the concept of this embodiment. As shown in FIG. 23A, when the graphic code is read by the mobile terminal device, the distance between the graphic code printed on paper or the like and the imaging lens is close to an appropriate distance, and the degree of focus is further increased. If it is smaller, it is displayed on the finder as shown in FIG. 23B, and the graphic code image is too large and blurred, so that the graphic code reading fails. In the present embodiment, when the history information that the cell size is larger than the set minimum value and the cell size becomes larger and the history information that the degree of focusing becomes smaller is acquired, the graphic code and the imaging are acquired. It is a graphic code reading device that determines that the distance from the lens is too close to an appropriate distance and outputs position adjustment information so that the imaging lens is further away from the user. The present embodiment is not limited to the third embodiment, and may be based on any one of the embodiments 3-1 to 3-3.
<Configuration of Embodiment 3-4>

  FIG. 24 shows an example of functional blocks of the present embodiment. The present embodiment is based on any one of the third embodiment, and the perspective determination unit further includes fourth perspective determination means. Here, a case where the perspective determination unit has only the fourth perspective determination means will be described. The “graphic code reading device” (2400) of this embodiment includes a “camera unit” (2401), a “graphic code information output unit” (2402), a “cell size calculation unit” (2403), and “readability”. “Determining unit” (2404), “Cell size calculation result history information holding unit” (2405), “Focus degree determination unit” (2406), “Focus degree determination result history information holding unit” (2407) , “Appropriate direction determination unit” (2408), “perspective determination unit” (2409), and “adjustment information output unit” (2410), and the perspective determination unit further includes “fourth perspective determination unit” (2411). ).

  The “fourth perspective determination means” (2411) constitutes a perspective determination unit (2410), information indicating that it has not moved in the in-focus direction from the appropriate direction determination unit (2408), and cell size calculation result history information When the information that the cell size is increased from the holding unit (2405) is acquired, it has a function of determining that the graphic code is close to an appropriate distance. When information is acquired that the imaging lens is in a readable range and the cell size increases as the degree of focus decreases, that is, the point X in FIG. 25 moves in the direction of the arrow. When the information is acquired, it has a function of determining that the graphic code is close to an appropriate distance.

The processing of other parts is the same as in the first and second embodiments.
<Flow of Embodiment 3-4>

The processing flow of the embodiment 3-4 is the same as that in FIG. 13 of the embodiment 3. In the present embodiment, the cell size recorded in the cell size calculation result history information recording step (S1305) is a determination result that the imaging lens has not moved in the in-focus direction in the appropriate direction determination step (1307). If the calculation result history information is history information indicating that the cell size is increasing, it is determined in the perspective determination step (S1308) that the graphic code is close to an appropriate distance. In this case, in the adjustment information output step (S1309), position adjustment information is output so as to move the imaging lens away.
<Effect of Embodiment 3-4>

  If the graphic code reading fails because the distance between the graphic code and the imaging lens is too close to the appropriate distance, an instruction is output to the adjustment information output unit to move the imaging lens away, so the user can easily The position of the imaging lens can be adjusted.

  FIG. 26 summarizes the concept of each embodiment. The figure shows the distance of the imaging lens from the graphic code (bottom line), and the arrows of the lines shown in B and C indicate the history direction of the degree of focus. Moreover, the arrow which becomes thin shows the log | history that cell size becomes small, The arrow which becomes thick shows the log | history that cell size becomes large. The graphic code reader according to the first embodiment can determine whether it is in the unreadable area (A1) or in the readable area (A2, A3, A4) based on the cell size calculation result. When the graphic code reading apparatus of the second embodiment is in the readable area, it is further moved in the in-focus direction (B1) based on the in-focus degree determination result history information, or in the in-focus direction. Whether or not there is (B2) can be determined. The graphic code reading device of the third embodiment further determines whether the distance between the graphic code and the imaging lens is shorter than the in-focus area (C1, C4) or far based on the cell size calculation result history information. (C2, C3) can be determined.

  FIG. 27 shows the configuration requirements in each claim. ○ indicates required configuration requirements, and (○) indicates selected configuration requirements.

Diagram explaining the concept of figure code reading The figure explaining the concept of Embodiment 1 Functional block diagram for explaining the first embodiment Diagram explaining viewfinder pattern The figure which showed the example of the output method of position adjustment information The figure explaining the flow of processing of Embodiment 1. The figure explaining the concept of Embodiment 2. Functional block diagram for explaining the second embodiment The figure explaining the focus degree determination result history information of Embodiment 2. The figure explaining the flow of processing of Embodiment 2. The figure explaining the concept of Embodiment 3 Functional block diagram for explaining the third embodiment The figure which showed an example of the relationship between the cell size of Embodiment 3, and a focus degree The figure explaining the concept of Embodiment 3-1. Functional block diagram for explaining the embodiment 3-1. The figure which showed an example of the relationship between the cell size of Embodiment 3-1, and a focus degree The figure explaining the concept of Embodiment 3-2 Functional block diagram for explaining the embodiment 3-2 The figure which showed an example of the relationship between the cell size of Embodiment 3-2 and a focus degree The figure explaining the concept of Embodiment 3-3 Functional block diagram for explaining the embodiment 3-3 The figure which showed an example of the relationship between the cell size of Embodiment 3-3 and a focus degree The figure explaining the concept of Embodiment 3-4 Functional block diagram for explaining the embodiment 3-4 The figure which showed an example of the relationship between the cell size of Embodiment 3-4 and a focus degree Diagram summarizing the concept of the present invention Diagram summarizing the configuration requirements of the present invention

Explanation of symbols

0300 Graphic code reading device 0301 Camera unit 0302 Graphic code information output unit 0303 Cell size calculation unit 0304 Appropriate direction determination unit 0305 Adjustment information output unit

Claims (15)

A camera unit that outputs an image signal of a graphic code image input from an imaging lens;
Based on an image signal output from the camera unit, a graphic code information output unit that outputs graphic code information;
A cell size calculation unit that calculates a cell size of a cell that is a minimum structural unit of the graphic code based on the graphic code information output from the graphic code information output unit;
From the cell size calculation result calculated by the cell size calculation unit, because the calculated cell size is smaller than the minimum value, a readability determination unit that determines whether reading is possible regardless of the presence of focus,
An adjustment information output unit that outputs position adjustment information for imaging to the user based on the determination result of the readability determination unit;
A graphic code reader. An in-focus degree determining unit that determines the in-focus degree of the graphic code image output from the camera unit;
An in-focus degree determination result history information holding unit that holds in-focus degree determination result history information that is a history of changes in the in-focus degree from the determination result of the in-focus degree determination unit;
Based on the in-focus degree determination result history information held in the in-focus degree determination result history information holding unit, whether the past relative movement between the imaging lens and the figure code has been in the in-focus direction, An appropriate direction determination unit that determines whether the movement has occurred,
The graphic code reading device according to claim 1, wherein the adjustment information output unit further outputs position adjustment information for imaging to a user based on a determination result of the appropriate direction determination unit. A cell size calculation result history information holding unit for holding cell size calculation result history information which is a history of cell size change from the calculation result of the cell size calculation unit;
Based on the determination result from the appropriate direction determination unit and the cell size calculation result history information held in the cell size calculation result history information holding unit, the distance between the imaging lens and the figure code with respect to an appropriate distance A perspective determination unit for determining perspective, and
The graphic code reading device according to claim 2, wherein the adjustment information output unit further outputs position adjustment information for imaging to a user based on a determination result of the perspective determination unit. The determination result from the appropriate direction determination unit is information that the movement is in the in-focus direction,
When the cell size calculation result history information held in the cell size calculation result history information holding unit is information that the cell size becomes smaller as the cell size calculation result later in time,
The graphic code reading device according to claim 3, wherein the perspective determination unit includes first perspective determination means that determines that the graphic code is closer than an appropriate distance. The determination result from the appropriate direction determination unit is information that the movement is in the in-focus direction,
When the cell size calculation result history information held in the cell size calculation result history information holding unit is information that the cell size becomes larger as the calculation result of the cell size later in time,
The graphic code reading device according to claim 3, wherein the perspective determination unit includes a second perspective determination unit that determines that the graphic code is located at a longer distance than an appropriate distance. The determination result from the appropriate direction determination unit is information that the movement is not in the in-focus direction,
When the cell size calculation result history information held in the cell size calculation result history information holding unit is information that the cell size becomes smaller as the cell size calculation result later in time,
The graphic code reading device according to any one of claims 3 to 5, wherein the perspective determination unit includes a third perspective determination unit that determines that the graphic code is farther than an appropriate distance. The determination result from the appropriate direction determination unit is information that the movement is not in the in-focus direction,
When the cell size calculation result history information held in the cell size calculation result history information holding unit is information that the cell size becomes larger as the calculation result of the cell size later in time,
The graphic code reading device according to claim 3, wherein the perspective determination unit includes a fourth perspective determination unit that determines that the graphic code is closer than an appropriate distance.   A portable terminal device comprising the graphic code reading device according to claim 1. A graphic code image output step for outputting a graphic code image;
A graphic code information output step for outputting graphic code information based on the graphic code image output in the graphic code image output step;
A cell size calculating step for calculating a cell size based on the graphic code information output in the graphic code information output step;
From the cell size calculation result in the cell size calculation step, because the calculated cell size is smaller than the minimum value, a readability determination step for determining whether reading is possible regardless of the presence or absence of focusing;
An adjustment information output step for outputting position adjustment information for imaging to the user based on the determination result acquired in the readability determination step;
A method of operating a graphic code reader including A graphic code image output step for outputting a graphic code image;
A graphic code information output step for outputting graphic code information based on the graphic code image output in the graphic code image output step;
A cell size calculating step for calculating a cell size based on the graphic code information output in the graphic code information output step;
From the cell size calculation result in the cell size calculation step, because the calculated cell size is smaller than the minimum value, a readability determination step for determining whether reading is possible regardless of the presence or absence of focusing;
When it is determined that reading is possible in the reading permission determination step,
An in-focus degree determination step for determining the in-focus degree of the image of the graphic code based on the graphic code image output by the camera unit;
In-focus degree determination result history information recording step for recording in-focus degree determination result history information, which is a history of changes in the in-focus degree determined in the in-focus degree determination step,
Based on the in-focus degree determination result history information recorded in the in-focus degree determination result history information recording step, whether the past relative movement between the imaging lens and the figure code was in the in-focus direction, or the in-focus direction An appropriate direction determination step for determining whether the movement was
An adjustment information output step for outputting position adjustment information for imaging to the user based on the determination result acquired in the appropriate direction determination step;
A method of operating a graphic code reader including A graphic code image output step for outputting a graphic code image;
A graphic code information output step for outputting graphic code information based on the graphic code image output in the graphic code image output step;
A cell size calculating step for calculating a cell size based on the graphic code information output in the graphic code information output step;
From the cell size calculation result in the cell size calculation step, because the calculated cell size is smaller than the minimum value, a readability determination step for determining whether reading is possible regardless of the presence or absence of focusing;
When it is determined that reading is possible in the reading permission determination step,
A cell size calculation result history information recording step for recording cell size calculation result history information which is a history of changes in cell size over time calculated in the cell size calculation step;
An in-focus degree determination step for determining the in-focus degree of the image of the graphic code based on the graphic code image output by the camera unit;
A focus degree determination result history record recording step for recording focus degree determination result history information which is a history of a change in the degree of focus determined in the focus degree determination step over time;
Based on the in-focus degree determination result history information stored in the in-focus degree determination result history information recording step, whether the past relative movement between the imaging lens and the figure code was in the in-focus direction, An appropriate direction determination step for determining whether or not it was a movement;
Based on the determination result determined in the appropriate direction determination step and the cell size calculation result history information recorded in the cell size calculation result history information holding unit, an appropriate distance between the imaging lens and the graphic code is determined. A perspective determination step for determining perspective with respect to a distance;
An adjustment information output step for outputting position adjustment information for imaging to the user based on the determination result acquired in the perspective determination step;
A method of operating a graphic code reader including The determination result acquired in the appropriate direction determination step is information that the movement is in the in-focus direction,
When the cell size calculation result history information recorded in the cell size calculation result history information recording step is information that the cell size becomes smaller as the cell size calculation result later in time,
Determining that the graphic code is closer than the appropriate distance;
The operation method of the graphic code reader according to claim 11, wherein output is performed so as to move the imaging lens away from the user. The determination result acquired in the appropriate direction determination step is information that the movement is in the in-focus direction,
When the cell size calculation result history information recorded in the cell size calculation result history information recording step is information that the cell size increases as the cell size calculation result later in time,
Determining that the graphic code is at a distance greater than the appropriate distance;
The operation method of the graphic code reading device according to claim 11 or 12, wherein an image pickup lens is output so as to be close to a user. The determination result acquired in the appropriate direction determination step is information that the movement is not in the in-focus direction,
When the cell size calculation result history information recorded in the cell size calculation result history information recording step is information that the cell size becomes smaller as the cell size calculation result later in time,
Determining that the graphic code is at a distance greater than the appropriate distance;
The operation method of the graphic code reading apparatus according to claim 11, wherein the operation is performed so that the imaging lens is brought closer to the user. The determination result acquired in the appropriate direction determination step is information that the movement is not in the in-focus direction,
When the cell size calculation result history information recorded in the cell size calculation result history information recording step is information that the cell size increases as the cell size calculation result later in time,
Determining that the graphic code is closer than the appropriate distance;
The operation method of the graphic code reading device according to claim 11, wherein the operation is performed so that the imaging lens is moved away from the user.

Images