WO2015163118A1

WO2015163118A1 - Character specifying device, and control program

Info

Publication number: WO2015163118A1
Application number: PCT/JP2015/060640
Authority: WO
Inventors: 忠郎安藤; 岸本　達雄; 石川　博一; 祐一矢吹
Original assignee: シャープ株式会社
Priority date: 2014-04-22
Filing date: 2015-04-03
Publication date: 2015-10-29
Also published as: JP6170241B2; JPWO2015163118A1

Abstract

In order to quickly and accurately specify only the target characters, this character specifying device is provided with: a character recognition unit (43) which performs character recognition on an expanded region, which is an expanded version of a specified region specified by an operation; and a selected character string specification unit (44) which specifies characters having more than a prescribed degree of overlap between the aforementioned specified region and a region configured for the characters included in the expanded region obtained in the aforementioned character recognition.

Description

Character identification device and control program

The present invention relates to a character identification device for identifying a character included in a display image.

In recent years, a technique for recognizing characters (character strings) included in an image and executing processing using the recognized characters is known. As such a technique, for example, a technique for acquiring information on characters and displaying an image generated from the acquired information on an image including characters, a technique for translating the extracted characters, and outputting a translation result, etc. It has been known. In the above-described technique, it is also possible to execute the above-described process for a character selected by the user among characters included in the image.

However, in the above-described technique, when the entire image is a target for character recognition, if a large number of characters are described in the image, the target character (for example, a character string selected by the user) is recognized. There is a problem that it takes time to specify. As a solution to this problem, the following techniques have been proposed. Patent Document 1 listed below describes a technique for recognizing characters only in a character string in a region selected by a user with a one-action operation on a touch panel. Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for extracting only a character string line from the entire screen and recognizing a character string line closest to the coordinates touched by the user on the touch panel. Patent Document 3 listed below describes a technique for cutting out a character string from an image displayed in the vicinity of coordinates touched on a touch panel by a user.

Japanese Patent Publication “JP 2013-171365 A (published September 2, 2013)” Japanese Patent Gazette “Patent No. 4466241 (issued on May 26, 2010)” Japanese Patent Publication “Japanese Patent Laid-Open No. 2003-067407 (published on March 7, 2003)” Japanese Patent Gazette “Patent No. 4484454 (issued on June 16, 2010)” Japanese Patent Gazette “Japanese Patent Laid-Open No. 2010-244211 (released on October 28, 2010)”

However, the techniques of Patent Documents 1 to 3 have the following problems. In the technique of Patent Literature 1, there is a possibility that erroneous recognition occurs when the target character string does not fit within the range selection. Further, in the technique of Patent Document 2, since it is necessary to extract the entire screen, it may take time to specify a character string. Further, in the technique of Patent Document 3, there is a possibility that a character string that is not intended by the user may be cut out together, and an extra procedure may be required until the target character string is specified. That is, the techniques of Patent Documents 1 to 3 have a problem that it is not sufficient to accurately specify only the characters intended by the user in a short time. When a device such as a smartphone displays an image (so-called through image) input from a camera to take a picture and performs character recognition on the through image, each time the user moves the device Since the characters displayed on the display section change, the problems of Patent Documents 1 to 3 are particularly remarkable.

The present invention has been made in view of the above-described problems, and an object of the present invention is to realize a character identification device or the like that can accurately identify only a target character in a short time.

In order to solve the above-described problem, a character identification device according to an aspect of the present invention is a character identification device for identifying a character included in a display image, and is specified by a user operation on the display image. A character recognition execution unit that performs character recognition on an enlarged region obtained by enlarging a specific region in the display image, and a region that is set as a character included in the enlarged region obtained by character recognition by the character recognition execution unit, A selected character specifying unit that specifies, as a character selected by the user, a character whose degree of overlap with the specific region exceeds a predetermined amount.

According to one aspect of the present invention, there is an effect that only a target character can be accurately specified in a short time.

FIG. 3 is a block diagram showing an example of a main part configuration of a smartphone according to Embodiments 1 to 3 of the present invention. It is a figure which shows an example of the outline | summary of the character string extraction which the smart phone of FIG. 1 performs. It is a figure which shows specification of the total touch area | region which the smart phone of FIG. 1 performs. It is a figure which shows specification of the character recognition area which the smart phone of FIG. 1 performs. (A) is a figure which shows specification of the extraction line which the smart phone of FIG. 1 performs, (b) is a figure which shows specification of the selection character. It is a flowchart which shows an example of the flow of the character string specific process which the smart phone of FIG. 1 performs. It is a flowchart which shows an example of the flow of a process after the connector A of FIG. It is a flowchart which shows an example of the flow of the character determination process shown in FIG. It is a flowchart which shows an example of the flow of a process after the connector B of FIG. It is a flowchart which shows an example of the flow of the character determination process shown in FIG.

First, the outline of the first to third embodiments described below will be described with reference to FIG. First, as illustrated in FIG. 2A, the smartphone 1 specifies a total touch area 11 that is an area specified by an input operation from an image 10 (hereinafter, referred to as a character string image 10). In FIG. 2, only a part of the character string image 10 is shown for convenience of explanation. Next, the smartphone 1 specifies a character recognition area 12 in which the total touch area 11 is enlarged as shown in FIG. The smartphone 1 performs character recognition for the character recognition area 12. The character recognition target may be a single character or a character string composed of a plurality of characters. Hereinafter, the character string will be described as an example of character recognition. Subsequently, as illustrated in FIG. 2C, the smartphone 1 specifies an extracted line area that is an area of a line included in the character recognition area 12. In the case of the example in FIG. 2C, the smartphone 1 specifies the extraction line area 13, the extraction line area 14, and the extraction line area 15. And the smart phone 1 specifies the selected character string according to the overlapping degree of each extraction line area | region and the total touch area | region 11. FIG. In the case of FIG. 2, the smartphone 1 specifies the selected character string 16 as illustrated in FIG.

As described above, since the smartphone 1 performs character recognition not on the entire image but on an enlarged area obtained by enlarging a specific area, the smartphone 1 can execute character recognition in a short time. In addition, since the character string whose degree of overlap between the specific region and the region set in the character string included in the enlarged region obtained by character recognition exceeds a predetermined amount is specified, the selected character string can be specified with high accuracy. Can do.

Hereinafter, Embodiments 1 to 3 will be described in detail. In the following embodiments, the smartphone 1 will be described as an example, but the present invention can be applied to any character identification device for identifying characters included in a display image.

Embodiment 1
An embodiment of the present invention will be described below with reference to FIGS. 1 and 3 to 8. First, with reference to FIG. 1, the principal part structure of the smart phone 1 (character identification device) is demonstrated. The smartphone 1 includes at least a touch panel 2, a photographing unit 3, a control unit 4, a storage unit 5, and a communication unit 6.

The touch panel 2 includes an input unit 21 and a display unit 22. The input unit 21 is an input device that accepts an input operation by a user. The touch panel 2 described in the present embodiment is rectangular, and an XY plane coordinate system having the origin at the upper left vertex of the coordinate detection area of the touch panel 2 is set on the touch panel 2 as described later. The input unit 21 detects a touch surface that accepts contact (including approach) of an indicator (such as a finger or a pen), presence or absence of contact between the indicator and the touch surface, and a contact position (coordinates). The touch sensor. The touch sensor may be realized by any sensor as long as it can detect the presence or absence of contact between the indicator and the touch surface. The input unit 21 outputs the detected coordinates and the like to the input specifying unit 41 described later. The display unit 22 is a display device that displays information processed by the smartphone 1 as an image in a display area, and is, for example, an LCD (liquid crystal display). Specifically, the display unit 22 displays information processed by a display control unit 46 described later. An example of the image displayed on the display unit 22 is the character string image 10.

The photographing unit 3 is a photographing device for photographing an object and is a so-called camera. As the imaging unit 3, an existing camera that is generally mounted on a smartphone can be used. The imaging unit 3 is controlled by an image acquisition unit 47 to be described later, and images an object. In addition, the photographing unit 3 outputs the photographed still image or video to the image acquisition unit 47.

The control unit 4 performs overall control of each unit included in the smartphone 1. The control unit 4 includes an input specifying unit 41, an extraction region specifying unit 42, a character recognizing unit 43 (character recognition executing unit), a selected character string specifying unit 44 (selected character specifying unit), a process executing unit 45, a display control unit 46, And the image acquisition part 47 is included.

The input specifying unit 41 specifies an input operation accepted by the input unit 21. Specifically, the input specifying unit 41 performs the input operation based on the coordinates in the input operation, the time that the indicator is in contact with the input surface, the moving direction of the indicator in contact with the input surface, and the like. Identify. Examples of the type of input operation include single tap, flick, and drag, but are not limited thereto. For example, the input specifying unit 41 performs a single tap operation, a drag operation, or a flick operation of the user with respect to the character string in the character string image in a state where an image including the character string (character string image 10) is displayed on the display unit 22. And the coordinates of the operation are supplied to the extraction region specifying unit 42. In addition, the input specifying unit 41 specifies an operation for performing shooting (for example, a single tap operation for a UI component displayed on the display unit 22), and instructs the image acquisition unit 47 to perform shooting. Supply.

The extraction area specifying unit 42 specifies an enlarged area that is an area obtained by enlarging the area specified by the input operation (specific area). The identification of the enlarged region will be described with reference to FIGS. Note that the origin of the coordinates shown in FIG. 3 corresponds to the upper left vertex of the coordinate detection area, which is an area where the touch sensor of the input unit 21 can detect the coordinates. In the present embodiment, the coordinate detection area is described as a rectangular area, but the present invention is not limited to this example.

First, the extraction area specifying unit 42 specifies the total touch area 11 (specific area) that is an area selected by an input operation performed on the touch panel 2. FIG. 3A is a diagram illustrating identification of the total touch area when the user performs a single tap operation on the touch panel 2. That is, in the example of FIG. 3A, the user touches the indicator S (user's finger) to the touch panel 2 and then moves the indicator S away from the touch panel without moving it. When the coordinate C1 with which the indicator S is touched is supplied from the input specifying unit 41, the extraction region specifying unit 42 selects a touch region M1 that is a square region with one side length L around the coordinate C1. Identify. Here, when the user removes the indicator from the touch panel, the touch area M1 becomes the total touch area. In addition, the length L of one side should just be set suitably, for example, the length L of one side may be about 1.0 cm. This is the size of the average index finger tip (fingertip) of an adult male. When the user selects a character string using his / her index finger as the indicator S, the size of the fingertip is the same as the character size. It is assumed that a character string is selected to the extent. Further, the length L of one side may be changed according to the type of input operation or the strength of pressing.

On the other hand, FIG. 3B is a diagram showing identification of the total touch area when the user performs a drag operation or a flick operation on the touch panel 2. That is, in the example of FIG. 3B, the user moves the indicator S away from the touch panel 2 after bringing the indicator S into contact with the touch panel 2. The extraction area specifying unit 42 is the coordinates of the position of the touch panel 2 touched by the indicator S from the input specifying unit 41, that is, in the example of FIG. 3B, the coordinates C1, the coordinates C2, the coordinates C3, and the coordinates When C4 is supplied, a touch area that is a square area having a side of L around each coordinate is specified. That is, in the example of FIG. 3B, the touch area M1, the touch area M2, the touch area M3, and the touch area M4 are specified. Then, the extraction area specifying unit 42 specifies the minimum value and the maximum value of the X coordinate and the minimum value and the maximum value of the Y coordinate from the vertex coordinates of each specified touch area. Then, the extraction area specifying unit 42 includes coordinates (x _min , y _min ) that are the minimum value of the specified X coordinate and the minimum value of the Y coordinate, and coordinates that are the maximum value of the specified X coordinate and the maximum value of the Y coordinate. A rectangular area (total touch area 11) in which a line segment connecting (x _max , y _max ) is a diagonal line is specified. That is, the coordinates (x _min , y _min ) and the coordinates (x _max , y _max ) are the vertices of the total touch area 11.

Subsequently, the extraction area specifying unit 42 specifies the character recognition area 12 (enlarged area). Specifically, as illustrated in FIG. 4, the extraction area specifying unit 42 enlarges the total touch area 11 based on a predetermined condition, and specifies the enlarged area as the character recognition area 12. Here, an example of the predetermined condition will be described. The example shown below is an example when the character string included in the character string image 10 is horizontally written. The extraction area specifying unit 42 specifies the coordinate X _min of the 1L position from the side connecting the two vertices having the X coordinate x _min in the total touch area 11 (the left side of the total touch area 11) to the negative direction side of the X coordinate. To do. Further, in the total touch area 11, the coordinate X _max at a position of 1 L is specified on the positive direction side of the X coordinate from the side connecting the two vertices whose X coordinate is x _max (the right side of the total touch area 11). Furthermore, the coordinate Y _min of the position of 2L is specified on the negative direction side of the Y coordinate from the side connecting the two vertices having the Y coordinate y _min in the total touch region 11 (upper side of the total touch region 11). Finally, a coordinate Y _max at a position of 2L is specified on the positive direction side of the Y coordinate from the side connecting the two vertices having the Y coordinate y _max in the total touch region 11 (the lower side of the total touch region 11). Then, the extraction area specifying unit 42 specifies the character recognition area 12 that is a rectangular area in which a line segment connecting the coordinates (X _min , Y _min ) and the coordinates (X _max , Y _max ) is a diagonal line. That is, the coordinates (X _min , Y _min ) and the coordinates (X _max , Y _max ) are the vertices of the character recognition area 12.

In other words, the extraction area specifying unit 42 specifies, as the character recognition area 12, an area in which the total touch area 11 is expanded by 2 L in the vertical direction and 1 L in the left-right direction. Here, when the character string image 10 is an image obtained by photographing a newspaper or a magazine, the large character is often about two to three times the small character. That is, when the character string is written horizontally, after the user changes the magnification of the character string image 10 in order to adjust the size of the small character to the size of his / her fingertip, the input operation is performed on the large character without changing the magnification. Even if it is done, it is necessary to set the vertical width so that the entire large character is included in the character recognition area. Therefore, in the above-described example, the total touch area 11 is expanded by 2L in the vertical direction. In addition, when a word in the character string image 10 is desired to be selected, the indicator may come into contact with a character adjacent to the word. In this case, there is a possibility that the entire character of the character next to the word is not selected, and the entire character adjacent to the word may not be the target of character recognition unless the left and right widths of the total touch area 11 are widened. . That is, the extraction area specifying unit 42 increases the left and right widths by 1 L in order to accurately recognize the selected character. Note that the predetermined condition, that is, how to enlarge the total touch area 11 is not limited to the above-described example. In addition, the extraction region specifying unit 42 supplies the coordinate information of the specified character recognition region 12 to the character recognition unit 43. Further, the extraction area specifying unit 42 supplies the coordinate information of the specified total touch area 11 to the selected character string specifying unit 44.

The character recognition unit 43 performs a character recognition process on an image including a character string. Specifically, when the character recognition unit 43 is supplied with the coordinate information of the character recognition region 12, the character recognition unit 43 converts the character string in the region of the character recognition region 12 in the character string image 10 supplied from the image acquisition unit 47 into line units. Extract with Here, as an extraction method of a character string, since an existing optical character recognition technique can be used, detailed description thereof is omitted. The character recognizing unit 43 selects the extracted character string in line units (hereinafter referred to as “extracted line”) and coordinate information of the minimum rectangular area (hereinafter referred to as “extracted line area”) including the entire extracted line. This is supplied to the column specifying unit 44.

The selected character string specifying unit 44 is a character string in which the overlapping degree between the area set in the character string included in the character recognition area 12 and the total touch area 11 obtained by character recognition by the character recognition section 43 exceeds a predetermined amount. Is specified. The identification of this character string will be described with reference to FIG. First, when the selected character string specifying unit 44 is supplied with coordinate information of an extracted line and an extracted line area from the character recognition unit 43, the selected character string specifying unit 44 determines whether the extracted line is vertical writing or horizontal writing. In the example illustrated in FIG. 5, a case where it is determined that the extracted line is horizontal writing will be described. Subsequently, the selected character string specifying unit 44 includes, from the extracted lines extracted from the character recognition area 12, an extracted line in which the degree of overlap between the line area and the specific area exceeds the first predetermined amount, that is, included in the extracted line. A character string specifying line, which is an extraction line whose character string is to be specified, is specified. Specifically, first, the selected character string specifying unit 44 specifies, as a determination line, an extracted line having the smallest Y coordinate of predetermined coordinates (for example, the coordinates of the upper left vertex of the extracted line area) in the extracted line area among the extracted lines. . That is, the selected character string specifying unit 44 specifies the extracted line having the extracted line area 13 (the extracted line at the top of the extracted lines) as the determination line among the extracted lines shown in FIG. Then, the selected character string specifying unit 44 compares the coordinate information of the extracted line area of the determination line with the coordinate information of the total touch area 11 supplied from the extraction area specifying unit 42, and extracts the extracted line area and the total touch area 11. It is determined whether or not. As shown in FIG. 5A, the extracted row area 13 and the total touch area 11 do not overlap. In this case, the selected character string specifying unit 44 does not specify the extracted line having the extracted line region 13 as the character string specifying line.

Subsequently, the selected character string specifying unit 44 specifies an extracted line having an extracted line area 14 that is an extracted line having the next smallest Y coordinate of the predetermined coordinates as a determination line. Then, the selected character string specifying unit 44 determines whether or not the extracted line area 14 and the total touch area 11 overlap. As shown in FIG. 5A, the extracted row area 14 and the total touch area 11 overlap each other. In this case, the selected character string specifying unit 44 determines whether either the upper side or the lower side of the total touch area 11 is included in the extracted line area 14. In other words, the selected character string specifying unit 44 determines whether one of the two sides parallel to the character string traveling direction of the boundary line of the total touch area 11 overlaps the extracted line area 14. . Specifically, the selected character string specifying unit 44 determines that the minimum value of the Y coordinate and the maximum value of the Y coordinate in the total touch area 11 are based on the minimum value of the Y coordinate and the maximum value of the Y coordinate in the extracted line area. It is determined whether it is included in the Y coordinate numerical value range. In the case of FIG. 5A, the minimum value of the Y coordinate in the total touch area 11 is included in the Y coordinate numerical value range in the extraction line area 14. In this case, the selected character string specifying unit 44 specifies a line overlapping area that is an area where the extracted line area and the total touch area 11 overlap. Then, a value obtained by subtracting the minimum value of the Y coordinate from the maximum value of the Y coordinate in the row overlap region (that is, the height value of the row overlap region) is the minimum value of the Y coordinate from the maximum value of the Y coordinate in the extracted row region 14. It is determined whether or not the length is a predetermined ratio or more (for example, a length of half or more) with respect to the value obtained by subtracting the value (that is, the height value of the extracted row area 14). As shown in (a) of FIG. 5, the height value of the row overlapping region is half or more of the height value of the extracted row region 14. In this case, the selected character string specifying unit 44 specifies an extracted line having the extracted line area 14 as a character string specifying line. Note that the extracted row area 15 overlaps the total touch area 11, and the maximum value of the Y coordinate in the total touch area 11 is included in the Y coordinate numerical value range. However, since the height value of the line overlap area does not become more than half of the height value of the extracted line area, the selected character string specifying unit 44 does not specify the extracted line having the extracted line area 15 as the character string specifying line. .

Next, when the selected character string specifying unit 44 specifies the character string specifying line, the character whose overlapping degree between the character area and the specific area exceeds the second predetermined amount from the characters included in the character string specifying line, that is, The selected character selected by the input operation is specified. Specifically, first, the selected character string specifying unit 44, for each character included in the character string specifying line (extracted line 14 in the case of FIG. 5), includes a minimum rectangular area (hereinafter referred to as a character) including the entire character. (Referred to as a region).

Subsequently, the selected character string specifying unit 44 uses, as a determination character, a character having the smallest X coordinate of a predetermined coordinate in the character area (for example, the coordinate of the upper left vertex of the character area) among the characters included in the character string specifying line. Identify. That is, the selected character string specifying unit 44 specifies the character having the character region 31 (the leftmost character in the character string specifying line) among the characters shown in FIG. Then, the selected character string specifying unit 44 compares the coordinate information of the character area of the determination character with the coordinate information of the total touch area 11 and determines whether or not the character area and the total touch area 11 overlap. As shown in FIG. 5B, the character area 31 and the total touch area 11 overlap each other. In this case, the selected character string specifying unit 44 determines whether either the left side or the right side of the total touch area 11 is included in the character area. In other words, the selected character string specifying unit 44 determines whether any one of the two sides perpendicular to the character string traveling direction of the boundary line of the total touch area 11 overlaps the character area. Specifically, in the selected character string specifying unit 44, the minimum value of the X coordinate and the maximum value of the X coordinate in the total touch area 11 include the minimum value of the X coordinate and the maximum value of the X coordinate in the character area. It is determined whether it is included in the X coordinate numerical range. In the case of FIG. 5B, the minimum value of the X coordinate in the total touch area 11 is included in the X coordinate numerical value range in the character area 31. In this case, the selected character string specifying unit 44 specifies a character superimposed region that is a region where the character region and the total touch region 11 overlap. Then, a value obtained by subtracting the minimum value of the X coordinate from the maximum value of the X coordinate in the character superimposed region (that is, the value of the width of the character superimposed region) is calculated as the minimum value of the X coordinate from the maximum value of the X coordinate in the character region 31. It is determined whether or not the length is a predetermined ratio or more (for example, a length of half or more) with respect to the subtracted value (that is, the width value of the character area 31). As shown in FIG. 5B, the value of the width of the character superimposed region is half or more than the value of the width of the character region 31. In this case, the selected character string specifying unit 44 specifies the character having the character area 31 as the selected character, and stores the selected character and the coordinate information of the selected character in the selected character storage unit 51 described later.

Subsequently, the selected character string specifying unit 44 specifies a character having the character region 32 in which the X coordinate of the predetermined coordinate is the next smallest character as a determination character. Then, the same processing as in the above example is performed. In the case of a character having the character region 32, the character region 31 and the total touch region 11 overlap. The left side or the right side of the total touch area 11 is not included in the character area 32. In this case, the selected character string specifying unit 44 specifies the character having the character region 32 as the selected character, and stores the selected character and the coordinate information of the selected character in the selected character storage unit 51 described later. The selected character string specifying unit 44 also specifies the character having the character area 33 as the selected character. Subsequently, in the character having the character area 34, the character area 34 and the total touch area 11 overlap each other. The maximum value of the X coordinate in the total touch area 11 is included in the X coordinate numerical value range in the character area 34. Furthermore, the value of the width of the character superimposed area is half or more than the value of the width of the character area 34. Therefore, the selected character string specifying unit 44 specifies a character having the character region 34 as a selected character, and stores the selected character and the coordinate information of the character region of the selected character in the selected character storage unit 51 described later. On the other hand, in the character having the character area 35, the character area 35 and the total touch area 11 do not overlap. In this case, the selected character string specifying unit 44 does not specify the extracted line having the character area 35 as the character string specifying line.

Finally, when the selected character string specifying unit 44 specifies the selected character in all the character string specifying lines, the selected character string and the coordinate information of the selected character stored in the selected character storage unit 51 are read out, and the character area of the selected character is read. Based on the coordinate information, the selected characters are arranged to specify the character string. Then, the specified character string is supplied to the process execution unit 45.

The process execution unit 45 executes a predetermined process based on the specified character string. Specifically, when the character string is supplied from the selected character string specifying unit 44, the process executing unit 45 acquires information related to the character string via the communication unit 6 described later. As an example of the information to be acquired, a search result obtained by searching the character string by a search engine, an image or a video related to the character string, and the like can be given. And the process execution part 45 produces the link image containing the link for accessing the acquired information using the acquired information. For example, an image indicating a search result of the character string, a thumbnail image of a video related to the character string, a reduced image of an image related to the character string, and the like are created as a link image. In addition, what is created using the information acquired by the process execution unit 45 is not limited to a link image, and may be a character string including a link, for example. Then, the process execution unit 45 supplies the created link image to the display control unit 46. In addition, the process which the process execution part 45 performs is not limited to the example mentioned above. That is, the process executed by the process execution unit 45 may be a process that is executed based on the supplied character string, and may be, for example, a process that translates the supplied character string into English.

The display control unit 46 determines an image to be displayed on the display unit 22. Specifically, when the character string image 10 is supplied from the image acquisition unit 47, the display control unit 46 displays the supplied character string image 10 on the display unit 22. Further, when the display control unit 46 acquires the link image from the processing execution unit 45, the display control unit 46 superimposes the link image on the character string image 10 and displays it on the display unit 22.

The image acquisition unit 47 operates the photographing unit 3 to acquire the character string image 10. Specifically, when an image capturing instruction is supplied from the input specifying unit 41, the image acquiring unit 47 causes the image capturing unit 3 to capture an image. Then, an image (character string image 10) captured by the imaging unit 3 is acquired, and the acquired character string image 10 is supplied to the character recognition unit 43 and the display control unit 46. In addition, although the image acquisition part 47 in this embodiment is a structure which acquires the image image | photographed by the imaging | photography part 3, it is not limited to this example. For example, the image acquisition unit 47 may read the character string image 10 stored in the storage unit 5 in response to an instruction from the input specifying unit 41 or acquire the character string image 10 via the communication unit 6. May be. Further, the image to be acquired may be a moving image or a so-called through image displayed on the display unit 22 in order to take a picture with the photographing unit 3.

The storage unit 5 is a storage device that stores various data used in the smartphone 1. As shown in FIG. 1, the storage unit 5 includes a selected character storage unit 51. The selected character storage unit 51 temporarily stores the selected character identified by the selected character string specifying unit 44 in association with the selected character and the coordinate information of the selected character.

The communication unit 6 is a communication device for transmitting and receiving information between the smartphone 1 and an external device. Specifically, the communication unit 6 is controlled by the processing execution unit 45 and acquires information related to the character string specified by the selected character string specifying unit 44 from the outside.

Next, the flow of the character string specifying process for specifying the character string selected by the input operation will be described with reference to FIGS. FIG. 6 describes the flow of processing after the character string image 10 is displayed on the display unit 22.

First, when the input specifying unit 41 specifies an input operation input to the input unit 21 (YES in S1), the input specifying unit 41 determines the coordinates of the specified input operation, that is, the touch panel 2 that the indicator S touches. Are supplied to the extraction area specifying unit 42. Subsequently, the extraction area specifying unit 42 specifies the total touch area 11 (S2). Since specific examples have been described above, they will be omitted. Subsequently, the extraction area specifying unit 42 specifies the character recognition area 12 (S3). Specifically, the extraction area specifying unit 42 enlarges the total touch area 11 based on a predetermined condition, and specifies the enlarged area as the character recognition area 12. In addition, since the specific example of a predetermined condition has been mentioned above, description here is abbreviate | omitted. The extraction region specifying unit 42 supplies the coordinate information of the specified character recognition region 12 to the character recognition unit 43. Further, the extraction area specifying unit 42 supplies the coordinate information of the specified total touch area 11 to the selected character string specifying unit 44. Subsequently, the character recognition unit 43 executes character recognition processing of the character recognition area 12 (S4). Specifically, when the character recognition unit 43 is supplied with the coordinate information of the character recognition region 12, the character recognition unit 43 executes the character string in the region of the character recognition region 12 in the character string image 10 supplied from the image acquisition unit 47. Extract by units (extract extracted rows). Then, the character recognizing unit 43 supplies the extracted extracted line and the coordinate information of the extracted line area, which is the smallest rectangular area including the entire extracted line, to the selected character string specifying unit 44.

Subsequently, the selected character string specifying unit 44 determines whether or not the supplied extracted line is horizontal writing (S5). Note that the processing flow in the case of vertical writing (NO in S5) will be described in the second embodiment to be described later. In the case of horizontal writing (YES in S5), the selected character string specifying unit 44 selects the uppermost line in the character recognition area 12 as a determination line (S11). Subsequently, the selected character string specifying unit 44 determines whether or not the determination line area and the total touch area 11 overlap each other (S12). Here, the determined line area is an extracted line area of the extracted line identified as the determined line. If they do not overlap (NO in S12), the selected character string specifying unit 44 determines whether or not the current determination line is the last line in the character recognition area 12 (S16). Specifically, the selected character string specifying unit 44 determines that the current determination line is the extracted line having the largest Y coordinate of predetermined coordinates (for example, the coordinates of the upper left vertex of the extracted line area) in the extracted line area among the extracted lines. It is determined whether or not. If the current determination line is not the last line (NO in S16), the selected character string specifying unit 44 sets the line immediately below the current determination line as the determination line (S17). Specifically, the selected character string specifying unit 44 determines the extracted line whose Y coordinate of the predetermined coordinate in the extracted line area is the next smaller than the Y coordinate of the predetermined coordinate in the current determined line as the next determined line. And And the selection character string specific | specification part 44 returns to the process of step S12. The case where the current determination line is the last line will be described later.

On the other hand, when the determination line area and the total touch area 11 overlap (YES in S12), the selected character string specifying unit 44 determines that only one of the upper side and the lower side of the total touch area 11 is the determination line area. It is determined whether it is within (S13). Since the specific example of the determination has been described above, the description is omitted. When only one of the upper side and the lower side is in the determination line area (YES in S13), the selected character string specifying unit 44 determines whether or not the height of the line overlap area is half or more of the height of the determination line area. Is determined (S14). Since the specific example of the determination has been described above, the description is omitted. If it is not half or more (NO in S14), the selected character string specifying unit 44 determines whether or not the current determination line is the last line in the character recognition area 12 (S16). Since the subsequent processing has already been described, the description thereof is omitted here.

On the other hand, when the height of the line superimposition area is not less than half the height of the determination line area (YES in S14), the selected character string specifying unit 44 specifies the determination line as a character string specifying line. Then, the character determination process is executed (S15). If only one of the upper side or the lower side of the total touch area 11 is not in the determination line area (NO in S13), the selected character string specifying unit 44 omits the process in step S14 and sets the determination line as a character. Identifies a column specific row. Then, a character determination process is executed (S15).

Next, the character determination process will be described. The selected character string specifying unit 44 specifies the coordinate information of the character area for each character included in the character string specifying line. Subsequently, the selected character string specifying unit 44 selects the leftmost character in the character string specifying line as a determination character (S21). Subsequently, the selected character string specifying unit 44 determines whether or not the determination character area and the total touch area 11 overlap (S22). Here, the determination character area is a character area of the character specified as the determination character. If they do not overlap (NO in S22), the selected character string specifying unit 44 determines whether or not the current determination character is the last character in the character string specifying line (S26). Specifically, the selected character string specifying unit 44 determines that the current determination character is the X coordinate of a predetermined coordinate in the character area (for example, the coordinate of the upper left vertex of the character area) among the characters in the character string specifying line. Determine whether the character is large. If the current determination character is not the final character (NO in S26), the selected character string specifying unit 44 sets the character to the right of the current determination character as the determination character (S27). Specifically, the selected character string specifying unit 44 sets a character whose X coordinate of the predetermined coordinate in the character area is the next smaller than the X coordinate of the predetermined coordinate in the determination character area of the current determination character as the next determination character. . Then, the selected character string specifying unit 44 returns to the process of step S22. The case where the current determination character is the final character will be described later.

On the other hand, when the determination character area and the total touch area 11 overlap (YES in S22), the selected character string specifying unit 44 determines that only one of the left side and the right side of the total touch area 11 is the determination character area. It is determined whether it is within (S23). Since the specific example of the determination has been described above, the description is omitted. When only one of the left side and the right side is in the determination character area (YES in S23), the selected character string specifying unit 44 determines whether or not the width of the character superimposed area is half or more of the width of the determination character area. Determine (S24). Since the specific example of the determination has been described above, the description is omitted. If it is not half or more (NO in S24), the selected character string specifying unit 44 determines whether or not the current determination character is the last character in the character string specifying line (S26). Since the subsequent processing has already been described, the description thereof is omitted here.

On the other hand, when the width of the character superimposed area is half or more than the width of the determination character area (YES in S24), the selected character string specifying unit 44 specifies the determination character as the selected character and selects the selected character. Characters are stored in the selected character storage unit 51 (S25). If only one of the left side or the right side of the total touch area 11 is not in the determination character area (NO in S23), the selected character string specifying unit 44 selects the determination character by omitting the process of step S24. Identifies it as a character. Then, the selected character is stored in the selected character storage unit 51 (S25).

Subsequently, the selected character string specifying unit 44 determines whether or not the current determination character is the last character in the character string specifying line (S26). When it determines with it being the last character (it is YES at S26), the selection character string specific | specification part 44 determines whether the present determination line is the last line in the character recognition area | region 12 (S16). When it determines with it being the last line (it is YES at S16), the selection character string specific | specification part 44 specifies the selected character string (S18). Then, the specified character string is supplied to the process execution unit 45. This completes the character string specifying process.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIG. 6, FIG. 9, and FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted. In the present embodiment, the flow of the character string specifying process when the selected character string specifying unit 44 determines that the extracted line supplied from the character recognition unit 43 is vertically written will be described. Note that detailed description of processes common to the flow of the character string specifying process described in the first embodiment is omitted.

When the supplied extracted line is vertically written (NO in S5), the selected character string specifying unit 44 selects the rightmost line in the character recognition area 12 as a determination line (S31). Specifically, the selected character string specifying unit 44 specifies an extracted line having the largest X coordinate of a predetermined coordinate in the extracted line area (for example, the coordinate of the upper left vertex of the extracted line area) among the extracted lines as a determination line. Subsequently, the selected character string specifying unit 44 determines whether or not the determination line area and the total touch area 11 overlap (S32). If they do not overlap (NO in S32), the selected character string specifying unit 44 determines whether or not the current determination line is the last line in the character recognition area 12 (S36). Specifically, the selected character string specifying unit 44 determines that the current determination line is the extracted line having the smallest X coordinate of predetermined coordinates (for example, the coordinates of the upper left vertex of the extracted line area) in the extracted line area among the extracted lines. It is determined whether or not. If the current determination line is not the last line (NO in S36), the selected character string specifying unit 44 sets the line one left of the current determination line as the determination line (S37). Specifically, the selected character string specifying unit 44 determines an extracted line whose X coordinate of a predetermined coordinate in the extracted line area is next to the X coordinate of the predetermined coordinate in the determined line area of the current determined line as the next determined line. And And the selection character string specific | specification part 44 returns to the process of step S12. The case where the current determination line is the last line will be described later.

On the other hand, when the determination line area and the total touch area 11 overlap (YES in S32), the selected character string specifying unit 44 has only one of the left side or the right side of the total touch area 11 in the determination line area. It is determined whether or not (S33). Specifically, in the selected character string specifying unit 44, the minimum value of the X coordinate and the maximum value of the X coordinate in the total touch area 11 include the minimum value of the X coordinate and the maximum value of the X coordinate in the determination line area. It is determined whether it is included in the X coordinate numerical range. When only one of the left side and the right side is in the determination line area (YES in S33), the selected character string specifying unit 44 determines whether or not the width of the line overlap area is equal to or greater than half the width of the determination line area. (S34). Specifically, the selected character string specifying unit 44 calculates a value obtained by subtracting the minimum value of the X coordinate from the maximum value of the X coordinate in the line superimposition area (that is, the value of the width of the line superimposition area). It is determined whether or not it is half or more of a value obtained by subtracting the minimum value of the X coordinate from the maximum value of the coordinate (that is, the value of the width of the determined row area). If it is not half or more (NO in S34), the selected character string specifying unit 44 determines whether or not the current determination line is the last line in the character recognition area 12 (S36). Since the subsequent processing has already been described, the description thereof is omitted here. It should be noted that the value of more than half is an example, and the determination threshold is not limited to this example.

On the other hand, when the width of the line overlap area is half or more of the width of the determination line area (YES in S34), the selected character string specifying unit 44 specifies the determination line as a character string specifying line, Character determination processing is executed (S15). When only one of the left side or the right side of the total touch area 11 is not in the determination line area (NO in S33), the selected character string specifying unit 44 omits the process in step S34 and sets the determination line as a character. Identifies a column specific row. Then, a character determination process is executed (S35).

Next, the character determination process will be described. The selected character string specifying unit 44 specifies the coordinate information of the character area for each character included in the character string specifying line. Subsequently, the selected character string specifying unit 44 selects the uppermost character in the character string specifying line as a determination character (S41). Specifically, the selected character string specifying unit 44 determines a character having the smallest Y coordinate of a predetermined coordinate in the character area (for example, the coordinate of the upper left vertex of the character area) among the characters included in the character string specifying line. Identifies as a character. Subsequently, the selected character string specifying unit 44 determines whether or not the determination character area and the total touch area 11 overlap (S42). If they do not overlap (NO in S42), the selected character string specifying unit 44 determines whether or not the current determination character is the last character in the character string specifying line (S46). Specifically, the selected character string specifying unit 44 determines that the current determination character is the Y coordinate of the predetermined coordinate in the character area (for example, the coordinate of the upper left vertex of the character area) among the characters in the character string specifying line. Determine whether the character is large. If the current determination character is not the final character (NO in S46), the selected character string specifying unit 44 sets the character immediately below the current determination character as the determination character (S47). Specifically, the selected character string specifying unit 44 sets a character whose Y coordinate of a predetermined coordinate in the character area is the next smaller than the Y coordinate of the predetermined coordinate in the determination character area of the current determination character as the next determination character. . Then, the selected character string specifying unit 44 returns to the process of step S42. The case where the current determination character is the final character will be described later.

On the other hand, when the determination character area and the total touch area 11 overlap (YES in S42), the selected character string specifying unit 44 determines that only one of the upper side and the lower side of the total touch area 11 is the determination character area. It is determined whether it is within (S43). Specifically, the selected character string specifying unit 44 determines that the minimum value of the Y coordinate and the maximum value of the Y coordinate in the total touch area 11 are based on the minimum value of the Y coordinate and the maximum value of the Y coordinate in the determination character area. It is determined whether it is included in the Y coordinate numerical value range. When only one of the upper side and the lower side is in the determination character area (YES in S43), the selected character string specifying unit 44 determines whether or not the height of the character superimposed area is half or more of the height of the determination character area. Is determined (S44). Specifically, the selected character string specifying unit 44 calculates a value obtained by subtracting the minimum value of the Y coordinate from the maximum value of the Y coordinate in the character superimposed region (that is, the height value of the character superimposed region) in the determination character region. It is determined whether or not it is half or more of a value obtained by subtracting the minimum value of the Y coordinate from the maximum value of the Y coordinate (that is, the height value of the determination character area). If it is not half or more (NO in S44), the selected character string specifying unit 44 determines whether or not the current determination character is the last character in the character string specifying line (S46). Since the subsequent processing has already been described, the description thereof is omitted here. It should be noted that the value of more than half is an example, and the determination threshold is not limited to this example.

On the other hand, when the width of the character superimposed region is half or more of the height of the determination character region (YES in S44), the selected character string specifying unit 44 specifies the determination character as the selected character, and The selected character is stored in the selected character storage unit 51 (S45). If only one of the upper side or the lower side of the total touch area 11 is not in the determination character area (NO in S43), the selected character string specifying unit 44 omits the process of step S44 and selects the determination character Identifies it as a character. Then, the selected character is stored in the selected character storage unit 51 (S45).

Subsequently, the selected character string specifying unit 44 determines whether or not the current determination character is the last character in the character string specifying line (S46). When it determines with it being the last character (it is YES at S46), the selection character string specific | specification part 44 determines whether the present determination line is the last line in the character recognition area | region 12 (S36). When it determines with it being the last line (it is YES at S36), the selection character string specific | specification part 44 specifies the selected character string (S38). This completes the character string specifying process.

[Embodiment 3]
The control blocks of the smartphone 1 (in particular, the input specifying unit 41, the extraction region specifying unit 42, the character recognizing unit 43, the selected character string specifying unit 44, the process executing unit 45, the display control unit 46, and the image acquiring unit 47) are integrated circuits. It may be realized by a logic circuit (hardware) formed on an (IC chip) or the like, or may be realized by software using a CPU (Central Processing Unit). In the latter case, the smartphone 1 includes a CPU that executes instructions of a program that is software that realizes each function, a ROM (Read Only Memory) or a storage in which the above-described program and various data are recorded so as to be readable by the computer (or CPU). An apparatus (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
A character specifying device (smart phone 1) according to aspect 1 of the present invention is a character specifying device for specifying a character included in a display image, and is specified in the display image specified by a user operation on the display image. A character recognition execution unit (character recognition unit 43) that performs character recognition on the enlarged region obtained by enlarging the region, and a region set as a character included in the enlarged region obtained by character recognition by the character recognition execution unit; A selected character specifying unit (selected character string specifying unit 44) that specifies a character whose degree of overlap with the specific region exceeds a predetermined amount as a character selected by the user.

According to the above configuration, character recognition is performed not on the entire image but on an enlarged area obtained by enlarging a specific area. Thereby, compared with the case where character recognition processing is performed with respect to the whole image, the time which character recognition processing requires can be shortened. In addition, since character recognition is performed on the enlarged region, at least a region that completely includes a character that the user wants to select can be a target of character recognition processing. Therefore, the character that the user wants to select can be recognized in a complete state. Furthermore, according to said structure, the character with which the overlap degree of the area | region set to the character contained in an expansion area and a specific area exceeds predetermined amount is pinpointed as a character selected by the user. Thereby, the selected character can be specified with high accuracy. From the above, it is possible to specify only the target character with high accuracy in a short time.

In the character specifying device according to aspect 2 of the present invention, in the above aspect 1, the selected character specifying unit is set for each line formed by a character included in the enlarged region obtained by character recognition by the character recognition executing unit. In addition, when the degree of overlap between the line area in which the line exists and the specific area exceeds a first predetermined amount, the character included in the line area may be specified.

According to the above configuration, when the degree of overlap between the line area and the specific area exceeds the first predetermined amount, the characters included in the line area are specified. That is, among the lines included in the enlarged area, it is possible to narrow down the lines for performing the process of specifying characters. Therefore, since it is not necessary to specify characters for all the lines included in the enlarged region, it is possible to specify characters in a short time.

The character identification device according to aspect 3 of the present invention is the character identification device according to aspect 2, in which the specific area and the line area are rectangular, and the selected character identification unit includes (1) the line area and the specific area overlapping each other. And two of the boundary lines of the specific area that are parallel to the direction of the character overlap the line area, or (2) the line area overlaps the specific area. In addition, in the boundary line of the specific area, when two sides parallel to the character traveling direction do not overlap the line area, the character included in the line area may be specified.

According to the above configuration, when most of the specific area overlaps the line area, the characters included in the line area are targeted for specification. Here, there is a high possibility that the line where most of the specific areas overlap is a line specified by the operation. That is, since a line that is likely to be a line specified by an operation is determined as a line that includes the character to be specified, the character can be specified with high accuracy.

In the character identification device according to aspect 4 of the present invention, in the aspect 3, the selected character identification unit is configured such that, of the boundary lines of the specific area, only one of the two sides parallel to the traveling direction of the character is the above. The length of the side perpendicular to the direction of movement of the character in the line overlap area, which is an area where the line area overlaps with the specific area, is the progression of the character in the line area. When the length is a predetermined ratio or more with respect to the length of the side perpendicular to the direction, the character included in the line area may be specified.

According to the above configuration, when only one of the two sides parallel to the character progression direction is overlapped with the line area among the boundary lines of the specific area, the line having a high degree of overlap is specified. Here, there is a high possibility that a line having a high degree of overlap is a line specified by the operation. That is, a character included in a line that is highly likely to be a line specified by an operation is set as a specification target. Therefore, the character can be specified with high accuracy.

The character identification device according to aspect 5 of the present invention is the character identification device according to any one of the aspects 2 to 4, wherein the selected character identification unit is included in a line area whose degree of overlap with the specific area exceeds the first predetermined amount. The character may be a character that identifies the character when the degree of overlap between the character region that is the region where the character exists and the specific region exceeds a second predetermined amount.

According to the above configuration, when the degree of overlap between the character and the specific area exceeds the second predetermined amount, the character is specified. That is, it is determined for each character whether or not it is a selected character, and the selected character is specified. Therefore, the character can be specified with high accuracy.

In the character specifying device according to aspect 6 of the present invention, in the above aspect 5, the character area is a rectangle, and the selected character specifying unit includes (1) the character area and the specific area overlapping, and Of the boundary lines of the specific area, two sides perpendicular to the direction of travel of the character both overlap the character area, or (2) the character area and the specific area overlap, and Of the boundary lines of the specific area, when neither two sides perpendicular to the advancing direction of the character overlap the character area, the character set as the character area may be a character to be specified.

According to the above configuration, when most of the character area overlaps with the specific area, the character with the character area set is set as the specified character. Here, there is a high possibility that a character in which most of the character area overlaps the specific area is a character that the user has attempted to select. In other words, since the character that is highly likely to be selected by the user is the character to be specified, the character can be specified with high accuracy.

In the character specifying device according to aspect 7 of the present invention, in the aspect 6, the selected character specifying unit is configured so that only one of the two sides perpendicular to the advancing direction of the character is the boundary line of the specific region. The length of the side parallel to the direction of movement of the character in the character overlap area, which is an area where the character area overlaps the character area and the character area overlaps the specific area, is the progression of the character in the character area. When the length is equal to or greater than a predetermined ratio with respect to the length of the side perpendicular to the direction, the character in which the character area is set may be a character to be specified.

According to the above configuration, when only one of the two sides perpendicular to the character traveling direction among the boundary lines of the specific region overlaps the character region, the character having a large overlapping degree is specified. Here, there is a high possibility that a character with a large degree of overlap is a character that the user has attempted to select. In other words, since the character that is highly likely to be selected by the user is the character to be specified, the character can be specified with high accuracy.

The character identification device according to each aspect of the present invention may be realized by a computer. In this case, the character identification device is operated on each computer by operating the computer as each unit (software element) included in the character identification device. The control program for the character identification device realized and the computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

The present invention can be used in a character identification device for identifying characters included in a display image. In particular, it is suitable for smartphones, tablet terminals, digital cameras, and the like.

1 Smartphone (character identification device), 43 Character recognition unit (character recognition execution unit), 44 Selected character string identification unit (selected character identification unit)

Claims

A character identification device for identifying characters included in a display image,
A character recognition execution unit that performs character recognition on an enlarged area obtained by enlarging a specific area in the display image specified by a user operation on the display image;
A selected character that identifies, as a character selected by the user, a character whose degree of overlap between the area set as the character included in the enlarged area obtained by character recognition by the character recognition execution unit and the specific area exceeds a predetermined amount And a character identification device.
The selected character specifying unit is set for each line formed by characters included in the enlarged region obtained by character recognition by the character recognition executing unit, and a line region that is the region where the line exists and the specific region The character identification device according to claim 1, wherein when the degree of overlapping exceeds a first predetermined amount, a character included in the line area is targeted for identification.
The specific area and the line area are rectangular,
The selected character identification part
(1) The line region and the specific region overlap, and two of the boundary lines of the specific region that are parallel to the character traveling direction overlap the line region, or
(2) When the line area and the specific area overlap, and two of the boundary lines of the specific area that are parallel to the character traveling direction do not overlap the line area, The character identification device according to claim 2, wherein characters included in the line area are targeted for identification.
The selected character specifying unit includes only one of two sides parallel to the direction of the character of the boundary line of the specific area overlapping the line area, and the line area and the specific area. The length of the side perpendicular to the character traveling direction in the line overlapping region, which is the region where the characters overlap, is equal to or greater than a predetermined ratio with respect to the length of the side perpendicular to the character traveling direction in the line region. The character identification device according to claim 3, wherein the character included in the line area is a target to be identified.
The selected character specifying unit is set for each character included in a line area in which the degree of overlap with the specific area exceeds the first predetermined amount, and the character area and the specific area are areas where the character exists. The character identification device according to any one of claims 2 to 4, wherein when the degree of overlap with the character exceeds a second predetermined amount, the character is identified.
The character area is rectangular,
The selected character identification part
(1) The character region and the specific region overlap, and two of the boundary lines of the specific region that are perpendicular to the character traveling direction overlap the character region, or
(2) When the character area and the specific area overlap, and two of the boundary lines of the specific area that are perpendicular to the character traveling direction do not overlap the character area, The character identification device according to claim 5, wherein the character set with the character area is a character to be identified.
The selected character specifying unit is configured such that only one of two sides perpendicular to the advancing direction of the character among the boundary lines of the specific region overlaps the character region, and the character region and the specific region are The length of the side parallel to the character traveling direction in the character overlapping region, which is the region where the characters overlap, is equal to or greater than a predetermined ratio with respect to the length of the side perpendicular to the character traveling direction in the character region. The character identification device according to claim 6, wherein the character for which the character area is set is a character to be identified.
A control program for causing a computer to function as the character identification device according to any one of claims 1 to 7, wherein the control program causes the computer to function as each unit.