WO2014045752A1

WO2014045752A1 - Text image display control device, operation control method therefor, and operation control program therefor

Info

Publication number: WO2014045752A1
Application number: PCT/JP2013/071482
Authority: WO
Inventors: 野中　俊一郎; 典久羽田
Original assignee: 富士フイルム株式会社
Priority date: 2012-09-19
Filing date: 2013-08-08
Publication date: 2014-03-27

Abstract

This text image display control device prevents text character images from becoming difficult to see when said images are magnified. Text character images that are included in a text image are extracted and the text character images are arranged for display on the display screen of a mobile phone. When a magnification command and a magnification rate are provided to the mobile phone, verification is performed to determine whether the size of the text character images is within an allowable size limit when said images are magnified by the provided magnification rate (Step 36). When the allowable limit is surpassed ("NO" at Step 36), the edges of the magnified text character images become conspicuous and make the text character images difficult to see. When set to a stop mode, the text character images are magnified to the allowable limit size (Step 41) and are not enlarged to a size that surpasses the allowable limit. The text character images that have been magnified to the allowable size limit are rearranged and displayed on the display screen (Steps 38, 39).

Description

Document image display control device, operation control method thereof, and operation control program thereof

The present invention relates to a document image display control device, its operation control method, and its operation control program.

There is a document image in which a document is imaged instead of being represented by a text file. In such a document image, there may be a case where a character region in which an imaged character is described and a photo region are mixed. Among such document images, there is an image that detects only a character area as a character enlargement target area without enlarging a description of a photograph (Patent Document 1). Also, there is a technique that enlarges a character image so as to fit within a specified size (Patent Document 2).

JP 2012-49583 A Japanese Patent Laid-Open No. 11-272871

If it is a character represented by text data, the resolution is not degraded by enlarging the character. However, when the character image included in the document image is enlarged, the resolution is lowered, and the character image may be difficult to see.

An object of the present invention is to prevent a character image from becoming difficult to see due to enlargement.

The document image display control device according to the present invention has a number of pixels in a character image area (character number in the character image area, number of pixels in height, character number in the character image area) representing a character included in the document image obtained by imaging the document. An allowable limit calculating means for determining the size of the enlargement allowable limit of the character image area based on the number of all the included pixels), an enlarging means for enlarging the character image area in response to the enlargement command for the character image area, Characters enlarged by the magnifying means in the judging means for judging whether or not the size of the character image area enlarged by the magnifying means exceeds the size of the enlargement allowable limit calculated by the allowable limit determining means. When the size of the image area is determined to be the size of the enlargement allowable limit determined by the allowable limit determining means, the enlargement means enlarges the character image area. Characterized in that it comprises a display control means for controlling the display unit to display stop warning means performs the stop or warning, and the character image area is enlarged by enlarging means on the display screen.

The present invention also provides an operation control method suitable for a document image display control device. That is, in this method, the allowable limit calculating means determines the size of the enlargement allowable limit of the character image area based on the resolution of the character image area representing the character included in the document image in which the document is imaged. The character image area is enlarged in response to the enlargement command of the character image area, and the size of the character image area enlarged by the determining means is determined by the allowable limit determining means. The stop warning means determines that the size of the character image area enlarged by the enlargement means has become the size of the enlargement allowable limit calculated by the allowable limit determination means. Accordingly, the enlargement means stops or warns the enlargement of the character image area, and the display control means displays the character image area enlarged by the enlargement means. It controls the display unit to display the.

The present invention also provides a computer readable program for implementing the operation control method of the document image display control device. A recording medium storing such a program may also be provided.

According to the present invention, the allowable enlargement limit of the character image area is determined based on the number of pixels of the character image area. When a character image region enlargement command is given, the character image region is enlarged in accordance with the enlargement command. When the size of the enlarged character image area exceeds the size of the determined enlargement allowable limit, the enlargement is stopped or a warning is issued. The enlarged character image area is displayed on the display screen of the display device. Since the character image is not represented by the text data but is imaged, when the character image area is enlarged, the unevenness of the edge of the character image becomes conspicuous and may be difficult to see. According to the present invention, when the size of the enlarged character image area is larger than the size of the determined enlargement allowable limit, the enlargement is stopped or a warning is performed. Therefore, the character image area is enlarged so as to be difficult to see. Is prevented in advance.

The character image enlarged by the magnifying means when the determining means determines that the size of the character image area enlarged by the magnifying means is the size of the enlargement allowable limit determined by the allowable limit determining means. You may make it further provide the character image area correction | amendment means which correct | amends the enlarged character image area so that the edge of an area | region may become smooth.

The permissible limit determining means preferably determines the size of the permissible limit in accordance with the viewing angle for viewing the character image area, for example.

It is a block diagram which shows the electric constitution of a mobile telephone. It is an example of a document image. It is an enlarged view of a part of a document image. It is an example of an area | region data file. It is an example of a related file table. It is an example of a character image. It is a table which shows the relationship between the pixel count of a character image, and the magnitude | size of an allowable limit. It is an example of the corrected character image. It is a flowchart which shows the process sequence of a mobile telephone. It is a flowchart which shows the process sequence of a mobile telephone. It is a flowchart which shows the process sequence of a mobile telephone. It is an example of the display screen of a mobile phone. It is an example of the display screen of a mobile phone.

FIG. 1 is a block diagram showing an electrical configuration of a multi-function mobile phone 1 called a so-called smartphone.

In this embodiment, an imaged document (referred to as a document image) is displayed on the display screen of the mobile phone 1. As will be described in detail later, when a character image constituting a document image is enlarged, it is enlarged and displayed at a predetermined allowable enlargement limit, but warning or enlargement stops when the allowable enlargement limit is reached. Is done.

The overall operation of the mobile phone 1 is controlled by the CPU 2.

The mobile phone 1 includes a display device 4 in which the display of the document image is controlled by the display control device 4. A touch panel 5 is formed on the display screen of the display device 4.

The mobile phone 1 also includes a memory 6 for storing data and a communication device 7 for communicating with a network such as the Internet. The mobile phone 1 is also provided with a memory card interface 12. When a recording medium such as a memory card 12 storing an operation program, which will be described later, is loaded into the memory card interface 11 and the operation program is read from the memory card 12, the operation program is stored in the mobile phone 1. Installed. Of course, the operation program may be downloaded using the communication device 7 and installed in the mobile phone 1.

The mobile phone 1 is also provided with a microphone 9 and a speaker 10. The mobile phone 1 also includes an audio control device 8 for controlling the audio input from the microphone 9 and the audio output from the speaker 10.

Image data representing a document image, an area data file, a related file table, etc., which will be described later, are received by the communication device 7 and are already stored in the memory 6.

FIG. 2 is an example of an imaged document image 15.

The document image 15 includes areas F1 to F5. The areas F1 to F5 are all rectangular (not necessarily rectangular), and four vertices are defined by coordinates when the upper left vertex of the document image 15 is the origin (X0, Y0). The position of the region F1 is defined by coordinates (x11, y11), (x12, y12), (x13, y13), and (x14, y14). The position of the region F2 is defined by coordinates (x21, y21), (x22, y22), (x23, y23), and (x24, y24). Similarly, the positions of the other regions F3 to F5 are defined by the coordinates of the four vertices.

Areas F1, F3, and F5 are areas where images (original images) are pasted before the document image 15 is imaged. Areas F2 and F4 are areas in which a document represented by text data is represented before being imaged, and texts are imaged by being imaged. The region F2 includes character images for 30 characters surrounded by a rectangle as indicated by reference characters C1 to C30. Characters are described in the rectangle. These character images C1 to C30 were represented by text data before being imaged, but are represented as images by being imaged. The area F4 also includes a character image surrounded by a rectangle as indicated by the symbol C.

FIG. 3 is an enlarged view of the upper left part of the document image 15 of FIG. 2 compared to FIG.

In the area F1 (including the area F4) including the character image C1 and the like, the position of the character image C1 and the like is also defined with reference to the origin (X0, Y0) of the document image 15. For example, the position of the character image C1 is defined by coordinates (x101, y101), (x102, y102), (x103, y103), and (x104, y104). The same applies to other character images.

FIG. 4 is an example of a region data file for the document image 15.

The region data file stores information such as the region, the position of the character image, the number of regions, and the number of characters included in the document image 15. The number of lines is added to make it easier to understand.

In the first to sixth lines, information about the area included in the document image 15 is described. The first line describes the number of areas. In the second line, information about the first area F1 is described. In the second line, “F1” is a code for identifying the first area F1, and “Picture” indicates that the image has been pasted before the first area F1 is imaged. Yes, "4" indicates that the first area F1 is a quadrangle, and x11, y11, x12, y12, x13, y13, x14, and y14 indicate the position coordinates of the first area F1. Information about the second area F2 is described in the third line. In the third line, “F2” is a code for identifying the second area, and “Text” is a character (character represented by the text data before the image included in the second area F2 is imaged). "4" indicates that the second area F2 is a quadrangle, and the character string x21 and the like shifted to "4" indicate the position coordinates of the second area F2. . Similarly, for the 4th, 5th and 6th lines, the information about the third area, the fourth area and the fifth area is an identification code, an image before being imaged, or a text. -Data indicating whether it was data, the number of vertices (4), and position coordinates are described.

From the seventh line to the m-th line, detailed information about the first area F1 is described.

From the mth line to the m + 30th line, detailed information about the second area F2 is described. The m-th line defines the number of characters (30 characters) represented by the character image included in the second area F2. In the (m + 1) th line, information about the first character image C1 included in the second area F2 is described. In the (m + 1) th line, the code “C1” is the identification data of the first character image, “4” is the number of vertices of the first character, and “x111 to y114” indicates the position coordinates of the character image C1. The character “a” added following the position coordinates indicates that the character represented by the character image C1 is not a forbidden character. Similarly, in the (m + 2) th and subsequent lines, the character image identification data, the number of character image vertices, the position coordinates of the character image, and whether or not the character image is a forbidden character are attached. In the m + 18th line, as described above, the identification data, the number of vertices, and the position coordinates for the character image C18 are described. The number “70” is added to the end of the position coordinates. Yes. The number “70” indicates the probability that the character image C18 is a forbidden character in percentage. “70” indicates that the character represented by the character image C18 is a forbidden character with a probability of 70 percent. In this way, a probability indicating a prohibited character may be added after the position coordinates.

From the (m + 31) th line onward, information on the areas F3, F4 and F5 is described as described above.

4 can be extracted from the document image 15 shown in FIG. 2 by using the area data file shown in FIG. 4, and the extracted character image C1 etc. can be rearranged on the display screen of the mobile phone 1.

FIG. 5 is an example of a related file table.

The related file table stores the file name of the document image file representing the document image and the file name of the area data file for the document image. The file name of the document image 15 shown in FIG. 2 is “image1.jpg”, and the file name of the area data file shown in FIG. 4 is “imge1-area.txt”. By storing these file names in the same related file table, the area data corresponding to the document image 15 is known. If there is a document image other than the document image 15, a related file table is generated corresponding to the document image, and an area data file corresponding to the document image is found from the generated related file table. Can do.

FIG. 6 is an example of the character image C1.

The character image C1 indicated by reference numeral 21 has the same size as the character image C1 included in the document image 15. A character image C1 indicated by reference numeral 22 is obtained by enlarging the width of the character image C1 included in the document image 15 to 2n (cm). A character image C1 indicated by reference numeral 23 is obtained by enlarging the character image C1 included in the document image 15 to 4n (cm).

Since the character image C1 is not represented by text data but is imaged, when enlarged, the edge of the character represented as an image becomes conspicuous. As the character image is enlarged, the edges become more conspicuous and difficult to see. If the number of pixels of the character image (width, height, total number of pixels in the character image area) is large, the edge will not be noticeable even if the character image is enlarged, but if the character image is small, the edge will be noticeable if the character image is enlarged. End up. In this embodiment, an allowable size after enlargement is determined according to the number of pixels of the character image, and if the character image is enlarged beyond that size, a warning is given or enlargement itself cannot be performed.

FIG. 7 is an example of an allowable limit table.

対応 Stores the size after enlargement that allows the character image of that resolution to be accepted according to the resolution of the character image.

As described above, the edge is not noticeable even if the character image is enlarged if the number of pixels of the character image is large, but if the character image is enlarged if the number of pixels of the character image is small, the edge becomes noticeable. For this reason, the smaller the number of pixels of the character image, the smaller the allowable limit of the character image is set. For example, the allowable limit when the number of pixels of a character image is less than R1 pixels, R1 pixels to R2 pixels, R2 pixels to R3 pixels, R3 pixels to R4 pixels, and R4 pixels to R5 pixels is N (cm), 2n (cm), 3n (cm), 4n (cm), 5n (cm), and 6n (cm), respectively. However, the number of pixels increases in the order of R1, R2, R3, R4, and R5.

Such an allowable limit enlargement rate table is also stored in the memory 6 of the mobile phone 1.

The size of the allowable limit is determined based on the allowable viewing angle. For example, if the viewing angle (allowable viewing angle) when the user views a character image having an allowable size width after enlargement is 2θ and the distance to the display screen is L, the allowable limit size ( (Width) is obtained by 2Ltanθ. Since the distance to the display screen varies depending on the type of display device (cell phone, television device, large screen, etc.), the size of the allowable limit for character images also varies depending on the type of display device.

The character image C1 indicated by reference numeral 24 in FIG. 8 is obtained by enlarging the character image C1 included in the document image 15 to a size of 4n (cm) and performing correction processing, as shown in FIG. It is.

By performing the correction process, the edge becomes inconspicuous unlike the character image C1 enlarged to 4n (cm) as indicated by reference numeral 23 in FIG. As described above, when the character image is enlarged to a size larger than the allowable size, the character image may be corrected.

Such correction processing can be realized by detecting the edge of the character represented by the character image C1 and smoothing the edge.

9 to 11 are flowcharts showing the processing procedure of the mobile phone 1.

In this processing procedure, the character image in the area F2 shown in FIG. 15 is displayed on the display screen of the mobile phone 1.

First, the document image data and the area data file representing the document image 15 stored in the memory 6 are read from the memory 6 (step 31). Then, based on the position data described in the area data file, character images C1 to C30 included in the area F2 of the document image 15 are extracted (step 32). The extracted character images C1 to C30 are arranged so as to be displayed on the display screen of the mobile phone 1 (step 33). The arranged character images C1 to C30 are displayed on the display screen (step 34).

FIG. 12 shows a state in which the extracted character images C1 to C30 are arranged on the display screen 50 of the mobile phone 1.

In the area F2 of the document image 15 shown in FIG. 2, ten character images are arranged in one line, and character images C1 to C30 are arranged in three lines. Since the size of the area F2 of the document image 15 in which the character images C1 to C30 are arranged is larger than the size of the display screen 50, the character images C1 to C30 displayed on the display screen 50 as shown in FIG. Are arranged in a ratio of 8 per line.

Returning to FIG. 9, when an enlargement command and an enlargement ratio are given to the mobile phone 1 (YES in step 35), whether the size of the character image after enlargement when enlarged according to the enlargement ratio is within an allowable limit. Is determined (step 36). For example, by placing two fingers on the touch panel 5 at the same time and tracing the touch panel 5 so that the fingers are separated (so-called pinch out), an enlargement command is given to the mobile phone 1. Given, the distance between those fingers is the magnification. It goes without saying that the enlargement command and the enlargement rate may be given to the mobile phone 1 by other methods.

If the size of the character image to be enlarged based on the enlargement rate given to the mobile phone 1 is within the allowable limit (YES in step 36), the character images C1 to C30 are enlarged according to the given enlargement rate. (Step 37). The enlarged character images C1 to C30 are rearranged so as to be displayed on the display screen 50 (step 38). The rearranged character images C1 to C30 are displayed on the display screen 50 (step 39). The size of the enlarged character image also depends on the resolution of the display screen of the display device 4 of the mobile phone 1. It is determined whether the size when the enlarged character image is displayed on the display screen is within an allowable limit.

FIG. 13 shows an example of the display screen 50 on which the rearranged character image C1 and the like are displayed.

In FIG. 13, the character images C29 and C30 are not displayed on the display screen 50, but the character images C29 and C30 are also displayed on the display screen 50 by scrolling the display screen 50.

In the display screen 50 shown in FIG. 13, the size (width) of the character images C1 to C30 included in the document image 15 is 2n (cm). In the example shown in FIG. 13, the number of pixels of the character images C1 to C30 included in the document image 15 is R1 pixels or more, and the allowable limit is 2n (cm). Therefore, the character images C1 to C30 enlarged to 2n (cm) are displayed on the display screen 50.

If the size of the character image enlarged with the enlargement ratio given to the mobile phone 1 exceeds the allowable limit (NO in step 36), the mobile phone 1 is set to either the enlargement warning mode or the enlargement stop mode. (Step 40). These modes are set in the mobile phone 1 in advance, but when the size after enlargement exceeds the allowable limit, the user may set either the enlargement warning mode or the enlargement stop mode. Good.

When the enlargement stop mode is set (step 40), the character images C1 to C30 are enlarged so as to be within the allowable limit (step 41). For example, if the number of pixels of the character images C1 to C30 is less than R1, the allowable limit is n (cm), and it is not enlarged beyond that size. Character images C1 to C30 enlarged to a permissible limit are rearranged (step 38) and displayed on the display screen 50.

If the enlargement warning mode is set (step 40), a warning is given to the user (step 42). For example, a warning text may be displayed on the display screen 50 or a warning sound may be generated. Subsequently, it is confirmed whether the correction mode is set (step 43). When the correction mode is not set (NO in step 43), the character images C1 to C30 are enlarged so as to have a given size exceeding the allowable limit (step 37), and from the enlarged character image C1. C30 is rearranged and displayed (steps 38 and 39). The user will reduce the size of the character image if necessary.

If the correction mode is set (YES in step 43), the character image is enlarged to a size exceeding the allowable limit (step 44). Subsequently, as described above, the enlarged character image is corrected so that the edges become smooth (step 45). The corrected character images are rearranged (step 46) and displayed on the display screen 50.

1 Mobile phone 2 CPU
3 Display control device 4 Display device

Claims

A tolerance limit determining means for determining a size of a magnification tolerance limit of the character image area based on the number of pixels of the character image area representing a character included in the document image in which the document is imaged;
An enlargement means for enlarging the character image area in response to an enlargement command for the character image area;
Determining means for determining whether or not the size of the character image area enlarged by the enlarging means is equal to or larger than the enlargement allowable limit determined by the allowable limit determining means;
When the determination means determines that the size of the character image area enlarged by the enlargement means has become the size of the enlargement allowable limit determined by the allowable limit determination means, the character by the enlargement means Stop warning means for stopping or warning the enlargement of the image area, and display control means for controlling the display device to display the character image area enlarged by the enlargement means on the display screen;
A document image display control device.
When the determination means determines that the size of the character image area enlarged by the enlargement means is the size of the enlargement allowable limit determined by the allowable limit determination means, the enlargement means enlarges the character image area. Character image area correction means for correcting the enlarged character image area so that the edge of the read character image area is smooth,
The document image display control apparatus according to claim 1, further comprising:
The allowable limit determining means is:
This determines the size of the enlargement limit according to the viewing angle for viewing the character image area.
The document image display control apparatus according to claim 1.
An allowable limit determining means determines a size of an expansion allowable limit of the character image area based on the number of pixels of the character image area representing a character included in the document image in which the document is imaged;
The enlargement means enlarges the character image area in response to the enlargement command of the character image area,
A judging means for judging whether the size of the character image area enlarged by the enlarging means is equal to or larger than the enlargement allowable limit determined by the allowable limit determining means;
When the stop warning means determines that the size of the character image area enlarged by the enlargement means is the size of the enlargement allowable limit determined by the allowable limit determination means in the determination means, Stop or warn the enlargement of the character image area by the above enlargement means,
Display control means controls the display device so as to display the character image area enlarged by the enlargement means on the display screen;
An operation control method for a document image display control apparatus.
A computer-readable program for controlling a computer of a document image display control device,
Determining the size of the character image area expansion allowable limit based on the number of pixels of the character image area representing the character included in the document image in which the document is imaged;
Enlarge the character image area according to the enlargement command of the character image area,
Determine whether the size of the enlarged text image area is greater than or equal to the size of the determined enlargement limit,
In response to determining that the size of the enlarged character image area has reached the size of the determined enlargement allowable limit, stop or warn the enlargement of the character image area.
A program for controlling a computer of a document image display control device to control a display device so as to display an enlarged character image region on a display screen.