JP2024119157A - Computer program, server, and system - Google Patents

Abstract

A recommendation is made using a scanned image. The method includes obtaining scanned image data representing a document to be optically scanned. A parameter that correlates with the aspect ratio of the document in the scanned image represented by the scanned image data is used to select a recommended scanning device from a plurality of candidate scanning devices for optically scanning the document. Specific information associated with the recommended scanning device is output. [Selected Figure] Figure 2

Description

This specification relates to technology for processing optically read images.

Conventionally, images of objects (e.g., documents) optically read by reading devices such as digital cameras and scanners have been used. Various technologies related to read images have also been proposed. For example, Patent Document 1 describes a technology that identifies the document type based on elements such as the characteristic structure of the document (ruled lines, etc.), the characteristics of the item layout, the insertion position of a drawing or image, and the type or size of font, and presents recommended copy functions and recommended transmission functions for each document type.

JP 2013-15348 A

However, there is room for improvement when using scanned images to make recommendations.

This specification discloses a technology that uses scanned images to make recommendations.

The technology disclosed in this specification can be realized as the following application examples:

[Application Example 1] A computer program that causes a computer to realize an acquisition function for acquiring scanned image data representing a document to be optically read, a selection function for selecting a recommended reading device for optically reading the document from among a plurality of candidate reading devices using a parameter that has a correlation with the aspect ratio of the document in the scanned image represented by the scanned image data, and an output function for outputting specific information associated with the recommended reading device.

According to this configuration, a recommended reading device for optically reading a document is selected using parameters that are correlated with the aspect ratio of the document in the read image, and specific information associated with the recommended reading device is output, making it possible to recommend an appropriate reading device.

[Application Example 2] A system comprising a server and a terminal device having a digital camera and a display unit and configured to communicate with the server via a network, the terminal device comprising a transmission unit that transmits scanned image data representing a document optically scanned by the digital camera to the server, the server comprising an acquisition unit that acquires the scanned image data from the terminal device, a selection unit that selects a recommended scanning device for optically scanning the document from a plurality of candidate scanning devices using a parameter that has a correlation with the aspect ratio of the document in the scanned image represented by the scanned image data, and an output unit that outputs specific information associated with the recommended scanning device to the terminal device, and the terminal device comprises a display processing unit that causes the specific information to be displayed on the display unit.

The technology disclosed in this specification can be realized in various forms, such as a data processing method and a data processing device, a server, a terminal device, a system including a server and a terminal device, a computer program for realizing the functions of the method or device, a recording medium (e.g., a non-transitory recording medium) on which the computer program is recorded, etc.

FIG. 1 is an explanatory diagram illustrating a system according to an embodiment; FIG. 11 is a sequence diagram illustrating an example of read data processing. FIG. 11 is a sequence diagram illustrating an example of read data processing. (A) is a diagram showing an example of a read image. (B) is a diagram showing an example of a target read image. (C) is a diagram showing an example of a candidate reading device. (D) is a diagram showing an example of specific information Iz1. (E) is a diagram showing an example of specific information Iz2. 13 is a flowchart showing an example of a selection process of a recommended reading device RD. 13 is a flowchart showing an example of a selection process of a recommended reading device RD. 13 is a flowchart showing an example of a selection process of a recommended reading device RD. 13 is a flowchart illustrating an example of a process for estimating a document type PD. 1A and 1B are diagrams illustrating the shadow of a document, 1C is a diagram illustrating a target scanned image IMt and specific portions SP1-SP3, and 1D is a diagram illustrating an aspect ratio and a range. 13 is a flowchart showing another embodiment of the process of selecting a recommended reading device RD. 13 is a flowchart showing another embodiment of the process of selecting a recommended reading device RD.

A. First embodiment:
A1. System configuration:
1 is a diagram illustrating a system according to an embodiment of the present invention. The system 1000 includes a multifunction device 100, a terminal device 200, and a server 300.

The multifunction device 100 is capable of printing images and reading documents. The terminal device 200 is a portable terminal device (e.g., a smartphone, a tablet computer, a laptop computer, a portable game console, etc.). The terminal device 200 is equipped with a digital camera 270. A user can cause the digital camera 270 of the terminal device 200 to read a document. Reading a document using a camera included in a portable device in this manner is also called camera scanning.

After reading the document, the terminal device 200 transmits information related to the reading to the server 300. The server 300 uses the received information to suggest to the user a recommended reading device for reading the document. For example, if the read document is long and narrow, the document may be a store receipt. For reading such documents, a manuscript holder is more preferable than an automatic document feeder. Therefore, the server 300 suggests a reading device that is equipped with a manuscript holder. Details of the suggestion of a recommended reading device will be described later.

The multifunction device 100 and the terminal device 200 are connected to a local area network LN. The local area network LN is managed by a user. The local area network LN is connected to the Internet IT via a router (not shown). The server 300 is connected to the Internet IT.

Next, the hardware configuration will be described. First, the multifunction device 100 will be described. The multifunction device 100 has a processor 110, a storage device 115, a display unit 140, an operation unit 150, a print execution unit 160, a read execution unit 170, and a communication interface 180. These elements are connected to each other via a bus (not shown).

The display unit 140 is a device configured to display images, such as a liquid crystal display or an organic EL display. The operation unit 150 is a device configured to receive operations by a user, such as a button, a lever, or a touch panel overlaid on the display unit 140. The communication interface 180 is an interface for communicating with other devices (e.g., including one or more interfaces of a wired LAN and an IEEE802.11 wireless LAN). The communication interface 180 of the multifunction device 100 is connected to a local area network LN.

The print execution unit 160 is a device that prints images. In this embodiment, the print execution unit 160 is a so-called inkjet printer. The print execution unit 160 is configured to print images using one or more types of printing material (e.g., four colors of ink: cyan, magenta, yellow, and black). Note that the print execution unit 160 may be a device that prints images using another method (e.g., a laser printer).

The reading execution unit 170 is a device that optically reads a document. In this embodiment, the reading execution unit 170 is equipped with an optical sensor (not shown) (e.g., a Contact Image Sensor (CIS) or a Charge Coupled Device (CCD)). The reading execution unit 170 optically reads a document to generate scan data representing the read document. The reading execution unit 170 may be equipped with one or both of a document table (also called a flatbed) and an automatic document feeder. The automatic document feeder is a device that automatically transports multiple documents one by one.

The processor 110 is a device configured to process data. The processor 110 is, for example, a Central Processing Unit (CPU) or a System on a chip (SoC). The storage device 115 includes a volatile storage device 120 and a non-volatile storage device 130. The volatile storage device 120 is, for example, a DRAM, and the non-volatile storage device 130 is, for example, a flash memory.

The non-volatile storage device 130 stores data of program PG1. The processes executed by the processor 110 in accordance with program PG1 include a process for causing the print execution unit 160 to print an image, and a process for causing the read execution unit 170 to read a document. The data of program PG1 is stored in the non-volatile storage device 130 when the multifunction device 100 is manufactured. Note that program PG1 may be stored in the non-volatile storage device 130 of the multifunction device 100 from a server (not shown) via a network, or from a portable storage device (e.g., a USB flash drive) (not shown) connected to the multifunction device 100.

The terminal device 200 has a processor 210, a storage device 215, a display unit 240, an operation unit 250, a digital camera 270, and a communication interface 280. These elements are connected to each other via a bus (not shown).

The display unit 240 is a device configured to display images, such as a liquid crystal display or an organic EL display. The operation unit 250 is a device configured to receive operations by a user, such as a button, a lever, or a touch panel overlaid on the display unit 240. The communication interface 280 is an interface for communicating with other devices (e.g., including one or more interfaces of a wired LAN, an IEEE802.11 wireless LAN, and a mobile phone network interface). In this embodiment, the communication interface 280 is connectable to a local area network LN.

The processor 210 is a device configured to process data (e.g., a CPU or SoC). The memory device 215 includes a volatile memory device 220 and a non-volatile memory device 230. The volatile memory device 220 is, for example, a DRAM, and the non-volatile memory device 230 is, for example, a flash memory.

The non-volatile storage device 230 stores data of program PG2. Program PG2 is an application program that runs on the terminal device 200. Program PG2 is provided by a service provider that operates the server 300. Program PG2 may be stored in the non-volatile storage device 230 of the terminal device 200 from a server (not shown) via a network, or from a portable storage device (e.g., a USB flash drive) (not shown) connected to the terminal device 200.

The memory area of the non-volatile memory device 230 includes a read memory area SR configured to store read image data. Read data representing an image read by the digital camera 270 is stored in the read memory area SR.

The server 300 has a processor 310, a storage device 315, and a communication interface 380. These elements are connected to each other via a bus (not shown). The communication interface 380 is an interface for communicating with other devices (e.g., one or more interfaces of a wired LAN and a wireless LAN of IEEE802.11). The communication interface 380 is connected to the Internet IT. The processor 310 is a device configured to process data (e.g., a CPU or SoC). The storage device 315 includes a volatile storage device 320 and a non-volatile storage device 330. The volatile storage device 320 is, for example, a DRAM, and the non-volatile storage device 330 is, for example, a flash memory. The non-volatile storage device 330 stores data of the program PG3. The processor 310 executes various processes for providing a service by executing the program PG3 (details will be described later). The program PG3 is uploaded to the server 300 by a service provider that provides the service.

A2. Read data processing:
2 and 3 are sequence diagrams showing an example of read data processing. FIG. 3 shows a continuation of FIG. 2. In the diagram, various steps of a user, an application APP, a digital camera 270, a non-volatile storage device 230, a server 300, and a multifunction device 100 are shown. Steps of the application APP are executed by a processor 210 of the terminal device 200. Steps of the server 300 and the multifunction device 100 are executed by processors 310 and 110, respectively. Here, the execution of processing by the processors 210, 310, and 110 is also expressed as the execution of processing by the application APP, the server 300, and the multifunction device 100.

In S115, the user starts the application APP by operating the operation unit 250 of the terminal device 200. The user adjusts the position and orientation of the terminal device 200 so that the document DC is located within the shooting range of the digital camera 270 of the terminal device 200. The user then operates the operation unit 150 to input a camera scan instruction.

In S120, the application APP supplies a capture instruction to the digital camera 270. In S125, the digital camera 270 captures an image in response to the capture instruction. As a result, the digital camera 270 optically reads the document DC and generates read image data representing the read document DC (also simply referred to as read data).

Fig. 4(A) is a diagram showing an example of a read image represented by read data. The read image IM1 is a rectangular image having two sides parallel to a first direction D1 (here, the horizontal direction) and two sides parallel to a second direction D2 (here, the vertical direction) perpendicular to the first direction D1. The read image IM1 is represented by the color values of each of a plurality of pixels arranged in a matrix along the first direction D1 and the second direction D2. In this embodiment, the color values are represented by three component values of R (red), G (green), and B (blue). Each component value is represented in 256 stages, for example, from 0 to 255. In this embodiment, other images described later also have a rectangular shape.

The scanned image IM1 shows a document portion DP1 representing the first document DC1, and a background portion BP1. In the scanned image IM1, the first document DC1 may be tilted. Also, the actual shape of the first document DC1 is assumed to be rectangular. In the scanned image IM1, the shape of the first document DC1 may be rectangular or similar to a rectangle.

In S130 (FIG. 2), the application APP acquires read data from the digital camera 270. In S135, the application APP generates corrected read data by correcting the read data (this correction is also called scan correction (details will be described later)). In S140 (FIG. 2), the application APP stores the corrected read data in the read memory area SR of the non-volatile memory device 230. The corrected read data is used in various processes such as viewing by the user, printing processing, and the process of selecting a recommended reading device described later. Such read data is called target read data. In this embodiment, the target read data is corrected read data.

FIG. 4B is a diagram showing an example of a target read image represented by the target read data. The target read image IM1c shows an example of an image obtained by scan correction of the read image IM1 of FIG. 4A. The target read image IM1c is a rectangular image having two sides parallel to the first direction Dx (here, the horizontal direction) and two sides parallel to the second direction Dy (here, the vertical direction) perpendicular to the first direction Dx. As shown in the figure, the inclination of the first document DC1 is approximately zero in the target read image IM1c. In addition, the background is removed. The width W is the length of the short side (here, the side parallel to the first direction Dx) of the target read image IM1c, and the height H is the length of the long side (here, the side parallel to the second direction Dy) of the target read image IM1c (unit: number of pixels). The width W and the height H are approximately the same as the width and height of the first document DC1. Hereinafter, the first direction Dx is defined as the direction parallel to the short side of the target image, and the second direction Dy is defined as the direction parallel to the long side of the target image. In other words, the height H is greater than the width W.

In this embodiment, the scan correction includes a process of reducing the inclination of the document in the read image and removing the background portion. Such a process may be various processes. For example, the application APP may execute the following process. The application APP separates the read image IM1 (FIG. 4A) into a background portion BP1 and a document portion DP1. The application APP obtains four straight lines L1-L4 that form a rectangle that approximates the contour of the document portion DP1. The application APP determines a rotation angle so that the directions of the upper side L1 and the lower side L3 approach the first direction D1, and the directions of the right side L2 and the left side L4 approach the second direction D2. The application APP rotates the read image IM1 by the rotation angle, and extracts, as the target read image IM1c, an image of a minimum rectangle that includes the rotated document portion DP1 and is composed of two sides parallel to the first direction D1 and two sides parallel to the second direction D2. The two parts BP1 and DP1 may be determined, for example, by binarizing the grayscale image of the scanned image IM1 (for example, Otsu's binarization). The four approximation lines L1-L4 may be determined, for example, using multiple pixels that indicate the outline of the document part DP1, according to an algorithm that determines a line that approximates multiple points (for example, a Hough transform, a least squares method, etc.).

When photographing a document, the terminal device 200 (specifically, the digital camera 270) may be tilted with respect to the document. Therefore, in the read image, the shape of the document may be distorted from a rectangle. For example, in the read image IM1 (FIG. 4(A)), the shape of the first document DC1 may be a trapezoid or a rectangle with no parallel sides. Scan correction may include a process for correcting such distortion. Distortion correction may include, for example, a projective transformation that associates four corners of the document part in the read image with four corners of the target read image, respectively. For example, the four corners P1-P4 of the document part DP1 in FIG. 4(A) may be associated with the four corners P1c-P4c of the target read image IM1c in FIG. 4(B). The four corners P1-P4 of the document part DP1 may be, for example, four corners formed by approximate straight lines L1-L4. The width W of the target read image IM1c may be determined using the length of one or both of the pair of opposing approximate straight lines (e.g., the upper side L1 and the lower side L3) (e.g., the same as the length of one of the sides L1 and L3 selected in advance, or the average of both lengths). The height H of the target read image IM1c may be determined using the length of one or both of the other pair of opposing approximate straight lines (e.g., the right side L2 and the left side L4) (e.g., the same as the length of one of the sides L2 and L4 selected in advance, or the average of both lengths).

The reading process S110, which includes the above steps S115-S140, is a process for one document. If the total number of documents is N (N is an integer equal to or greater than 1), the user proceeds with the reading process S110 N times. After the Nth reading process S110, in S142, the user operates the operation unit 150 to input an instruction to end scanning.

In S145, the application APP transmits data of the processing information to the server 300. The processing information includes the following information.
(1) Reader type PA
(2) Number of reads PB
(3) Print Flag PC
(4) Target read image IMt

The reading device type PA is the type of reading device used to read the document. In this embodiment, the model name of the reading device is used as the reading device type PA. When the digital camera 270 of the terminal device 200 is used to generate the read data, the reading device type PA is set to the model name of the terminal device 200. The model name of the terminal device 200 indicates that the reading device is included in the portable device.

In addition, in the reading process S110, a stationary reading device (e.g., multifunction device 100) may be used instead of the digital camera 270 of the terminal device 200. For example, the user may input an instruction to read using the multifunction device 100 in S115. In response to this instruction, the application APP transmits a reading instruction to the multifunction device 100. The multifunction device 100 reads the document in response to this instruction and transmits the read data to the terminal device 200. In this case, the reading device type PA is set to the model name of the multifunction device 100. The model name of the multifunction device 100 indicates that the reading device is a stationary reading device. In addition, the scan correction (S135) may be performed by the terminal device 200, or alternatively, may be performed by the multifunction device 100.

The number of reads PB is the number of pages of the document that have been read. The print flag PC indicates whether the target read data has been used for printing. "PC=ON" indicates that the target read data has been used for printing, and "PC=OFF" indicates that the target read data has not been used for printing. In S145, the print flag PC is set to "OFF."

The target read image IMt is a target read image generated by the reading process S110. When two or more target read images are generated, one target read image that represents them is used (for example, the first target read image). Hereinafter, the target read image IMt will represent the document DC.

In S150, the server 300 uses the processing information to select a recommended reading device from a plurality of candidate reading devices. FIG. 4(C) is a diagram showing an example of a candidate reading device. In this embodiment, a recommended reading device is selected from five types of candidate reading devices CD1-CD5.

The first candidate CD1 (Model A) is a flatbed scanner without an automatic document feeder. A flatbed, also called a manuscript tray, is a platform on which objects to be scanned, such as documents, are placed. In this embodiment, the flatbed scanner is a dedicated scanner. A dedicated scanner is a device dedicated to scanning and does not have a printing function. Hereinafter, "FB" will be used as an abbreviation for flatbed, and "ADF" will be used as an abbreviation for automatic document feeder.

The second candidate CD2 (Model B) is a dedicated scanner with an ADF. Model B may or may not have a FB.

The third candidate CD3 (Model C) is a scanner with an automatic card feeder. An automatic card feeder is a device that automatically transports small cards such as credit cards. Model C may or may not have an FB.

The fourth candidate CD4 (model D) is a multifunction device with an FB. A multifunction device is a device that includes a print execution unit and a read execution unit, like the multifunction device 100 (Figure 1). Model D does not have an ADF.

The fifth candidate, CD5 (Model E), is a multifunction printer with both ADF and FB.

In S150 (FIG. 2), the server 300 uses parameters that are correlated with the aspect ratio of the document DC in the target read image IMt to select a recommended reading device for optically reading the document DC. For example, if the aspect ratio of the document DC is the same as that of an A4 size document, the number of reads PB is 1, and the print flag PC is "OFF", the first candidate CD1 having FB may be recommended. Details of the selection process for the recommended reading device will be described later.

In S152, the server 300 generates specific information Iz1 associated with the recommended reading device. In this embodiment, the data of the specific information Iz1 is display data including a description of the recommended reading device and a link to the web page of the recommended reading device. The description and link are predetermined for each recommended reading device. The data format of the specific information Iz1 may be various formats, such as text format. In S155, the server 300 transmits the data of the specific information Iz1 to the terminal device 200. In S160, the application APP uses the received data to display the specific information Iz1 on the display unit 240.

FIG. 4D is a diagram showing an example of specific information Iz1. The specific information Iz1 includes a first message Msg1 that describes the recommended reading device, and a first link LK1 to the web page of the recommended reading device. The link to the web page represents, for example, a Uniform Resource Locator (URL). By observing the first message Msg1, the user can know the more preferable reading device (here, model A of a flatbed scanner). In addition, the user can display the web page indicated by the first link LK1 on the display unit 240 by operating the operation unit 250 (for example, a web browser may be started on the terminal device 200 by tapping the first link LK1). The user can learn details of the recommended reading device by referring to the displayed web page. The web page of the recommended reading device may be provided by the manufacturer of the recommended reading device or a service provider.

The target scanned data can be used for various purposes. In this embodiment, the user causes the multifunction device 100 to print the target scanned image. In S215 (FIG. 3), the user inputs a print instruction by operating the operation unit 150 of the terminal device 200.

In S220, the application APP acquires target read data from the read memory area SR of the non-volatile memory device 230. In S225, the application APP sends a print instruction to the multifunction device 100. This instruction includes the target read data. In S230, the multifunction device 100 uses the received target read data to print the target read image. Note that in S255, the application APP may use the target read data to generate print data suitable for the multifunction device 100. The application APP may then send the print data to the multifunction device 100.

After S225, in S245, the application APP sends the processing information data to the server 300. The difference from the processing information in S145 (FIG. 2) is that the print flag PC is "ON."

In S250, the server 300 uses the processing information to select a recommended reading device from multiple candidate reading devices. Unlike S150 (FIG. 2), the print flag PC is "ON." In this case, the server 300 can select a multifunction device that can print images in addition to reading documents (details will be described later). Here, it is assumed that the fourth candidate CD4 (FIG. 4(C)) is selected.

In S252, the server 300 generates specific information Iz2 associated with the recommended reading device. As in S152 (FIG. 2), the server 300 generates specific information Iz2 including a description of the recommended reading device and a link. In S255, the server 300 transmits data of the specific information Iz2 to the terminal device 200. In S260, the application APP uses the received data to display the specific information Iz2 on the display unit 240.

Figure 4 (E) is a diagram showing an example of specific information Iz2. Unlike specific information Iz1 in Figure 4 (D), in specific information Iz2 in Figure 4 (E), second message Msg2 and second link LK2 relate to the recommended reading device selected in S250 (Figure 3). By referring to second message Msg2, the user can learn about a more preferred reading device (here, model D of the multifunction device with FB). In addition, the user can learn details about the recommended reading device by referring to the web page indicated by second link LK2.

This completes the read data processing in Figures 2 and 3.

A3. Recommended reader selection process:
5 to 7 are flowcharts showing an example of the selection process of a recommended reading device RD (S150 (FIG. 2), S250 (FIG. 3)). In S310, the processor 310 of the server 300 acquires processing information data from the terminal device 200. The acquisition of the processing information is performed, for example, in S145 (FIG. 2) or S245 (FIG. 3). As described above, the processing information includes the reading device type PA, the number of reads PB, the print flag PC, and the target read image IMt.

In S315, the processor 310 executes a process of estimating the document type PD. In this process, the processor 310 estimates the document type PD, which is the type of the document DC represented by the target scanned image IMt. In this embodiment, the document type PD is selected from "book," "card," "standard document," "store receipt," and "other."

Figure 8 is a flowchart showing an example of a process for estimating document type PD. In S410, processor 310 searches for a shadow from a specific portion of document DC represented by target read image IMt. Figures 9(A) and 9(B) are explanatory diagrams of document shadows. As described below, shadows can occur when reading a bound document (i.e., a book). A scanner having a platen can be used to read the pages of a book. A user opens the book, places the page to be read on the platen, and then has the scanner read the page. Here, the vicinity of the bound portion between the right and left pages is likely to be separated from the platen. If a page is read with part of the document separated from the platen, a shadow can occur in the part separated from the platen.

Figure 9 (A) shows an example of a target read image generated when both the right page PR2 and the left page PL2 are read in one scan. The second document DC2 in the target read image IM2c represents both the right page PR2 and the left page PL2. The bound portion DC2b of the second document DC2 is located in a first specific portion SP1 located in the center of the target read image IM2c in the second direction Dy. The first specific portion SP1 is a rectangular portion extending in the first direction Dx. The first specific portion SP1 extends from the end of the target read image IM2c on the first direction Dx side to the opposite end. A shadow is cast on a portion of the target read image IM2c that includes the bound portion DC2b (i.e., the first specific portion SP1).

Figure 9 (B) shows an example of a target read image generated when one page is read. The third document DC3 in the target read image IM3c represents one page. The bound portion DC3b of the third document DC3 is located at the second specific portion SP2 located at the end of the target read image IM3c in the opposite direction to the first direction Dx. The second specific portion SP2 is a rectangular portion extending in the second direction Dy. The second specific portion SP2 extends from the end of the target read image IM3c in the second direction Dy to the opposite end. A shadow is cast on a portion of the target read image IM3c that includes the bound portion DC3b (i.e., the second specific portion SP2).

Although not shown in the figure, when one page is read, the bound portion may be located at a third specific portion SP3 located at the end of the target read image (e.g., target read image IM3c) on the first direction Dx side. The third specific portion SP3 is a rectangular portion extending in the second direction Dy. The third specific portion SP3 extends from the end of the target read image on the second direction Dy side to the opposite end. In this case, a shadow may be generated on the third specific portion SP3.

Figure 9 (C) is a diagram showing the target read image IMt and specific portions SP1-SP3. In S410 (Figure 8), the processor 310 searches for a shadow in the specific portions SP1-SP3 of the target read image IMt. The conditions for determining that a shadow exists in a specific portion may be various conditions that indicate that the specific portion is darker than other portions. For example, the processor 310 may determine that a shadow exists in a specific portion when a representative value (e.g., average, median, mode, etc.) of the luminance values of the specific portion is smaller than a representative value of the overall luminance values of the target read image IMt and the difference between the representative values is greater than a threshold value.

The threshold value of the difference between the representative values may be experimentally determined in advance for each of the specific portions SP1-SP3 so that the shadow can be appropriately searched for from various target read images IMt. Furthermore, the widths W1-W3 of the specific portions SP1-SP3 may be adjusted according to the size of the target read image IMt. For example, the width W1 of the first specific portion SP1 may be a value obtained by multiplying the height H of the target read image IMt by a predetermined first coefficient (greater than zero and less than 1). The widths W2 and W3 of the specific portions SP2 and SP3 may be a value obtained by multiplying the width W of the target read image IMt by a predetermined second coefficient (greater than zero and less than 1). The first and second coefficients may be experimentally determined in advance so that the shadow of the book can be appropriately searched for from various target read images.

In S420 (FIG. 8), the processor 310 determines whether or not a shadow is detected from one or more specific portions in S410. If a shadow is detected from one or more specific portions (SS420: Yes), in S425, the processor 310 sets the document type PD to "book" and ends the estimation process.

If no shadow is detected from any of the specific parts SP1-SP3 (S420: No), in S430, the processor 310 determines whether the aspect ratio of the target read image IMt is within the first range Rn1 including the golden ratio RT1. FIG. 9D is an explanatory diagram of the aspect ratio and range. The horizontal axis indicates the aspect ratio RT. In the figure, the target read image IMt representing the document DC and the width W and height H of the target read image IMt are shown. Here, the value obtained by dividing the larger value by the smaller value is adopted as the ratio between the larger value and the smaller value. The aspect ratio RT is calculated by dividing the length of the longer side (here, the height H) of the target read image IMt by the length of the shorter side (here, the width W). As described in FIG. 4B, in this embodiment, the shape of the target read image IMt is approximately the same as the shape of the read document DC. That is, the aspect ratio RT calculated from the height H and width W of the target scanned image IMt is approximately the same as the aspect ratio of the document DC. The processor 310 estimates the document type PD using the aspect ratio RT of the target scanned image IMt, which approximates the aspect ratio of the document DC.

The first ratio RT1 in the figure indicates the golden ratio (called golden ratio RT1). The golden ratio RT1 is expressed as (1 + sqrt(5))/2, which is approximately 1.618 (sqrt(x) is the square root of x). Examples of documents that have an aspect ratio RT close to the golden ratio RT1 include credit cards and business cards. The size of a credit card complies with "ID-1" of the international standard "ISO/IEC7810". The aspect ratio RT of ID-1 is approximately 1.586, which is close to the golden ratio RT1. The first range Rn1 is a range of aspect ratios RT that includes the golden ratio RT1 (greater than or equal to the second threshold RTh2 and less than the first threshold RTh1). The first range Rn1 (i.e., thresholds RTh1, RTh2) is determined in advance so as to include the aspect ratio RT of "ID-1".

The second ratio RT2 in the figure indicates the silver ratio (called the silver ratio RT2). The silver ratio RT2 is expressed as sqrt(2) and is approximately 1.414. Documents with aspect ratios RT close to the silver ratio RT2 are, for example, standard size documents such as A4, A5, B5, and B6. Standard sizes with aspect ratios RT close to the silver ratio RT2 are, for example, the "A, B, C series" of the international standard "ISO216" and the "A, B series" of the Japanese standard "JIS P 0138". The second range Rn2 is the range of aspect ratios RT that includes the silver ratio RT2 (greater than or equal to the third threshold RTh3 and less than the second threshold RTh2). The second range Rn2 (i.e., thresholds RTh2, RTh3) is determined in advance to include the aspect ratios RT of one or more series of standard sizes (for example, two series: ISO216 A series (same as JIS P 0138 A series) and JIS P 0138 B series).

The figure shows a third range Rn3. The third range Rn3 is a range of aspect ratios RT that are equal to or greater than a third threshold RTh3. Documents with aspect ratios RT within the third range Rn3 are elongated documents. Store receipts are well-known examples of such documents.

In S430 (FIG. 8), the processor 310 determines whether the aspect ratio RT is within the first range Rn1. If the aspect ratio RT is within the first range Rn1 (S430: Yes), in S435, the processor 310 sets the document type PD to "card" and ends the estimation process.

If the aspect ratio RT is not within the first range Rn1 (S430: No), in S440, the processor 310 determines whether the aspect ratio RT is within the second range Rn2. If the aspect ratio RT is within the second range Rn2 (S440: Yes), in S445, the processor 310 sets the document type PD to "standard document" and ends the estimation process.

If the aspect ratio RT is not within the second range Rn2 (S440: No), in S450, the processor 310 determines whether the aspect ratio RT is within the third range Rn3. If the aspect ratio RT is within the third range Rn3 (S450: Yes), in S455, the processor 310 sets the document type PD to "store receipt" and ends the estimation process.

If the aspect ratio RT is not within the third range Rn3 (S450: No), in S465, the processor 310 sets the document type PD to "Other" and ends the estimation process.

After the document type PD estimation process (FIG. 5: S315), in S320, the processor 310 determines whether the document type PD is a "store receipt". If "PD = store receipt" (S320: Yes), in S325, the processor 310 selects a reading device with an FB as the recommended reading device RD and ends the selection process. In S325, a candidate reading device that has been arbitrarily selected in advance from candidates CD1, CD4, and CD5 (FIG. 4(C)) that have an FB may be used (for example, the first candidate CD1 for a flatbed scanner). In many cases, ADFs are not compatible with long and narrow receipts. Reading devices with an FB are suitable for reading receipts.

If the document type PD is different from "store receipt" (S320: No), in S330, processor 310 determines whether document type PD is "book". If "PD = book" (S330: Yes), in S333, processor 310 determines whether the multiple selectable candidates CD1-CD5 include a candidate that is newer than the model indicated by the reading device type PA and has an FB (referred to as a new FB candidate). If all candidates CD1, CD4, CD5 that have an FB are older than the model indicated by the reading device type PA, the determination result in S333 is No. In this case, processor 310 sets recommended reading device RD to "none" in S334 and ends the selection process. If the selectable candidates CD1-CD5 include a new FB candidate (S333: Yes), the processor 310 selects the new FB candidate (any of the candidates CD1, CD4, or CD5) as the recommended reading device RD in S335 and ends the selection process. The new FB candidate is suitable for reading books.

If the document type PD is different from "book" (S330: No), in S340 (FIG. 6), the processor 310 determines whether the reading device type PA indicates a camera of a portable device. If the reading device type PA indicates a model of a portable device such as a smartphone, tablet computer, laptop computer, portable game console, or portable digital camera, the determination result of S340 is Yes.

If the determination result in S340 is Yes, in S345, processor 310 determines whether print flag PC is "ON". If PC=ON (S345: Yes), in S352, processor 310 determines whether read count PB is 1. If PB=1 (S352: Yes), processor 310 selects a multifunction device having an FB as a recommended reading device RD in S354 and ends the selection process. In S354, a candidate reading device arbitrarily selected in advance from candidates CD4 and CD5 (FIG. 4(C)) of multifunction devices having an FB may be used (for example, a multifunction device without an ADF (fourth candidate CD4). A multifunction device having an FB is suitable for printing a single scanned image (i.e., copying a single document).

If the determination result in S352 is No (i.e., the number of scans PB is 2 or more), the processor 310 selects the multifunction device with an ADF (here, the fifth candidate CD5) as the recommended scanning device RD in S358, and ends the selection process. A multifunction device with an ADF is suitable for printing two or more scanned images (i.e., copying two or more documents).

If the determination result in S345 is No (i.e., PC=OFF), in S362, processor 310 determines whether document type PD is "card". If "PD=card" (S362: Yes), in S365, processor 310 selects a scanner with an automatic card feeder (here, the third candidate CD3) as the recommended reading device RD, and ends the selection process. Scanners with an automatic card feeder are suitable for reading cards.

If the document type PD is different from "card" in S362 (S362: No), in S372, the processor 310 determines whether the number of reads PB is 1. If PB=1 (S372: Yes), in S374, the processor 310 selects the reading device having FB as the recommended reading device RD and ends the selection process. In S374, a candidate reading device that has been arbitrarily selected in advance from the candidate reading devices CD1, CD4, and CD5 (FIG. 4(C)) having FB may be used (for example, the first candidate CD1 for the flatbed scanner). A reading device having FB is suitable for reading a single document (for example, a standard document) that is different from a receipt, book, or card.

If the determination result in S372 is No (i.e., the number of reads PB is 2 or more), the processor 310 selects the reading device with an ADF as the recommended reading device RD in S378 and ends the selection process. In S378, a candidate reading device that has been arbitrarily selected in advance from the candidates CD2 and CD5 (FIG. 4C) for reading devices with an ADF may be adopted (for example, the second candidate CD2 for a dedicated scan machine with an ADF). A reading device with an ADF is suitable for reading two or more documents (for example, two or more standard documents) that are different from receipts, books, or cards.

If the determination result in S340 is No, the reader type PA indicates a stationary reader. In this case, in S380 (FIG. 7), the processor 310 determines whether or not all of the following conditions 1 to 3 are satisfied.
(Condition 1) The reading device type PA indicates a flatbed scanner.
(Condition 2) The number of reads PB is 2 or more.
(Condition 3) The print flag PC is OFF.

If all of conditions 1-3 are met (S380: Yes), in S385, the processor 310 selects a dedicated scanner with an ADF (here, the second candidate CD2) as the recommended reading device RD, and ends the selection process. A dedicated scanner with an ADF is more suitable for reading documents of two or more pages than a flatbed scanner.

If one or more of conditions 1-3 are not met (S380: No), the processor 310 sets the recommended reading device RD to "None" in S388 and ends the selection process.

As described above, the processor 310 of the server 300 executes the selection process for the recommended reading device RD (FIGS. 5-7). Note that if the determination result of S333 (FIG. 5) is No, and if the determination result of S380 (FIG. 7) is No, the recommended reading device RD is "none". In this case, in S152 (FIG. 2) and S252 (FIG. 3), the processor 310 generates display data including an explanatory text indicating that there is no recommended reading device as data of the specific information. Alternatively, the processor 310 may transmit an instruction to the terminal device 200 to omit display of the specific information in S155 (FIG. 2) and S255 (FIG. 3). In response to this instruction, the application APP may skip displaying the specific information (S160, S260).

As described above, in this embodiment, the processor 310 of the server 300 executes the following process. In S145 (FIG. 2) and S245 (FIG. 3), the processor 310 acquires data of the target read image IMt representing the document DC to be optically read. In S150 (FIG. 2) and S250 (FIG. 3), the processor 310 uses the aspect ratio RT of the target read image IMt to select a recommended reading device RD for optically reading the document DC from among the multiple candidate reading devices CD1-CD5. The aspect ratio RT of the target read image IMt (FIG. 2(C)) is an example of a parameter that is correlated with the aspect ratio of the document DC in the target read image IMt represented by the data of the target read image IMt. In S155 (FIG. 2) and S255 (FIG. 3), the processor 310 outputs specific information Iz1, Iz2 associated with the recommended reading device RD. In this way, the processor 310 selects a recommended reading device RD using an aspect ratio RT that is correlated with the aspect ratio of the document DC, and outputs specific information Iz1 and Iz2 that correspond to the recommended reading device RD, making it possible to recommend an appropriate reading device.

In this embodiment, the server 300 selects the recommended reading device RD and outputs the specific information Iz1 and Iz2. In S150 (FIG. 2) and S250 (FIG. 3), the processor 310 of the server 300 acquires data of the target read image IMt from the terminal device 200. In S150 (FIG. 2) and S250 (FIG. 3), the processor 310 uses the aspect ratio RT of the target read image IMt to select the recommended reading device RD from the multiple candidate reading devices CD1-CD5. In S155 (FIG. 2) and S255 (FIG. 3), the processor 310 outputs the data of the specific information Iz1 and Iz2 to the terminal device 200. Therefore, the user can use the specific information Iz1 and Iz2 by using the terminal device 200.

In addition, in this embodiment, the system 1000 includes a server 300 and a terminal device 200. The terminal device 200 has a digital camera 270 and a display unit 240, and is configured to communicate with the server 300 via a network (e.g., network LN, IT). The processor 210 of the terminal device 200 transmits data of a target read image IMt representing a document DC optically read by the digital camera 270 to the server 300 in S145 (FIG. 2) and S245 (FIG. 3). The processor 310 of the server 300 executes the following processing. In S145 (FIG. 2) and S245 (FIG. 3), the processor 310 acquires data of the target read image IMt from the terminal device 200. In S150 (FIG. 2) and S250 (FIG. 3), the processor 310 uses a parameter (here, the aspect ratio RT) that is correlated with the aspect ratio of the document DC in the target read image IMt represented by the data of the target read image IMt to select a recommended reading device RD for optically reading the document DC from among the multiple candidate reading devices CD1-CD5. In S155 (FIG. 2) and S255 (FIG. 3), the processor 310 outputs the specific information Iz1 and Iz2 associated with the recommended reading device RD to the terminal device 200. In S160 (FIG. 2) and S260 (FIG. 3), the processor 210 of the terminal device 200 causes the display unit 240 to display the specific information Iz1 and Iz2. The user can easily know the recommended reading device RD by observing the specific information Iz1 and Iz2 displayed on the display unit 240 of the terminal device 200.

In addition, in this embodiment, the data of the target read image IMt may be data of an image captured by the digital camera 270 included in the terminal device 200, which is an example of a portable device. In this case, the distance between the digital camera 270 and the document at the time of shooting can be set arbitrarily. That is, the size of the document in the read image can change in various ways. For example, the size of the first document DC1 in the read image IM1 (FIG. 4A) can change in various ways. Therefore, it is not easy to identify the actual size of the document (and thus the document type PD) from the size of the document in the read image. In this embodiment, the processor 310 selects the recommended reading device RD using a parameter (here, the aspect ratio RT) that is correlated with the aspect ratio of the document DC. The actual aspect ratio of the document DC does not change. Therefore, even if the distance between the digital camera 270 and the document DC at the time of shooting changes, the aspect ratio of the document DC in the read image (and thus the correlated parameter) is expected to be stable. Furthermore, the aspect ratio of the document DC varies depending on the type of document DC. Therefore, the processor 310 can select an appropriate recommended reading device RD using the aspect ratio RT, even if the scanned image data is data of an image captured by a digital camera included in a portable device.

Furthermore, when the scanned image data is data of an image captured by a digital camera included in a portable device, the scanned image may have the following problems.
(1) The resolution (i.e., pixel density) of the scanned image is low; (2) the document in the scanned image is distorted; (3) a shadow appears in the scanned image (e.g., the shadow of a portable device, the shadow of the photographer or a fixture holding the portable device, etc.).
(4) Parts of the scanned image that should be white (for example, the margins of a document) are gray, which results in increased consumption of printing materials (ink, toner, etc.) when the scanned image is printed.

Stationary reading devices are often designed with document reading in mind. Various stationary reading devices can reduce the likelihood of one or more of the above defects. Thus, by employing a stationary reading device as a candidate reading device, the processor 310 can select a recommended reading device RD that can reduce the likelihood of one or more of the above defects.

In addition, in this embodiment, the multiple candidate reading devices CD1-CD5 (Figure 4(C)) include a flatbed scanner (candidates CD1, CD4) that is a scanner with a document tray, an automatic feed scanner (candidate CD2) that is a scanner with an automatic feeder that automatically feeds multiple sheets, and a multifunction scanner (CD5) that is a scanner with both a document tray and an automatic feeder. Therefore, the processor 310 can select a recommended reading device RD that is suitable for various document types PD.

In this embodiment, the multiple candidate reading devices CD1-CD5 (FIG. 4C) include an automatic card feed scanner (third candidate CD3) having an automatic card feed device that automatically feeds multiple cards. As described in S430 and S435 (FIG. 8), if the aspect ratio RT of the target read image IMt (FIG. 9C) is within the first range Rn1 (FIG. 9D) that includes the golden ratio RT1 (S430: Yes), the processor 310 sets the document type PD to "card". In this embodiment, the aspect ratio RT of the target read image IMt is approximately the same as the aspect ratio of the document DC. Therefore, the aspect ratio RT within the first range Rn1 indicates that the aspect ratio of the document DC is within the first range Rn1. Furthermore, when a first condition (described later) including the determination result of S430 being Yes is satisfied, the processor 310 selects the automatic card feed scanner (third candidate CD3) as the recommended reading device RD in S365 of Fig. 6. In this embodiment, the first condition includes a type card condition for setting the document type PD to "card" in the estimation process of Fig. 8, and a selection card condition for the process to proceed to S365 in the selection process of Figs. 5 to 7. The type card condition (Fig. 8) includes "S420: No" and "S430: Yes". The selection card condition (Figs. 5 and 6) includes "S320: No", "S330: No", "S340: Yes", "S345: No", and "S362: Yes". Note that "S320: No", "S330: No" and "S362: Yes" regarding the document type PD are satisfied if the type card conditions are met.

In this way, if a first condition is satisfied, including the aspect ratio RT indicating that the aspect ratio of document DC is within a first range Rn1 that includes the golden ratio RT1, the processor 310 can select an automatic card feed scanner suitable for document DC as the recommended reading device RD. By using the recommended reading device RD (i.e., the automatic card feed scanner), a user can properly read a document (e.g., a card such as a credit card or a driver's license).

In this embodiment, the multiple candidate reading devices CD1-CD5 (FIG. 4C) include a scanner having a document tray (candidate reading devices CD1, CD4, CD5). As described in S450 and S455 (FIG. 8), if the aspect ratio RT of the target read image IMt is within the third range Rn3 (S450: Yes), the processor 310 sets the document type PD to store receipt. As shown in FIG. 9D, the third range Rn3 is a range in which the aspect ratio RT is longer and narrower than the golden ratio RT1. The aspect ratio RT within the third range Rn3 indicates that the aspect ratio of the document DC is within the third range Rn3. In addition, if a third condition (described later) is satisfied, including the judgment result of S450 being Yes, the processor 310 selects a scanner having a document tray (for example, the first candidate CD1) as the recommended reading device RD in S325 of FIG. 5. In this embodiment, the third condition includes a type receipt condition for setting the document type PD to "store receipt" in the estimation process of FIG. 8, and a selected receipt condition for the process to proceed to S325 in the selection process of FIGS. 5-7. The type receipt condition (FIG. 8) includes "S420: No", "S430: No", "S440: No", and "S450: Yes". If "S450: Yes", then "S430: No" and "S440: No" are satisfied. The selected receipt condition (FIG. 5) includes "S320: Yes". "S320: Yes" for the document type PD is satisfied if the type receipt condition is satisfied.

In this way, when the aspect ratio of document DC is within the third range Rn3 that is longer and narrower than the golden ratio, processor 310 can select a scanner with a platen as the recommended reading device RD. ADFs often cannot transport long and narrow documents such as store receipts. When using the recommended reading device RD, a user can properly read a document (e.g., a store receipt) by placing the document on the platen.

In this embodiment, the multiple candidate reading devices CD1-CD5 (FIG. 4C) include a scanner having a platen (candidate reading devices CD1, CD4, CD5). Then, as described in S410, S420, and S425 (FIG. 8), if a shadow is detected from any of the specific parts SP1-SP3 of the document DC in the target read image IMt (FIG. 9C) (S420: Yes), the processor 310 sets the document type PD to "book". As described in S410, the detection of a shadow from a specific part indicates that the specific part is darker than other parts of the document DC. Furthermore, if a fourth condition (described later) is satisfied, including the judgment result of S420 being Yes, the processor 310 selects a scanner having a platen (any of the candidates CD1, CD4, CD5) as the recommended reading device RD in S335 of FIG. 5. In this embodiment, the fourth condition includes a type present condition for setting the document type PD to "book" in the estimation process of FIG. 8, and a selection present condition for the process to proceed to S335 in the selection process of FIGS. 5-7. The type present condition (FIG. 8) includes "S420: Yes". The selection present condition (FIG. 5) includes "S320: No", "S330: Yes", and "S333: Yes". Note that "S320: No" and "S330: Yes" related to the document type PD are satisfied if the type present condition is satisfied.

In this way, when a specific portion of document DC (specifically, any of specific portions SP1-SP3) in target read image IMt (FIG. 9C) is darker than other portions of document DC, processor 310 can select a scanner having a platen as recommended reading device RD. ADFs often cannot transport multiple bound sheets. When using recommended reading device RD, a user can properly read a document by placing the document (e.g., a page of an open book) on the platen.

In this embodiment, the multiple candidate reading devices CD1-CD5 (FIG. 4C) include a multifunction device that includes a print execution unit and a reading execution unit (candidates CD4, CD5). Then, as explained in S354 and S358 (FIG. 6), if the sixth condition is satisfied, including that the data of the target read image IMt has been used for printing (S345: Yes), the processor 310 selects the multifunction device (candidates CD4, CD5 in this case) as the recommended reading device RD. In this embodiment, the sixth condition includes "S320: No", "S330: No", "S340: Yes", and "S345: Yes" for moving the process to S354 or S358 in the selection process of FIGS. 5-7.

In this way, when the data of the target read image IMt is used for printing, the processor 310 can select the multifunction device as the recommended reading device RD. When the user uses the recommended reading device RD, the user can use the recommended reading device RD to read the document and print the read image.

B. Second embodiment:
Fig. 10 is a flow chart showing another embodiment of the selection process of the recommended reading device RD. In the figure, the process executed when the determination result of S340 in Fig. 6 is Yes is shown. There are only two differences from the embodiment in Fig. 6. The first difference is that S356 is added between S352 and S358. The second difference is that S376 is added between S372 and S378. The other parts of the selection process are the same as the corresponding parts of the selection process in Figs. 5 to 7. In Fig. 10, the same steps as those in Fig. 6 are given the same reference numerals and the explanation is omitted.

If the determination result in S352 is No (i.e., the number of reads PB is 2 or more), the processor 310 determines in S356 whether the document type PD is a "standard document". If "PD = standard document" (S356: Yes), the processor 310 selects in S358 a multifunction device with an ADF (here, the fifth candidate CD5) as the recommended reading device RD, and ends the selection process.

If the document type PD is different from "standard document" in S356 (S356: No), the processor 310 selects the multifunction device having the FB as the recommended reading device RD in S354 and ends the selection process.

If the determination result in S372 is No (i.e., the number of reads PB is 2 or more), the processor 310 determines in S376 whether the document type PD is a "standard document." If "PD = standard document" (S376: Yes), the processor 310 selects a reading device having an ADF as a recommended reading device RD in S378 and ends the selection process.

If the document type PD is different from "standard document" in S376 (S376: No), the processor 310 selects the reading device having the FB as the recommended reading device RD in S374 and ends the selection process.

As described above, in this embodiment, the multiple candidate reading devices CD1-CD5 (FIG. 4C) include an automatic feed scanner (candidates CD2, CD5), which is a scanner having an automatic feeder that automatically feeds multiple sheets. Then, as explained in S440 and S445 (FIG. 8), if the aspect ratio RT of the target read image IMt (FIG. 9C) is within the second range Rn2 (FIG. 9D) that includes the golden ratio RT2 (S440: Yes), the processor 310 sets the document type PD to "standard document". An aspect ratio RT within the second range Rn2 indicates that the aspect ratio of document DC is within the second range Rn2. Furthermore, when a second condition (described later) is satisfied, including the determination result of S440 being Yes, the processor 310 selects the automatic feed scanner (second candidate CD2 or fifth candidate CD5) as the recommended reading device RD in S358 or S378 of FIG. 10. In this embodiment, the second condition includes a type standard condition for setting the document type PD to "standard document" in the estimation process of FIG. 8, and a selection standard condition for moving the process to S358 or S378 of FIG. 10 in the selection process of FIGS. 5-7 and 10. The type standard condition (FIG. 8) includes "S420: No", "S430: No", and "S440: Yes".

The following standard printing conditions or standard reading conditions are adopted as the selected standard conditions (Figs. 5, 6, and 10). The standard printing conditions include "S320: No (Fig. 5)", "S330: No (Fig. 5)", "S340: Yes (Fig. 6)", "S345: Yes (Fig. 10)", "S352: No (Fig. 10)", and "S356: Yes (Fig. 10)". Note that "S320: No", "S330: No", and "S356: Yes" for document type PD are satisfied if the type standard conditions are satisfied. The standard reading conditions include "S320: No (FIG. 5)," "S330: No (FIG. 5)," "S340: Yes (FIG. 6)," "S345: No (FIG. 10)," "S362: No (FIG. 10)," "S372: No (FIG. 10)," and "S376: Yes (FIG. 10)." Note that "S320: No," "S330: No," "S362: No," and "S376: Yes" related to the document type PD are satisfied if the type standard condition is satisfied.

In this manner, if a second condition is met, including the aspect ratio RT indicating that the aspect ratio of document DC is within a second range Rn2 that includes the golden ratio RT2, processor 310 can select the autofeed scanner as the recommended reading device RD. By using the recommended reading device RD (i.e., the autofeed scanner), a user can properly read documents (e.g., A4 or B5 documents).

C. Third embodiment:
Fig. 11 is a flow chart showing another embodiment of the selection process of the recommended reading device RD. The process shown in Fig. 11 is executed instead of the process shown in Fig. 7. The only difference from the embodiment shown in Fig. 7 is that S380 is replaced with S380c. The other parts of the selection process are the same as the corresponding parts of the selection process shown in Figs. 5 to 7. The selection process of this embodiment is composed of the processes shown in Figs. 5, 6 and 11. The process shown in Fig. 11 may be applied to the embodiment shown in Fig. 10.

In S340 (FIG. 6), if the reader type PA indicates a stationary reader (S340: No), the processor 310 determines in S380c (FIG. 11) whether all of the following conditions Ca to Cd are satisfied.
(Ca) The reader type PA is a stationary reader. (Cb) The document type PD is a "card" or "standard document."
(Cc) The number of reads PB is 2 or more. (Cd) The print flag PC is OFF.

If all conditions Ca-Cd are met (S380c: Yes), in S385, the processor 310 selects a dedicated scan device with an ADF (here, the second candidate CD2) as the recommended reading device RD, and ends the selection process.

If one or more of the conditions Ca-Cd are not satisfied (S380c: No), the processor 310 sets the recommended reading device RD to "None" in S388 and ends the selection process.

As described above, in this embodiment, the multiple candidate reading devices CD1-CD5 (FIG. 4C) include an automatic feed scanner (candidates CD2, CD5) that is a scanner having an automatic feed device that automatically feeds multiple sheets. Then, when the fifth condition including the above conditions Ca-Cd is satisfied, the processor 310 selects the automatic feed scanner (here, the second candidate CD2) as the recommended reading device RD in S385 of FIG. 11. By using the recommended reading device RD (i.e., the automatic feed scanner), the user can properly read a document (e.g., a document of multiple A5 sheets). Note that in this embodiment, the fifth condition includes "S340: No (FIG. 6)" in addition to conditions Ca-Cd. When "S340: No", condition Ca is satisfied.

D. Variations:
(1) The multiple candidate reading devices are not limited to the candidate reading devices CD1-CD5 in FIG. 4(C), and may include various reading devices. For example, a dedicated scanning device having both FB and ADF may be included in the multiple candidates. Also, one or more candidates arbitrarily selected from the candidates CD1-CD5 in FIG. 4(C) may be omitted. Also, multiple models of the same type may be included in the multiple candidates. For example, multiple models of a multifunction device having an ADF and FB may be candidates. In this case, multiple models of the same type may be selected as the recommended reading device RD.

In either case, it is preferable that the processor 310 selects a reading device other than the reading device used to generate the target read image IMt as the recommended reading device RD. For example, if the recommended reading device RD selected in the selection process for the recommended reading device RD is the same model as the model indicated by the reading device type PA, the processor 310 may change the recommended reading device RD to "none."

(2) The generation of the target read data may be performed by an application other than the application APP (e.g., a reading application). For example, the processing of the application APP in the reading process S110 (FIG. 2) may be performed by the reading application. The application APP may perform the processing from S145 onward using the target read data generated by the reading application.

In either case, the scan correction (S135) may be omitted. When the scan correction (S135) is omitted, in the selection process (S150, S250) of the recommended reading device RD, the processor 310 of the server 300 may calculate a parameter (called an aspect ratio parameter) that is correlated with the aspect ratio of the document DC in the target read image by analyzing the target read image. The aspect ratio parameter is not limited to the aspect ratio RT of the target read image IMt, and may be various parameters that are correlated with the aspect ratio of the document DC. For example, the aspect ratio parameter may be the ratio between the length in the first direction Dx and the length in the second direction Dy of the document part (for example, the document part DP1 in FIG. 4A) separated from the read image. This aspect ratio parameter can be used instead of the above aspect ratio RT. In addition, the processor 310 may generate an image of the document from which the background part has been removed by executing the same process as that described in S135 of FIG. 2. Then, the processor 310 may obtain the aspect ratio of the generated image (same as the aspect ratio RT described above) as an aspect ratio parameter.

(3) The server 300 may be omitted from the system 1000 (FIG. 1). In this case, the processing of the server 300 may be executed by the terminal device 200 instead of the server 300. For example, in the read data processing of FIG. 2 and FIG. 3, the processing executed by the server 300 may be executed by the application APP of the terminal device 200. In S145 and S245, the application APP may acquire data of the target read image IMt from the read memory area SR of the non-volatile memory device 230. In S150 and S250, the application APP may execute a selection process of the recommended reading device RD that is the same as the selection process of each of the above embodiments (FIG. 5-7, FIG. 8, FIG. 10, FIG. 11) and each modified example. In S152 and S252, the application APP may generate specific information associated with the recommended reading device RD. S155 and S255 may be omitted. In S160 and S260, the application APP may output data of the specific information to the display unit 240. As a result, the display unit 240 displays the specific information. In this manner, the destination of the specific information output by the application APP may be a display device such as the display unit 240.

(4) The specific information associated with the recommended reading device RD may be various types of information. For example, the specific information may include a message that represents various types of information related to the recommended reading device RD (e.g., model name, specifications, price, etc.). The specific information may also indicate a link to a webpage that sells the recommended reading device RD. Either the message or the link may be omitted from the specific information. The data format of the specific information may also be various formats. For example, the data of the specific information may be image data representing the specific information.

In either case, the specific information may be output in various ways. For example, the processor 310 of the server 300 may transmit data of the specific information to the user's terminal device 200, as in S155 (FIG. 2) or S255 (FIG. 3). The processor 310 may also output data of a message (including the specific information) addressed to the user. The message may be a so-called email or a Short Message Service (SMS). The message may also be a message of a messaging system that transmits and receives information between multiple users. In addition, when the application APP of the terminal device 200 generates the specific information, the application APP may output the specific information to the display unit 240 for display.

(5) The selection process of the recommended reading device RD may be various processes. In S365 of FIG. 6, an automatic card feed scanner is selected. The first condition for this may be various conditions including that the aspect ratio parameter indicates that the aspect ratio of the document DC is within a first range Rn1 including the golden ratio RT1 (referred to as the first criterion condition. For example, S430: Yes (FIG. 8)). The first condition may include only the first criterion condition. That is, when the first criterion condition is satisfied, the first condition may be satisfied regardless of other information and other conditions. For example, even if the reading device type PA indicates a stationary reading device and the print flag PC is "ON", the first condition may be satisfied when the first criterion condition is satisfied. The first condition may include various other conditions in addition to the first criterion condition. The first condition may include, for example, "the reading device type PA indicates a flatbed scanner". Note that the automatic card feed scanner may be selected based on a condition different from the first condition. Additionally, the determination of the first condition and the selection of the automatic card feed scanner based on the first condition may be omitted.

In addition, in S358 or S378 in FIG. 10, the automatic feed scanner is selected. The second condition for this may be various conditions including that the aspect ratio parameter indicates that the aspect ratio of the document DC is within the second range Rn2 including the golden ratio RT2 (referred to as the second criterion condition. For example, S440: Yes (FIG. 8)). The second condition may include only the second criterion condition. For example, the second condition may be satisfied when the second criterion condition is satisfied even if the reading device type PA indicates a stationary reading device and the number of readings PB is 1. The second condition may include various other conditions in addition to the second criterion condition. The second condition may include, for example, "the reading device type PA indicates a flatbed scanner." Note that the automatic feed scanner may be selected based on a condition different from the second condition. Also, the determination of the second condition and the selection of the automatic feed scanner based on the second condition may be omitted.

In addition, in S325 of FIG. 5, a scanner having a document table is selected. The third condition for this purpose may be various conditions including that the aspect ratio parameter indicates that the aspect ratio of the document DC is within a third range Rn3 that is longer and narrower than the golden ratio RT1 (referred to as the third criterion condition. For example, S450: Yes (FIG. 8)). The third condition may include only the third criterion condition. For example, the third condition may be satisfied if the third criterion condition is satisfied even if a shadow is detected from the specific portion SP1-SP3 of the target read image IMt (FIG. 9(C)). The third condition may include various other conditions in addition to the third criterion condition. The third condition may include, for example, "the reading device type PA indicates a camera of a portable device." Note that a scanner having a document table may be selected based on a condition different from the third condition. Also, the determination of the third condition and the selection of a scanner having a document table based on the third condition may be omitted.

In addition, in S335 of FIG. 5, a scanner having a document platen is selected. The fourth condition for this purpose may be various conditions including that a specific portion of the document DC (e.g., any of the specific portions SP1-SP3) in the target read image IMt (FIG. 9C) is darker than other portions of the document (referred to as the fourth criterion condition; for example, S420: Yes (FIG. 8)). The fourth condition may include only the fourth criterion condition. For example, even if the multiple selectable candidates CD1-CD5 do not include a model newer than the model indicated by the reading device type PA, the fourth condition may be satisfied if the fourth criterion condition is satisfied. The fourth condition may include various other conditions in addition to the fourth criterion condition. The fourth condition may include, for example, "the reading device type PA indicates a flatbed scanner." Also, the specific portion used in determining the fourth criterion condition may be one or more specific portions arbitrarily selected in advance from the specific portions SP1-SP3 (FIG. 9C). Note that a scanner having a platen may be selected based on a condition different from the fourth condition. Also, the determination of the fourth condition and the selection of a scanner having a platen based on the fourth condition may be omitted.

Also, the auto feed scanner is selected in S385 of Fig. 11. The fifth condition for this may be various conditions including the following conditions C1-C3.
(C1) The read image data is data of an image read by a stationary scanner.
(C2) The aspect ratio parameters indicate that the aspect ratio of the document DC is within a first range Rn1 including the golden ratio RT1 or within a second range Rn2 including the silver ratio RT2.
(C3) The scanned image data is data generated by scanning a plurality of pages of a document.
Conditions Ca-Cc in S380c in FIG. 11 are examples of conditions C1-C3, respectively. The fifth condition may include only conditions C1-C3. For example, even if the print flag PC is "ON", the fifth condition may be satisfied if conditions C1-C3 are satisfied. The fifth condition may include various other conditions in addition to conditions C1-C3. The fifth condition may include, for example, "the reading device type PA indicates a flatbed scanner." Note that the automatic feed scanner may be selected based on a condition different from the fifth condition. Also, the determination of the fifth condition and the selection of the automatic feed scanner based on the fifth condition may be omitted.

In addition, in S354 and S358 in FIG. 6 and FIG. 10, a multifunction device is selected. The sixth condition for this purpose may be various conditions including that the scanned image data has been used for printing (referred to as the sixth criterion condition. For example, S345: Yes (FIG. 6 and FIG. 10)). The sixth condition may include only the sixth criterion condition. For example, even if the reading device type PA indicates a stationary reading device, the sixth condition may be satisfied if the sixth criterion condition is satisfied. The sixth condition may include various other conditions in addition to the sixth criterion condition. The sixth condition may include, for example, "the number of reads PB is equal to or greater than a threshold value (the threshold value is a predetermined value equal to or greater than 2)." Note that a multifunction device may be selected based on a condition different from the sixth condition. Also, the determination of the sixth condition and the selection of the multifunction device based on the sixth condition may be omitted.

In either case, it is preferable that the selection process of the recommended reading device RD is configured so that a reading device capable of improving work efficiency is selected when the same document DC is read again. Furthermore, the order in which the multiple conditions are judged is not limited to the order shown in Figures 5-7, 8, 10, and 11, and may be in various orders.

(6) In the embodiment of FIG. 9D, the ranges Rn1, Rn2, and Rn3 are configured so as not to overlap with each other. Alternatively, the first range Rn1 and the second range Rn2 may overlap with each other partially. The first range Rn1 and the third range Rn3 may overlap with each other partially. The aspect ratio RT included in the overlapping range of the two ranges may be processed as being included in both ranges. In this case, the document type PD may be set to a type associated with the range referenced in the previous determination. For example, assume that the aspect ratio RT is included in the overlapping range of the first range Rn1 and the second range Rn2. In this case, in S430, which precedes S440 (FIG. 8) that references the second range Rn2, it may be determined that the aspect ratio RT is included in the first range Rn1. Then, in S435, the document type PD may be set to "card" associated with the first range Rn1.

(7) Multiple devices (e.g., computers) that can communicate with each other via a network may share some of the data processing functions of the server 300, and as a whole provide the data processing functions (a system including these devices corresponds to a server).

In each of the above embodiments, a part of the configuration realized by hardware may be replaced by software, and conversely, a part or all of the configuration realized by software may be replaced by hardware. For example, the function of the document type estimation process of S315 in FIG. 5 may be realized by a dedicated hardware circuit.

In addition, when some or all of the functions of the present disclosure are realized by a computer program, the program can be provided in a form stored in a computer-readable recording medium (e.g., a non-transitory recording medium). The program can be used in a state stored in the same or a different recording medium (computer-readable recording medium) from when it was provided. "Computer-readable recording medium" is not limited to portable recording media such as memory cards and CD-ROMs, but can also include internal storage devices within a computer, such as various ROMs, and external storage devices connected to a computer, such as a hard disk drive.

The above examples and modifications can be combined as appropriate. Furthermore, the above examples and modifications are provided to facilitate understanding of the present disclosure and do not limit the present invention. The present invention may be modified or improved without departing from the spirit of the present invention, and equivalents thereof are included in the present invention.

100...Multifunction device, 110...Processor, 115...Storage device, 120...Volatile storage device, 130...Non-volatile storage device, 140...Display unit, 150...Operation unit, 160...Print execution unit, 170...Read execution unit, 180...Communication interface, 200...Terminal device, 210...Processor, 215...Storage device, 220...Volatile storage device, 230...Non-volatile storage device, 240...Display unit, 250...Operation unit, 270...Digital camera, 280...Communication interface, 300...Server, 310...Processor, 315...Storage device, 320...Volatile storage device, 330...Non-volatile storage device, 380...Communication interface, 1000...System

Claims (11)

A computer program comprising:
an acquisition function for acquiring scanned image data representative of a document to be optically scanned;
a selection function for selecting a recommended reading device for optically reading the document from among a plurality of candidate reading devices using a parameter correlated with an aspect ratio of the document in the read image represented by the read image data;
an output function for outputting specific information associated with the recommended reading device;
A computer program that enables a computer to realize the above. 2. A computer program according to claim 1, comprising:
The scanned image data is data of an image captured by a digital camera included in a portable device.
Computer program. A computer program according to claim 1 or 2,
The plurality of candidate reading devices include a flatbed scanner having a document table, an automatic feed scanner having an automatic feeder that automatically feeds a plurality of sheets, and a multi-function scanner having both a document table and an automatic feeder.
Computer program. A computer program according to claim 1 or 2,
the plurality of candidate reading devices includes an automatic card feed scanner having an automatic card feed device that automatically feeds a plurality of cards;
the selection function selecting the automatic card feed scanner as the preferred reading device if a first condition is met including the parameters indicating that the aspect ratio is within a first range that includes the golden ratio;
Computer program. A computer program according to claim 1 or 2,
The plurality of candidate reading devices include an automatic feed scanner, which is a scanner having an automatic feed device that automatically feeds a plurality of sheets;
the selecting function selecting the autofeed scanner as the preferred scanning device if a second condition is met including the parameters indicating that the aspect ratio is within a second range that includes the golden ratio;
Computer program. A computer program according to claim 1 or 2,
the plurality of candidate reading devices includes a scanner having a document table;
the selecting function selects the scanner having the document table as the recommended reading device when a third condition is satisfied, the third condition including the parameter indicating that the aspect ratio is within a third range that is longer and narrower than the golden ratio;
Computer program. A computer program according to claim 1 or 2,
the plurality of candidate reading devices includes a scanner having a document table;
the selecting function selects the scanner having the document table as the recommended reading device when a fourth condition is satisfied, the fourth condition including that a specific portion of the document is darker than other portions of the document in the read image.
Computer program. 2. A computer program according to claim 1, comprising:
The plurality of candidate reading devices include an automatic feed scanner, which is a scanner having an automatic feed device that automatically feeds a plurality of sheets;
the selection function selects the automatic feed scanner as the recommended reading device when a fifth condition is satisfied, the fifth condition including that the read image data is data of an image read by a stationary scanner, that the parameters indicate that the aspect ratio is within a first range including the golden ratio or a second range including the golden ratio, and that the read image data is data generated by reading a plurality of documents.
Computer program. A computer program according to claim 1 or 2,
the plurality of candidate reading devices include a multifunction peripheral including a print execution unit and a read execution unit;
the selecting function selects the multifunction peripheral as the recommended reading device when a sixth condition is satisfied, the sixth condition including that the read image data has been used for printing.
Computer program. A server,
an acquisition unit that acquires scanned image data representing a document to be optically read from a terminal device;
a selection unit that selects a recommended reading device for optically reading the document from among a plurality of candidate reading devices using a parameter that is correlated with an aspect ratio of the document in the read image represented by the read image data;
an output unit that outputs specific information associated with the recommended reading device to the terminal device;
A server comprising: 1. A system comprising:
A server;
a terminal device having a digital camera and a display unit and configured to communicate with the server via a network;
Equipped with
the terminal device includes a transmission unit that transmits scanned image data representing a document optically scanned by the digital camera to the server;
The server,
an acquisition unit that acquires the scanned image data from the terminal device;
a selection unit that selects a recommended reading device for optically reading the document from among a plurality of candidate reading devices using a parameter that is correlated with an aspect ratio of the document in the read image represented by the read image data;
an output unit that outputs specific information associated with the recommended reading device to the terminal device;
Equipped with
The terminal device includes a display processing unit that displays the specific information on the display unit.
system.

Images