JP7447681B2 - Document retrieval system, program and document retrieval method - Google Patents

Description

The present disclosure relates to a document retrieval system, a program, and a document retrieval method.

In conventional document search systems, the main search method has been to search for document data targeted by the user from document data stored in a server or the like based on a character string input by the user. In recent years, document search systems have considered search methods that accept information about image objects other than character strings from users as search items.

The information about the image object includes the classification of the image object (photo, graph, table, etc.), its position, its color information, etc. The document search system searches for document data corresponding to the information about the image object received from the user. do.

According to this, the document search system can search from the memory of the user who viewed the document, and can improve search performance.

In the document image database search method of Patent Document 1, an example is described in which a model document image of document data to be displayed as a search result is generated and the model document image is displayed. According to this, in Patent Document 1, in addition to displaying character strings such as file names as search results, typical images of document data are displayed as model document images (so-called thumbnail images) so that users can search It makes it easy to recognize the results.

Japanese Patent Application Publication No. 09-237282

In a document search system that displays so-called thumbnail images as search results, as in Patent Document 1, the characteristics of the document stored by the user need to match the characteristics of the thumbnail image.

However, a document read by a document reading device or the like and document data generated by reading the document do not necessarily have the same display mode, and the user may It is not always possible to view a document in the same display mode as the document data stored in a server or the like.

For example, when document data is generated by a document reading function such as scanning of a document reading device and then stored on a server, it may be read as monochrome depending on the settings at the time of reading, or it may be read with a watermark or the like added. , the image quality may be adjusted and read.

When searching based on the user's memory of viewing the document before it was read, the document data stored on the server is the document data after the settings were made for reading, so the document search system displays it as a search result. The characteristics of the thumbnail image of the document data to be used are different from the characteristics of the document stored by the user.

As a result, in the document search system, the document in the user's memory and the thumbnail image displayed will be different, and the user will be unable to believe that the document data in the thumbnail image displayed as a search result is the desired document. The problem was that I couldn't figure it out.

The present disclosure was devised in view of the actual situation, and its purpose is to enable the user to read the desired document even if there is a difference in the display mode between the scanned document and the document data due to the settings at the time of reading. An object of the present invention is to provide a document retrieval system, a program, and a document retrieval method that display search results that allow a user to appropriately understand the information.

A document search system according to an aspect of the present disclosure includes a document server that stores a plurality of document data, a document reading device that reads documents stored as document data in the document server, and documents that are input as search items from a search terminal. The document search system includes a search server that searches for a target document from the document server based on components that search the document server. When the document reading device modifies the read document based on the user's settings and uses it as document data, the document reading device outputs information regarding the document before the modification to the search server as modification information. When the search server searches for document data based on the constituent elements of the search item entered on the search terminal and provides the search terminal with a thumbnail image that displays part of the document data in the search results, the search server searches for document data based on the components of the search item entered on the search terminal, and when providing the search terminal with a thumbnail image that displays part of the document data in the search result, change information is For certain document data, a thumbnail image displaying a part of the document before being changed based on the change information is included in the search results and provided to the search terminal.

A program according to an aspect of the present disclosure includes a document server that stores a plurality of document data, a document reading device that reads documents stored as document data in the document server, and a document that is input as a search item from a search terminal. The program is executed in a document search system that includes a search server that searches a document server for a target document based on an element. When the document reading device changes the document read based on the user's settings and uses it as document data, the program outputs information about the document before the change to the search server as change information, and The process of searching document data based on the components of the search item entered on the search terminal, and the search server providing the search terminal with a thumbnail image that displays part of the document data in the search results. For document data that has change information, the process includes a process of including in the search result a thumbnail image displaying a part of the document before being changed based on the change information and providing it to the search terminal.

A document search method according to an aspect of the present disclosure includes a document server that stores a plurality of document data, a document reading device that reads a document stored as document data in the document server, and a document that is input as a search item from a search terminal. and a search server that searches for a target document from the document server based on the constituent elements of the document search method. When the document reading device changes the document read based on the user's settings and uses it as document data, there is a step of outputting information about the document before the change to the search server as change information, and a step of having the search server output the information on the document before the change is made to the search server. A step of searching document data based on the components of the input search item, and a step of providing the search server with change information when the search server includes a thumbnail image displaying a part of the document data in the search result and provides it to the search terminal. For certain document data, the method includes the step of including in the search result a thumbnail image displaying a part of the document before being changed based on the change information and providing the search result to the search terminal.

According to the present disclosure, when a read document is changed to document data, information about the document before the change is output as change information, and a thumbnail image displaying a part of the document data is included in the search results. When providing the document data to the search terminal using the change information, a thumbnail image that displays part of the document before being changed based on the change information is included in the search result and provided to the search terminal, so that the data can be read easily. With this setting, search results are displayed that allow the user to appropriately understand the document that the user is looking for, even if there is a difference in the display mode between the scanned document and the document data.

1 is a diagram showing the overall configuration of a document search system. FIG. 3 is a diagram illustrating an example of change processing from document data. This is an example of how search results are displayed. FIG. 1 is a block diagram illustrating an example of a usage pattern of the overall configuration of a document search system. 1 is a diagram showing the configuration of a document reading device. FIG. 2 is a diagram showing the configuration of a search server. 3 is a flowchart illustrating a processing procedure regarding a reading process of the document reading device. 3 is a flowchart showing a search processing procedure of a search server. FIG. 7 is a diagram illustrating an example in which part of a thumbnail image is used as change information. FIG. 6 is a diagram illustrating an example of displaying estimated files. FIG. 3 is a diagram illustrating an example of a window that explicitly displays document data stored by a document server. FIG. 6 is a diagram illustrating an example of preferentially displaying thumbnail images that match search items received from a user. FIG. 7 is a diagram illustrating an example of displaying thumbnail images with emphasis on change information.

Hereinafter, embodiments of the technical idea according to the present disclosure will be described with reference to the drawings. In the following description, the same parts are given the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated.
[Embodiment 1]
<Overall configuration of document search system>
FIG. 1 is a diagram showing the overall configuration of a document search system 1. As shown in FIG. The document search system 1 of this embodiment searches for a document targeted by the user from among a plurality of documents stored in the document server 20 in response to a search instruction from the user.

The document search system 1 includes a document reading device 10, a document server 20, a search server 30, and a search terminal 40.

The document reading device 10, the document server 20, the search server 30, and the search terminal 40 are configured to be able to communicate via a network. In the document search system 1 of this embodiment, a predetermined application AP is installed in each of the document reading device 10, the document server 20, the search server 30, and the search terminal 40.

The application AP causes the document reading device 10, the document server 20, the search server 30, and the search terminal 40 to cooperate. The application AP provides the user with a function to search for document data that the user desires from among the document data stored in the document server 20, a function to display or print arbitrary document data, and the like.

The document reading device 10 is typically a scanner that reads a document such as an image formed on a sheet as data. In this embodiment, it is a multi-function peripheral (MFP) having a scanner function. In addition to the scanner function, the document reading device 10 is equipped with a plurality of functions such as a copy function, a facsimile function, a network function, a BOX function, an e-mail transmission/reception function, and an external device connection function.

The document reading device included in the document retrieval system 1 is not limited to the document reading device 10, and the document retrieval system 1 may include a plurality of document reading devices.

The document server 20 is a server that stores multiple documents as document data. The document server 20 may be a general-purpose server that has not only the function of storing document data but also other functions. The document search system 1 may include not only the document server 20 but also a plurality of other document servers.

The search server 30 is a server that searches for document data targeted by the user from among a plurality of document data stored in the document server 20. The search server 30 may be a general-purpose server that has not only the function of searching document data but also other functions.

The search server 30 monitors the storage unit included in the document server 20, and when new document data is generated, it generates an index regarding the document data. The index is information for organizing information regarding document data for searching, and improves the speed of searching. The index includes the file name of the document data, the directory, and the character structure within the document, and in this embodiment, particularly includes information regarding components including image objects. The document search system 1 provides search processing using the constituent elements as search items because the index includes information regarding the constituent elements. For example, the search server 30 can receive a search item "contains a red pie chart" from a user, refer to the index, and search for document data "contains a red pie chart." The search server 30 may delete or change the index in response to deletion or change of the document data for which the index has been generated from the document server 20.

The search server 30 searches document data using the index in response to a search instruction from a user. In one aspect, the document server 20 and the search server 30 may be configured as an integrated device, that is, an integrated server.

The search terminal 40 is a terminal for a user to execute a search. The search terminal 40 receives search items from the user and transmits the search items to the search server 30. The search server 30 searches based on the received search items and sends the search results back to the search terminal 40. The search terminal 40 includes a display, and displays search results to the user on the display. The search terminal 40 may be a general-purpose computer that can provide the user with the function of creating document data, or may be a mobile terminal such as a smartphone. The document search system 1 may include not only the search terminal 40 but also a plurality of terminals.

The search terminal 40 includes a document creation application for creating a document. The document creation application is typically an application such as Word or Excel (registered trademark). The document creation application may be not only Word and Excel but also other document creation applications.
<Processing flow>
An example of the overall processing flow in the document search system 1 according to the present embodiment will be described below.

In step S1, the document reading device 10 receives an instruction to read the document SH1 from the user. The reading instruction is an instruction to scan the document SH1 using a scanner included in the document reading device 10 to scan an image formed on a sheet and generate document data. Below, the document reading process performed by the document reading device 10 may be simply referred to as scanning.

The document SH1 is a document in which an image is formed on a sheet using color materials such as toner of a plurality of colors, and components including image objects are formed. For example, the title characters of document SH1 are formed in red. Furthermore, images of a plurality of image objects included in the document SH1 consisting of a table, a bar graph, and a pie chart are formed on the sheet in different colors.

Hereinafter, document data in which color information is set as a component of the document data or a document printed based on the document data may be simply referred to as a color document. On the other hand, document data generated using only monochrome color information instead of a color document, or a document printed based on the document data, is sometimes simply referred to as a monochrome document.

In step S1, the document reading device 10 receives an instruction from the user A to read the document SH1. The document reading device 10 accepts settings for changing a color document to monochrome during a reading process.

In step S2, the document reading device 10 reads the document SH1 as document data D1, which is monochrome document data, and stores it in the document server 20. In this way, the document reading device 10 can generate document data by making changes after reading an image from a document, and can store the document data in the document server 20.

The search server 30 that monitors the document server 20 generates an index for the document data D1 based on the document server 20 receiving and storing the document data D1. The search server 30 generates an index every time new document data is stored in the document server 20. At this time, user A shares document SH1 with user B, who is another user. For example, user A allows other users including user B to view document SH1 as reference material for use in a meeting. User A also transfers document SH1 to user B.

In step S3, user B searches for document data D1 based on the viewed document SH1 or the document SH1 owned by user B. Search terminal 40 receives search items from user B, and user B inputs search items based on the stored information of document SH1. For example, the search terminal 40 accepts from user B that search items include tables, bar graphs, and pie charts.

The search terminal 40 transmits a process for searching document data including tables, bar graphs, and pie charts to the search server 30. The search server 30 uses the index to search for document data that matches the search item from among the plurality of document data stored in the document server 20 that is the search target.

The search server 30 causes the search terminal 40 to display a thumbnail image T1 of the document data D1 and a thumbnail image T2 in which the document data D1 is displayed as a color document as a search result. A thumbnail image refers to a sample that has been reduced in size to improve visibility when displaying an image or printed page. That is, a thumbnail image is an image that displays a portion of document data.

As a result, even if a user who has stored the document SH1, which is a color document, views the monochrome thumbnail image T1, the characteristics are different. It is possible to prevent the document from being determined to be a document. That is, by displaying the thumbnail image T2, which is a color document, as a search result, the document search system 1 can display differences in the display mode between the read document SH1 and the generated document data D1, depending on the settings at the time of reading. To display search results that allow the user to properly understand the document that the user is looking for, even when the user encounters a document.

In particular, if user B who searches after viewing document SH1 is different from user A who caused document SH1 to be read, user B who searches has no way of knowing that document SH1 was read as monochrome, and there is no effect. It is true.

Furthermore, even if user A has read the document SH1, if he performs a search process while viewing the document SH1, which is a color document at hand, he can see that it is the same at first glance when compared with the thumbnail image T2. Therefore, it is easy for the user to understand that this is the document of interest.
<Example of change processing from a document>
FIG. 2 is a diagram illustrating an example of change processing from a document. As described above, the document SH1 is a color document on a sheet medium that includes a plurality of image objects consisting of a display, a bar graph, and a pie chart, and images are formed on sheets in different colors.

The document reading device 10 can generate document data by adding changes when reading the document SH1. Below, an example of change processing that can be performed by the document reading device 10 will be shown.

The document data D1 is document data generated by changing the color document SH1 to monochrome and reading it. The document reading device 10 uses the color change function to generate document data in which the color information included in the read document SH1 is changed to monochrome.

The document reading device 10 can perform monochrome reading and two-color reading using a color change function. Monocolor reading is a reading process that generates document data using only color information of one designated color. The document reading device 10 performs monochrome reading by expressing color differences and gradation levels of a sheet that are observed with the naked eye as shading differences in a single color.

Two-color reading is a reading process that generates document data using color information of only two specified colors. The document reading device 10 sets, for example, all red color information for the parts judged to be colored (other than black) among the color information of the read document, and sets the color information for all parts judged to be black to black. Set color information and generate document data.

The document data D2 is document data generated using a tint block function during reading. The background pattern function is a function that generates document data by setting characters such as "Copy" or "Confidential" in a background pattern for all pages included in the document SH1 so as not to stand out. In FIG. 2, the characters "Copy" are set in the background pattern of document data D2. The characters to be set may be predetermined or may be set by the user.

The document reading device 10 includes not only a tint block function but also a base color function as a background setting function. The base color function is a function that generates document data by adding a specified color to an area recognized as the background of a read document.

The document data D3 is document data whose image quality has been adjusted and read by the image quality adjustment function. As an image quality adjustment function, the document reading device 10 can adjust the brightness, hue, saturation, and contrast of document data generated through reading processing. The document data D3 is document data whose brightness has been adjusted to be darker than the document SH1.

Brightness is an index indicating the degree of brightness of document data. Hue refers to distinct hues such as red, blue, and yellow, and is used to make adjustments such as increasing redness or weakening blueness from among these distinct hues. . Saturation is an index indicating the vividness of a color. Contrast is an index indicating the degree of shading of an image.

The document data D4 is document data generated using a watermark function during reading. The document reading device 10 can add predetermined information to document data using the watermark function. For example, the document reading device 10 can add characters such as "confidential" or "duplication strictly prohibited" to all pages included in the document SH1 or to a predetermined portion of the first page.

The document data D4 is document data in which a watermark WM1 "confidential" is added to the upper right portion of the sheet. The document reading device 10 can use the watermark function to add not only characters such as "confidential" but also date and time to document data generated by the reading process.

The document reading device 10 allows the user to set the date and time to be added as a watermark, such as the date and time when the reading process was performed or the date and time when the file was created. The document reading device 10 can also be set by the user, such as whether to display the date as "Year, Month, Day" or "MM/DD/YYYY", or whether to use the Western calendar or the Japanese calendar. .

The document data D5 is document data generated by a reading process using the overlay function of the document reading device 10. The overlay function is a function that adds an image predetermined by the user to document data. In the document data D5, an overlay OR1 indicating a frame for stamping is added to the document SH1. Using the overlay function, the document reading device 10 can add an image according to the unique needs of the user, such as the words "For Manager Only" or a specific table frame at a predetermined position. .

The document data D6 is document data generated by a reading process using a page aggregation function that aggregates a plurality of read pages of a document into one page of the document data. Page P1 formed in document data D6 indicates the first page of document SH1, and page P2 indicates the second page of document SH1. That is, when the document reading device 10 uses the page aggregation function, the document to be read needs to include a plurality of pages.

The document reading device 10 uses the page aggregation function to arrange the pages of two documents into one page of document data, or arrange the pages of four documents into one page of document data. You can line them up at home.

By using the page aggregation function, the document reading device 10 can reduce the amount of data used by reducing document data representing a plurality of pages.

The document reading device 10 can change the scale of a read document. For example, the document reading device 10 can generate document data in which only the image of page P1 is formed without forming the image of page P2 among the document data D6.

In this way, the document reading device 10 can perform changes that affect the appearance of the read document. Hereinafter, these processes will be referred to as change processes.

As described above, the document reading device 10 is capable of generating document data by adding changes to a read document.
<Display example of search results>
FIG. 3 is a display example of search results. Window W1 is a window displayed on search terminal 40 using application AP. That is, the search terminal 40 receives search items from the user and displays the window W1 as the search results.

A thumbnail image T1 representing the document data D1 is displayed on the left side of the window W1 as a search result.

On the right side of the window W1, if a change process has been performed when the reading process to generate the document data D1 has been performed, an area R1 is displayed. In the area R1, a thumbnail image of the document SH1 before the modification process is performed when it is scanned is displayed. That is, the thumbnail image T2 is displayed as a color document. The date and time of scanning is displayed at the bottom of the thumbnail image T2.

The thumbnail image T1 representing the document data D1 read as monochrome has different characteristics from the document SH1 stored by the user in step S3 of FIG. Therefore, it is difficult for the user B in step S3 to judge that the document data is the one he or she wants by looking only at the thumbnail image T1.

On the other hand, in FIG. 3, a thumbnail image T2 indicating the document that has been read and is before being changed is displayed in the area R1. That is, a thumbnail image T2 indicating the document SH1 stored by user B in step S3 is displayed. Thereby, user B can easily understand that the displayed document data is the document data that he or she wants.

The document search system 1 allows the user to retrieve the desired document even if there is a difference in display mode between the read document SH1 and the document data D1 generated based on the reading process of the document SH1, depending on the settings at the time of reading. Display search results that give users a better understanding of their data.

<An example of how to use the overall configuration>
FIG. 4 is a block diagram illustrating an example of how the overall configuration of the document search system 1 is used. The document search system 1 includes a document reading device 10, a document server 20, a search server 30, and a search terminal 40.

When the document reading device 10 generates document data in which the above-described modification processing is performed on the read document based on a reading instruction from the user, the document reading device 10 outputs information regarding the modification to the search server 30 as modification information.

The change information includes at least either the pre-change thumbnail image or the document data of the read document before undergoing the change process. The change information may include information indicating that the display mode of the document data has been changed or information indicating that predetermined information has been added to the document data.

That is, the change information includes information indicating that all the changes shown in the above-mentioned change examples have been made. For example, the change information may include information indicating that document data of a color document has been read in monochrome. The change information will be explained in detail later.

The search server 30 searches the document data stored by the document server 20 according to the search items received from the search terminal 40. The search server 30 transmits document data matching the search item or document data similar thereto to the search terminal 40 as a search result.

The document reading device 10, the document server 20, the search server 30, and the search terminal 40 may be partially or entirely integrated in terms of hardware configuration.

<Configuration of document reading device>
FIG. 5 is a diagram showing the configuration of the document reading device 10. As shown in FIG. The document reading device 10 includes a control section 100, an operation panel 110, a document data transmission section 120, a change information transmission section 130, and an image reading section 140.

The control unit 100 includes a CPU (Central Processing Unit) 101, a storage unit 102, an image processing unit 103, and a change information generation unit 104.

The CPU 101 executes programs for realizing various functions of the document reading device 10. The CPU 101 may be a built-in CPU, an FPGA (Field-Programmable Gate Array), or a combination thereof.

The storage unit 102 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). The CPU 101 executes or references various programs and data loaded into the RAM.

The image processing unit 103 performs modification processing on a document read by an image reading unit 140, which will be described later. For example, the image processing unit 103 processes a read color document into monochrome document data, or adds a watermark to a read document. The image processing unit 103 transmits document data generated by changing the read document to the document data transmitting unit 120.

The change information generation unit 104 generates change information regarding the document before being changed, based on the document read before the image processing unit 103 performs the change process. The modification information is a thumbnail image showing a portion of the read document before modification processing is performed.

That is, the change information generation unit 104 generates thumbnail images in advance from the document before being subjected to change processing by the image processing unit 103. Hereinafter, this thumbnail image may be referred to as a pre-change thumbnail image.

In the document retrieval system 1 of this embodiment, when the document reading device 10 reads a document after performing the modification process, it generates a pre-modification thumbnail image from the document before the modification process, as shown in FIG. , the thumbnail image T2 of the document before the modification process is displayed.

Further, the change information may be the document data of the read document before the change processing is performed. The search server 30 generates a pre-change thumbnail image from the document data of the read document. If the change information is the document data of the document read before performing the change process, the document reading device 10 may cause the document server 20 to store the document data.

Furthermore, the change information may be information indicating that the document data of a color document has been changed to a monochrome image, information indicating that a watermark has been added to the document data, or information about the details of the change process itself. May contain.

By including the content of the change process in the change information, the search terminal 40 can display the content of the change process to the user.

That is, the change information, which is information about the document before being changed, includes at least the thumbnail image before change or the document data of the read document before being changed.

The document reading device 10 causes the storage unit 102 to temporarily store the change information generated by the change information generation unit 104, and then causes the change information transmission unit 130 to transmit the stored change information.

The operation panel 110 is a display device for receiving various operations of the document reading device 10 from the user. The operation panel 110 is realized by physical keys, a touch panel, etc. The operation panel 110 receives an input command for the document reading device 10 and transmits a signal corresponding to the command to the control unit 100. The operation panel 110 includes a display panel such as an organic EL (Electro Luminescence) monitor or a liquid crystal monitor.

The document data transmitting unit 120 transmits the document data received from the image processing unit 103 to the document server 20.

The change information transmitter 130 transmits the change information generated by the change information generator 104 to the search server 30. After the change information transmitter 130 transmits the change information to the search server 30, the document reading device 10 receives a confirmation signal indicating that the change information has been received from the search server 30. Based on receiving the confirmation signal, the document reading device 10 deletes the change information from the storage unit 102.

Thereby, the document reading device 10 secures a storage area and prevents security from becoming vulnerable due to document data not intended by the user being stored.

The image reading unit 140 is, for example, a device that constitutes a scanner, and reads an image formed on a sheet. The scanner can hold documents such as sheets. After a document such as a sheet is set, the scanner receives a reading instruction and reads an image on the sheet.

<Search server configuration>
FIG. 6 is a diagram showing the configuration of the search server 30. The search server 30 includes a control section 300, a search item receiving section 310, a search result providing section 320, a server communication section 330, an image receiving section 340, and a change information receiving section 350.

The control unit 300 includes a CPU 301, an index storage unit 302, a search unit 303, and a search result generation unit 304.

The CPU 301 can execute programs for implementing various functions of the search server 30. The CPU 301 may be an integrated circuit such as an FPGA. CPU 301 is configured by at least one integrated circuit. An integrated circuit is configured, for example, by at least one CPU, FPGA, or a combination thereof.

The CPU 301 refers to a RAM (not shown) to execute the program. The RAM is, for example, DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory).

The index storage unit 302 is a nonvolatile memory, and stores data used for indexing the document data stored by the document server 20 for each document data. The index storage unit 302 is, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), or a flash memory.

The index storage section 302 includes a change information storage section 3021. The change information storage unit 3021 stores change information received by a change information receiving unit 350 (described later) in association with an index stored for each document data.

That is, the document data whose change information is stored in the change information storage unit 3021 is document data generated from a document read by the document reading device 10.

When the CPU 301 receives information that the document server 20 has newly stored document data from the server communication unit 330 (described later), the CPU 301 generates an index regarding the document data and stores it in the index storage unit 302.

The search unit 303 performs a search process on document data stored in the document server 20 based on search items received by a search item receiving unit 310 (described later).

The search result generation unit 304 generates a thumbnail image of the document data derived as the search result by the search unit 303, and generates screen data to be displayed by the search terminal 40 as the search result.

The search result generation section 304 includes a thumbnail generation section 3041. The thumbnail generation unit 3041 generates a thumbnail image of the document data derived by the search unit 303. In the following, the thumbnail image generated by the thumbnail generation unit 3041 based on the document data stored in the document server 20 may be referred to as a changed thumbnail image.

If the change information received by the change information receiving unit 350 (described later) includes only document data before change of the read document, the thumbnail generation unit 3041 generates a thumbnail image before change from the document data before change. do.

In the search server 30, the thumbnail generation unit 3041 generates a pre-change thumbnail image, and stores the pre-change thumbnail image in the change information storage unit 3021 as change information. After storing the pre-change thumbnail image in the change information storage unit 3021, the search server 30 deletes the document data of the read document before the change. As a result, the search server 30 secures a storage area and prevents security from becoming vulnerable due to document data not intended by the user being stored.

The search item receiving unit 310 receives search items input by the user from the search terminal 40. Search items include, for example, the type, color, and position of the image object. The search terminal 40 receives search items from the user in the form of document data having a red pie chart image object located on the right side of the sheet.

Although the search item receiving unit 310 is illustrated in FIG. 6 as accepting search items only from the search terminal 40, the search item receiving unit 310 may also accept search items from the document reading device 10. Thereby, in the document search system 1, the user can search not only with the search terminal 40 but also with the document reading device 10.

The search result providing unit 320 displays the results searched by the search unit 303. That is, the search result providing unit 320 provides the search terminal 40 with screen data showing the search results generated by the search result generating unit 304.

The server communication unit 330 communicates with the document server 20 that stores document data to be searched.

The image receiving unit 340 receives the document data or its image data from the document server 20 in order to generate a thumbnail image of the document data that is the result of the search by the search unit 303 .

The change information receiving unit 350 receives change information from the document reading device 10 every time the document reading device 10 changes a read document to generate document data. The change information receiving unit 350 stores the received change information in the change information storage unit 3021.

<Reading process procedure of document reading device>
FIG. 7 is a flowchart showing the processing procedure regarding the reading process of the document reading device 10. In the flowchart below, processing after the document reading device 10 receives a reading instruction will be described.

The document reading device 10 determines whether a document is set in the scanner (step S100). When determining that it has not been set (NO in step S100), the document reading device 10 stops the process at step S100.

When the document reading device 10 determines that a document is set in the scanner (YES in step S100), it receives information regarding the reading settings (step S101).

The reading settings include change processing that is set for the document read by the user during reading. That is, it includes all the change processing described above, such as settings for changing a color document to monochrome and settings for adjusting image quality. In addition to change processing, the reading settings include settings such as the number of document data to be generated, encryption settings, and directories to be stored.

The document reading device 10 executes a reading process (step S102). The document reading device 10 reads a document set on a scanner. At this time, the document reading device 10 reads the document set in the scanner as it is and does not perform any modification processing.

The document reading device 10 determines whether the reading settings include a change process (step S103). That is, the document reading device 10 determines whether the reading settings received in step S101 include a change process such as the setting for changing a color document to monochrome as described above.

If it is determined that the reading settings include a change process (YES in step S103), the change information generation unit 104 of the document reading device 10 generates change information, and the change information transmission unit 130 sends the change information to the search server 30. (Step S104). After that, the image processing unit 103 of the document reading device 10 performs change processing according to the reading settings on the document data as image processing (step S105). For example, the image processing unit 103 adds a watermark to document data generated from a read document.

The document data transmitting unit 120 of the document reading device 10 then transmits the document data to the document server 20 (step S106). Here, if change information has been generated, the document data is document data that has been subjected to change processing. For example, the document reading device 10 transmits the watermarked document data to the document server 20, and ends the process.

If it is determined that the reading settings do not include changing processing (NO in step S103), the document reading device 10 transmits the document data of the document read in step S102 to the document server 20 (step S106), and ends the process. .

<Search processing procedure>
FIG. 8 is a flowchart showing the search processing procedure of the search server 30. The search server 30 receives change information from the document reading device 10 (step S200). That is, in step S104 in FIG. 7, the document reading device 10 transmits the change information, and the change information receiving unit 350 of the search server 30 receives the change information.

The search server 30 associates the received change information with the corresponding document data (step S201). That is, the search server 30 associates the received change information with the document data stored in the index storage unit 302 in the change information storage unit 3021. Associate and memorize.

At this time, if document data before modification processing of the read document is received as modification information, the search server 30 generates a thumbnail image before modification from the document data, and uses the thumbnail image before modification as modification information for the document. Store it in association with the data.

The search server 30 determines whether a search instruction has been received (step S202). If a search instruction has not been received (NO in step S202), the search server 30 returns the process to step S200.

When the search instruction is received (YES in step S202), the search server 30 selects document data that matches the search item from among the plurality of document data stored in the document server 20, based on the search item included in the search instruction. Search for. The search server 30 may receive a search instruction from either the document reading device 10 or the search terminal 40. In this embodiment, the search server 30 receives a search instruction via an application AP. In some aspects, search server 30 may receive search instructions via a web browser.

After the search, the search server 30 generates a thumbnail image of the document data to be displayed as a search result (step S204). The thumbnail generation unit 3041 may generate thumbnail images of only the first page of document data to be displayed as a search result, or may generate thumbnail images of all pages. Furthermore, thumbnail images of only pages satisfying the predetermined condition may be generated based on the fact that the predetermined condition is satisfied.

The search server 30 determines whether change information is associated with the document data to be displayed as a search result (step S205). When determining that change information is associated with the document data to be displayed as a search result (YES in step S205), the search server 30, based on the associated change information and the document data to be displayed as a search result, A pre-change thumbnail image is generated (step S206). If a pre-change thumbnail image is associated with the change information, the search server 30 acquires the pre-change thumbnail image from the change information.

The search server 30 provides the post-change thumbnail image and the pre-change thumbnail image to the search terminal 40 as search results (step S207), and ends the process.

If it is determined that the change information is not associated with the document data to be displayed as a search result (NO in step S205), the search server 30 provides the thumbnail image generated in step S204 to the search terminal 40 as a search result. (Step S207), the process ends.

In this way, when the thumbnail image before change is stored as change information, the search server 30 includes the thumbnail image before the change process is applied to the document data displayed as a search result. Therefore, the search server 30 can generate thumbnail images in the same display mode as the display mode scanned in the past.

As a result, as shown in FIG. 3, the document retrieval system 1 of the present embodiment can perform the following operations even if there is a difference in the display mode between the read document SH1 and the generated document data D1 due to the settings at the time of reading. Display search results that allow users to properly understand the documents they are looking for.

The configuration of the document search system 1 of this embodiment will be described below.
<Example of using part of a thumbnail image as change information>
FIG. 9 is a diagram showing an example in which part of a thumbnail image is used as change information. The modification information includes at least the thumbnail image before modification or the document data of the read document itself before modification processing is performed. Instead of the thumbnail image before change, the change information may be only a portion of the thumbnail image before change that has been affected by the change process. That is, the document reading device 10 sets the change information as an image of only the portion of the thumbnail image that displays the part of the document before the change, in which the change is reflected. In the following, the portion in which the change is reflected will be referred to as a difference image.

FIG. 9 shows an example in which a watermark is added to the document SH2 and the reading process is executed. The document reading device 10 generates document data D7 by adding a "confidential" watermark to the read document SH2.

The document reading device 10 stores the document data D7 in the document server 20. The document reading device 10 transmits the change information to the search server 30. In FIG. 9, the change information is a difference image DI1 that shows a portion of the unchanged thumbnail image of the document SH2 before the watermark is added. In addition to the difference image DI1, the change information includes information that a watermark has been added.

That is, the document reading device 10 transmits only the thumbnail image of the portion to which the watermark is added to the search server 30 as change information. That is, as shown in FIG. 9, the document reading device 10 transmits the difference image DI1 of the upper right corner of the document SH2 to the search server 30.

The search server 30 stores the difference image DI1, which is the change information, in association with the index of the document data D7.

In response to the search instruction, the search server 30 displays the document data D7 from the document server 20 as a search result shown in a window W2. The search server 30 generates a thumbnail image T1 based on the document data D7 received from the document server 20.

The search server 30 superimposes the difference image DI1 on the thumbnail image T1. The search server 30 thereby generates a thumbnail image T2 of the document SH2 before the modification process is performed.

As a result, in the document search system 1, only a necessary part of the thumbnail image can be used as change information without using the entire thumbnail image as change information, and data capacity can be saved.

Furthermore, since the change information includes information indicating that a watermark has been added, the search server 30 can display "WM has been added" in the area R1.

Thereby, the document search system 1 can display in text what kind of modification processing has been performed on the scanned document data, making it easier for the user to understand the difference between the thumbnail image T1 and the thumbnail image T2.

<Example of displaying estimated files>
FIG. 10 is a diagram showing an example of displaying estimated files. Window W3 in FIG. 10 is a window in which region R2 is added to window W1 in FIG.

In FIG. 10, the estimated file is displayed as a search result in area R2. The estimated file is a file that is the source of the document SH1 that is read in order to generate the document data D1.

That is, as shown in step S1 in FIG. 1, document data D1 is generated by the document reading device 10 reading a document SH1 owned by user A. Here, the document SH1 is a sheet of paper media, but there is a possibility that the document SH1 itself is a sheet printed based on document data stored in the document server 20.

The document reading device 10 analyzes the constituent elements of the document data D1 when displaying the thumbnail image T1. For example, the document reading device 10 analyzes that the document data D1 includes a table at the center position, a pie chart at the lower left, and a bar graph at the lower right.

Similarly, the document reading device 10 searches the document data stored in the document server 20 to determine whether there is document data that includes a table in the center position, a pie chart in the lower left corner, and a bar graph in the lower right corner.

The search server 30 derives document data D1' having the same components as the document data D1. In FIG. 10, document data D1' is the document data that is the source of document SH1. That is, before step S1 shown in FIG. 1, the user of the document search system 1 prints the document SH1 based on the document data D1' stored in the document server 20. Thereafter, in step S1 shown in FIG. 1, the document reading device 10 is executed by the user A to read the document SH1.

As shown in FIG. 10, the search server 30 displays the derived document data D1' as the estimated file that is the source of the document SH1 as a search result. As a result, for example, if the document data D1 is a file in an uneditable format, the document data D1' may be a file in an editable format, improving convenience for the user.

For example, the document data D1 read by the document reading device 10 may be a file in an uneditable format such as JPEG (Joint Photographic Experts Group), PNG (Portable Network Graphics), or PDF (Portable Document Format). . On the other hand, the document data D1' that has been stored in the document server 20 for the longest time may be an editable file created using Word, Excel (registered trademark), or the like. The document search system 1 can provide users with files in an editable format.

According to this, the document search system 1 can display files in an editable format to the user by including and displaying the estimated files in the search results as shown in FIG. Improved convenience.

<Example of search results window>
FIG. 11 is a diagram showing an example of a window that explicitly displays document data stored in the document server 20. Window W4 is a window that displays search results on search terminal 40 or document reading device 10.

Window W4 in FIG. 11 displays the same thumbnail images as thumbnail image T1, thumbnail image T2, and thumbnail image T3 displayed in window W3 shown in FIG. 10. That is, the thumbnail image T1 is a changed thumbnail image indicating the document data D1. Thumbnail image T2 is a pre-change thumbnail image showing document SH1. The thumbnail image T3 is a thumbnail image indicating the document data D1' which is the estimated file.

In FIG. 11, document data D1 stored in the document server 20 is explicitly displayed.
That is, in FIG. 11, a character display WD1 such as "document in server" is provided above the thumbnail image T1 of the document data D1, and a colored frame FR1 is further provided around the thumbnail image T1.

In this way, when the search result generation unit 304 of the search server 30 displays both the thumbnail image of the document data stored in the document server 20 and the changed thumbnail image, the search result generation unit 304 selects which thumbnail image It is clearly displayed whether the image is a thumbnail image currently stored in the document server 20.

This makes it possible to easily distinguish the pre-change thumbnail images including the thumbnail image T2 and the thumbnail image T3 from the thumbnail image indicating the estimated file, and the document retrieval system 1 allows the user to view the information currently stored in the document server 20. It is possible to easily understand the document data in the document.

The search server 30 may display only one thumbnail image T1, thumbnail image T2, and thumbnail image T3 instead of displaying them side by side as shown in window W4. The search server 30 displays only the thumbnail images T1 currently stored in the document server 20 on the search terminal 40.

When the user selects the thumbnail image T1, the search terminal 40 displays the thumbnail image T2 in the same area where the thumbnail image T1 was displayed. Further, when the user selects the thumbnail image T2, the search terminal 40 displays the thumbnail image T3 in the same area where the thumbnail image T2 was displayed.

In this way, in the document search system 1, when a plurality of thumbnail images corresponding to document data are generated, the thumbnail images may be switched and displayed by selecting one.

As a result, the document search system 1 can display multiple thumbnail images in a small display area, and by switching and displaying thumbnail images in the same area, it is possible to identify which part of the thumbnail image has been modified. It can be easily understood.

FIG. 12 is a diagram illustrating an example of preferentially displaying thumbnail images that match the search items received from the user. Window W5 is a window that displays search results on search terminal 40 or document reading device 10.

The search query Q1 shown in FIG. 12 is a search query generated based on search items that the search terminal 40 or the document reading device 10 receives from the user.

The user inputs as search items that a pie chart exists at the bottom of the data, a bar graph exists at the bottom of the data, and that the document is a color document.

When the search item receiving unit 310 receives the above-mentioned search item, the search server 30 generates a search query Q1 based also on the search item. The search server 30 executes the search query Q1, taking into consideration not only the index stored in the index storage unit 302 but also the change information stored in the change information storage unit 3021. That is, in the document search system 1, the search process shown in FIG. 12 can be performed only when the change information includes information indicating the content of the change process.

In the example of FIG. 12, the document data D1 is document data in which a pie chart exists at the bottom of the data and a bar graph exists at the bottom of the data, so some of the search items other than the color document are matches. The search server 30 executes a search on the change information stored in the change information storage unit 3021.

The change information includes information that the document data D1 has been read after being changed to monochrome. That is, since the thumbnail image T2 before change is a color document, the search server 30 can determine that the thumbnail image T2 before change is a document that matches all the search items input by the user.

If the change information includes information that matches the search item, the search server 30 displays the thumbnail image corresponding to the change information with priority over other thumbnail images.

That is, if some of the search items match the change information, there is a high possibility that the user viewed the document before the change. In other words, in the example of FIG. 12, it is highly likely that the user viewed document SH1, which is a color document, and entered the search item.

Therefore, the search server 30 preferentially displays the thumbnail image T2 corresponding to the document SH2 that is highly likely to have been viewed by the user. Displaying with priority includes, for example, displaying a thumbnail image larger than other thumbnail images or displaying it with a frame so that it stands out more than other thumbnail images, as shown in FIG. 12. .

As a result, the document search system 1 can prioritize and display documents that the user has actually viewed as search results, and even if the correct document data is being searched, the document may not be the one that the user is looking for. This prevents people from making such judgments.

FIG. 13 is a diagram illustrating an example of displaying thumbnail images with emphasis on change information. Window W6 is a window that displays search results on search terminal 40 or document reading device 10.

FIG. 13 shows an example in which a modification process in which a watermark is added and a modification process in which the document is read in monochrome are performed during the reading process. Therefore, unlike the thumbnail image T2 before the change, the thumbnail image T1 stored in the document server 20 is displayed in monochrome, and a watermark "Confidential" is displayed.

As shown in FIG. 13, when generating the thumbnail image T1 of the document data D1 stored in the document server 20, the search server 30 generates the thumbnail image T1 by emphasizing the content of the change information, and displays it as a search result. let

For example, the search server 30 displays a display EMM1 in which the watermark is highlighted with a frame attached to the thumbnail image T1 to which the watermark has been added. Thereby, the document search system 1 can easily make the user understand that the thumbnail image T1 is a thumbnail image indicating a document to which a watermark of "confidential" has been added.

Further, the search server 30 displays, for example, a colored frame FR1 around the thumbnail image T1 of the document data D1 that has been read as monochrome. Thereby, the document retrieval system 1 allows the user to compare the color added to the frame FR1 with the monochrome color of the thumbnail image T1, and allows the user to easily understand that the thumbnail image T1 is a thumbnail image indicating a document output as monochrome. can be done.
<Displaying the same thumbnail image>
In the document search system 1, the number of document data that the search server 30 displays as a search result is not limited to one. That is, it is assumed that the search server 30 searches for a plurality of document data items from among the document servers 20 that match the search item input by the user.

The search server 30 generates a thumbnail image before change and a thumbnail image after change for each document data. That is, the search server 30 can provide the search terminal 40 with a plurality of thumbnail images for one document data.

Here, if the document server 20 stores a plurality of the same document data as different document data, the generated thumbnail images may be the same thumbnail images even though they each correspond to different document data. It can be.

In addition, if there are multiple pieces of document data that have the same cover, which is the first page, but different second and subsequent pages, and a thumbnail image of the first page is generated, each thumbnail image that is generated is different from the document data. The thumbnail images may be the same even though they are compatible.

When the search server 30 determines that the same thumbnail images are included among the plurality of generated thumbnail images, the search server 30 displays these thumbnail images together as one thumbnail image on the search terminal 40.

When the user selects a thumbnail image to which multiple pieces of document data are associated, the search terminal 40 displays a new pop-up screen or the like to display the file names, etc. of the multiple pieces of associated document data. You may.

As a result, the document search system 1 makes it easier for the user to search for desired document data without arranging multiple thumbnail images on the screen of the search terminal 40 even though they are the same thumbnail image. Improves sex.
<Example where document data includes multiple pages>
The document data stored in the document server 20 may include multiple pages.

When generating the changed thumbnail image based on the change information, the search server 30 may generate only the thumbnail image of the page on which the change information is reflected among the plurality of pages of the document data.

For example, if information that a watermark has been added to the first page is stored as the change information, the search server 30 generates the first page of the document data as a pre-change thumbnail image and sends it to the search terminal 40. provide.

Furthermore, if the change information includes information that a predetermined image was added only to the last page by the overlay function, for example, the search server 30 stores the last page of the document data as the pre-change thumbnail image. It is generated and provided to the search terminal 40.

In this manner, by displaying pages on which change information is reflected as thumbnail images, the document search system 1 allows the user to easily understand the differences between the thumbnail images.

When the document data includes a plurality of pages, the search server 30 may generate thumbnail images corresponding to all the pages and display all the pages on the search terminal 40.

Furthermore, when displaying a plurality of document data as search results and the search item entered by the user does not match the change information, the search server 30 displays the change information of each of the plurality of document data. The page may be generated as a thumbnail image.

For example, assume that the search terminal 40 inputs document data in which a red pie chart exists as a search item. The search server finds document data D8 and document data D9 from the document server 20 using the index, assuming that the red pie chart exists.

Document data D8 is associated with change information that was previously output with a date watermark added only to the first page. Document data D9 is associated with change information that was previously output with an overlay added only to the third page.

In this case, the search server 30 displays the thumbnail image of the first page of the document data D8 and the thumbnail image of the third page of the document data D9 side by side.

As a result, even when displaying the document data D8 and the document data D9 on the search terminal 40 at the same time, the search server 30 can display pages that reflect the change information characteristic of each as a thumbnail image. , users can easily understand the differences between document data.

<Summary>
As described above, the document search system 1 according to the present embodiment includes the document server 20 that stores a plurality of document data, the document reading device 10 that reads documents stored as document data in the document server 20, and the search terminal 40. This is a document search system that includes a search server that searches for a target document from the document server 20 based on constituent elements constituting a document input as a search item. When the document reading device 10 changes the read document based on the user's settings and uses it as document data, it outputs information regarding the document before the change to the search server 30 as change information. When the search server 30 searches for document data based on the constituent elements of the search item input at the search terminal 40 and provides the search result including a thumbnail image displaying a part of the document data to the search terminal 40, For document data with change information, a thumbnail image displaying a part of the document before being changed based on the change information is included in the search results and provided to the search terminal.

According to this, when a read document is changed to document data, information about the document before the change is output as change information, and a thumbnail image that displays part of the document data is included in the search results. When providing document data to a search terminal, a thumbnail image that displays part of the document before being changed based on the change information is included in the search results for document data that has change information, and is provided to the search terminal. Even if there is a difference in the display mode between the read document and the document data depending on the settings, search results are displayed that allow the user to appropriately understand the document that the user is looking for.

Further, the change information outputted by the document reading device 10 to the search server 30 includes document data of the read document before being changed.

According to this, the pre-change thumbnail image can be generated at the search server.
Furthermore, when the search server 30 generates a thumbnail image displaying a part of the document before being changed using the document data of the read document received from the document reading device 10 before being changed, the search server 30 generates a thumbnail image of the read document. Delete the document data before changing it.

According to this, security is ensured by preventing document data not intended by the user from being retained, and storage space is secured.

Further, the change information that the document reading device 10 outputs to the search server 30 is an image of only the portion of the thumbnail image that displays the part of the document before the change, in which the change is reflected.

According to this, in the document search system 1, only a necessary part of the thumbnail image can be used as change information without using the entire thumbnail image as change information, and it is possible to save data capacity.

Furthermore, the search server 30 searches the document server for document data that is the source of the read document, and displays the source document data included in the search results.

According to this, the document search system 1 can display files in an editable format to the user by including and displaying the estimated files in the search results as shown in FIG. Improved convenience.

Further, the change information includes information indicating that the display mode of the document data has been changed or information indicating that predetermined information has been added to the document data.

According to this, in the document search system 1, the document reading device 10 can display information indicating the content of the change process as a search result.

Furthermore, the information indicating that the display mode of the document data has been changed includes image quality adjustment information that adjusts at least one of brightness, hue, and saturation, resolution conversion information that converts resolution, and multiple Page aggregation information that aggregates pages into one sheet, base color information that changes the background color, color change information that changes color information to monochrome, two-color, monocolor, predetermined multiple colors, etc. Information indicating that predetermined change information has been added to document data, including negative/positive reversal information for reversing white and black, includes background pattern setting information for setting a background pattern, date or predetermined characters, etc. This includes watermark setting information for setting a watermark, and image synthesis information for synthesizing a predetermined image with document data.

According to this, the document search system 1 can display information indicating various modification processes of the document reading device 10 as a search result.

Furthermore, when the search terminal 40 displays both a thumbnail image displaying a part of document data and a thumbnail image displaying a part of the document before modification as a search result, which thumbnail image is displayed on the document server 20. Displays whether the image is a thumbnail image that displays part of the stored document data.

According to this, the document search system 1 can explicitly display the document data currently stored in the document server 20 to the user, and can easily distinguish it from the thumbnail image before change. can.

Furthermore, when displaying a thumbnail image that displays a part of the document before modification as a search result, the search terminal 40 displays the modification information with emphasis.

According to this, the document search system 1 can easily indicate to the user the location where the change information has been reflected.

Furthermore, when the same thumbnail images displaying parts of different document data are provided from a plurality of search servers, the search terminal 40 displays the same thumbnail images together as one thumbnail image.

According to this, the display area can be saved.
Furthermore, the search server 30 searches document data based on whether the change information matches the search items received from the user, and the search terminal 40 searches document data based on the change information that matches the search items received from the user. When displaying a thumbnail image that shows a part of the document before the change, the thumbnail image is displayed with priority over other thumbnail images.

According to this, documents viewed by the user are inferred using search items, and thumbnail images that are likely to have been viewed by the user are prioritized and displayed.

Furthermore, when the document data includes a plurality of pages, the search server 30 provides the search terminal 40 with thumbnail images of pages that reflect change information that matches the search item received from the user.

According to this, in the document search system 1, by using thumbnail images of pages in which characteristic change information is reflected, it is possible for the user to understand change processing performed on document data.

In addition, when the search server 30 provides the search terminal 40 with a plurality of document data that includes a plurality of pages and does not match the search items accepted from the user, the search server 30 determines that there is different change information among the plurality of document data. In this case, the search terminal 40 is provided with a thumbnail image of a page that reflects the change information of each document data.

According to this, the document search system 1 allows the user to easily understand the differences between document data.

Furthermore, when a plurality of thumbnail images are provided from the search server 30 and the user selects a thumbnail image, the search terminal 40 switches the thumbnail image to another thumbnail image and displays it.

According to this, the document search system 1 can display a plurality of thumbnail images in a small display area, and by switching and displaying thumbnail images in the same area, it is possible to determine which part of the thumbnail image has been changed. It is possible to easily understand whether the

Further, the document server 20 and the search server 30 are configured as an integrated device.
According to this, the configuration of the document search system 1 can be simplified.

Further, based on the document server 20 that stores a plurality of document data, the document reading device 10 that reads documents to be stored as document data in the document server 20, and the constituent elements constituting the document input as a search item from the search terminal 40, This program is executed by the document search system 1, which includes a search server that searches for a target document from the document server 20. When the document reading device 10 changes a document read based on the user's settings and uses it as document data, the program outputs information about the document before the change to the search server 30 as change information, and performs a search. A process of causing the server 30 to search for document data based on the constituent elements of the search item input on the search terminal 40, and a process in which the search server 30 includes a thumbnail image that displays a part of the document data in the search result and sends it to the search terminal 40. When providing the document data, for document data for which there is change information in the search server 30, a process of including a thumbnail image displaying a part of the document before being changed based on the change information in the search result and providing it to the search terminal 40. include.

According to this, when a read document is changed to document data, information about the document before the change is output as change information, and a thumbnail image that displays part of the document data is included in the search results. When providing document data to a search terminal, a thumbnail image that displays part of the document before being changed based on the change information is included in the search results for document data that has change information, and is provided to the search terminal. Even if there is a difference in the display mode between the read document and the document data depending on the settings, search results are displayed that allow the user to appropriately understand the document that the user is looking for.

Also, based on the document server 20 that stores a plurality of document data, the document reading device 10 that reads documents to be stored as document data in the document server 20, and the constituent elements constituting the document input as a search item from the search terminal 40, This document search method includes a search server 30 that searches a document server 20 for a target document. The document search method includes the steps of, when the document reading device 10 changes a read document based on the user's settings and uses it as document data, outputting information regarding the document before the change to the search server 30 as change information. , a step of causing the search server 30 to search for document data based on the constituent elements of the search item input on the search terminal 40; 40, for document data for which there is change information in the search server 30, a step of including in the search result a thumbnail image displaying a part of the document before being changed based on the change information and providing it to the search terminal 40; ,including.

According to this, when a read document is changed to document data, information about the document before the change is output as change information, and a thumbnail image that displays part of the document data is included in the search results. When providing document data to a search terminal, a thumbnail image that displays part of the document before being changed based on the change information is included in the search results for document data that has change information, and is provided to the search terminal. Even if there is a difference in the display mode between the read document and the document data depending on the settings, search results are displayed that allow the user to appropriately understand the document that the user is looking for.

The embodiments disclosed this time should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims rather than the above description, and it is intended that all changes within the meaning and range equivalent to the claims are included.

1 document search system, 10 document reading device, 20 document server, 30 search server, 40 search terminal, 100, 300 control unit, 102 storage unit, 103 image processing unit, 104 change information generation unit, 110 operation panel, 120 document data Transmission unit, 130 Change information transmission unit, 302 Index storage unit, 303 Search unit, 304 Search result generation unit, 310 Search item reception unit, 320 Search result provision unit, 330 Server communication unit, 340 Image reception unit, 350 Change information reception section, 3021 change information storage section, 3041 thumbnail generation section, A, B user, AP application, DI1 image, FR1 frame, OR1 overlay, P1, P2 page, Q1 search query, R1, R2 area, SH1, SH2 document, T1 , T2, T3 thumbnail image, W1, W2, W3, W4, W5, W6 window, WD1 character display, WM1 watermark.

Claims (17)

a document server that stores a plurality of document data; a document reading device that reads documents to be stored as document data in the document server; A document search system comprising a search server that searches for a target document,
The document reading device includes:
When a read document is changed based on the user's settings and converted into document data, information about the document before the change is output to the search server as change information,
The search server is
searching document data based on the constituent elements of the search item input on the search terminal;
When the search results include a thumbnail image that displays part of the document data and are provided to the search terminal, for document data that has the change information, the part of the document before being changed based on the change information is displayed. A document search system that includes thumbnail images in the search results and provides them to the search terminal. 2. The document search system according to claim 1, wherein the change information outputted by the document reading device to the search server includes document data of the read document before being changed. When the search server generates a thumbnail image displaying a part of the document before modification using the document data before modification of the read document received from the document reading device, the search server performs modification of the scanned document. The document search system according to claim 2, wherein previous document data is deleted. The change information outputted by the document reading device to the search server is an image of only a portion of a thumbnail image displaying a part of the document before the change, in which the change is reflected. The document search system according to any one of the items. 5. The search server according to claim 1, wherein the search server searches the document server for document data that is the source of the read document, and displays the source document data by including it in the search results. Document retrieval system described. 6. The change information includes information indicating that the display mode of the document data has been changed or information indicating that predetermined information has been added to the document data. document retrieval system. The information indicating that the display mode of the document data of the change information has been changed includes image quality adjustment information for adjusting at least one of brightness, hue, and saturation, resolution conversion information for converting resolution, and a plurality of pages. page aggregation information that aggregates the background color into one sheet, base color information that changes the background color, color change information that changes the color information to monochrome, two-color, monocolor, predetermined multiple colors, etc., white Contains negative/positive reversal information that inverts the black color,
The information indicating that predetermined information in the change information has been added to the document data includes tint block setting information for setting a tint block, watermark setting information for setting a watermark such as a date or predetermined characters, 7. The document retrieval system according to claim 6, further comprising image compositing information for composing a predetermined image with document data. When the search terminal displays both a thumbnail image displaying part of document data and a thumbnail image displaying a part of the document before modification as the search result, which thumbnail image is stored in the document server. 8. The document retrieval system according to claim 1, wherein the document retrieval system displays whether the thumbnail image is a part of the document data currently displayed. The search terminal according to any one of claims 1 to 8, when displaying a thumbnail image displaying a part of the document before modification as the search result, displays the modification information with emphasis. Document retrieval system. 10. The search terminal according to claim 1, wherein when the same thumbnail images displaying parts of different document data are provided from a plurality of search servers, the search terminal displays the same thumbnail images collectively as one thumbnail image. The document search system according to item 1. The search server searches document data based on whether the change information matches the search item received from the user,
When displaying a thumbnail image that displays a part of the document before modification, which is formed based on the modification information that matches the search item received from the user, the search terminal may replace the thumbnail image with other thumbnail images. The document search system according to any one of claims 1 to 10, wherein the document search system displays the document with priority over the document search system. 12. The search server according to claim 1, wherein when the document data includes a plurality of pages, the search server provides the search terminal with a thumbnail image of a page in which the change information that matches the search item received from the user is reflected. The document search system according to any one of the items. When the search server provides the search terminal with a plurality of document data that includes a plurality of pages and does not match the search item received from the user, the search server provides the change information that is different between the plurality of document data. 13. The document search system according to claim 1, wherein the document search system provides the search terminal with a thumbnail image of a page that reflects the change information of each document data. Claims 1 to 13, wherein the search terminal is provided with a plurality of thumbnail images from the search server, and when a user selects a thumbnail image, switches the thumbnail image to another thumbnail image and displays the thumbnail image. The document search system according to any one of the above. The document search system according to any one of claims 1 to 14, wherein the document server and the search server are configured as an integrated device. a document server that stores a plurality of document data; a document reading device that reads documents to be stored as document data in the document server; A program executed in a document search system including a search server that searches for a target document,
The program is
When the document reading device changes the document read based on the user's settings and uses it as document data, a process of outputting information regarding the document before the change to the search server as change information;
a process of causing the search server to search document data based on the constituent elements of the search item input at the search terminal;
When the search server provides the search terminal with a thumbnail image displaying a part of the document data in the search results, the document data for which the search server has the change information is changed before being changed based on the change information. including a thumbnail image displaying a part of a document in the search result and providing it to the search terminal. a document server that stores a plurality of document data; a document reading device that reads documents to be stored as document data in the document server; A search server for searching a target document, the document search method comprising:
When the document reading device changes the document read based on the user's settings and uses it as document data, outputting information regarding the document before the change to the search server as change information;
causing the search server to search document data based on the constituent elements of the search item input at the search terminal;
When the search server provides the search terminal with a thumbnail image displaying a part of the document data in the search results, the document data for which the search server has the change information is changed before being changed based on the change information. a document search method, comprising the step of: including a thumbnail image displaying a part of a document in the search result and providing it to the search terminal.

Images