JP5355345B2 - Document browsing system and control method thereof - Google Patents

Description

  The present invention relates to a document browsing system including a document distribution device that distributes an image file that represents a document image, and a document browsing device that browses the document image, and a control method thereof.

  Distribute in-house document files (electronic files created by application software such as document creation software, spreadsheet software, and presentation software) to mobile devices so that they can be viewed outside the company. Document browsing systems are known. In recent years, with the increasing awareness of corporate compliance, so-called thin client systems have been actively developed to prevent the leakage of confidential information by preventing distributed data from remaining on mobile terminals.

  In such a thin client document browsing system, a document file is converted into an image file for each page and distributed, and an image corresponding to the image file (hereinafter referred to as a document image) is displayed, thereby allowing a document image to be transmitted. A method of browsing the contents of a document file is often used. In an image file, information such as text (characters or character strings) and charts cannot be edited. Therefore, if the document image is browsed as described above, the information is copied and remains on the mobile terminal. Can be prevented.

  However, if the contents of the document file are viewed through the document image, it is possible to prevent the outflow of information, but it is impossible to perform a so-called text search such as extracting the same text as the selected text. There arises a problem that the usability of the document browsing system is deteriorated.

  In order to solve this problem, in Patent Documents 1 and 2, text information indicating text included in an image file is stored in association with the image file in advance, and the user selects a predetermined area on the document image. In addition, the text included in the area can be specified from the text information. In this way, the text search can be performed even when the document image is browsed by extracting the same text as the specified text from the text information.

JP-A-8-212331 JP-A-11-102375

  However, in the configurations of Patent Documents 1 and 2, there is a problem that a search using text as a search key can be performed, but a search other than text cannot be performed. In addition to text, a document file created as corporate material includes a lot of information such as figures and graphs. For this reason, in the document browsing system, it is desired that not only a search using a text as a search key but also a search using a figure or graph as a search key.

  The present invention has been made in view of the above problems, and in a document browsing system for browsing a document image, when a region other than text is selected on the document image, the selected region is used as a search key. The purpose is to be able to search.

  In order to achieve the above object, the present invention has file storage means capable of storing a plurality of image files indicating document images, and in response to a request for distribution of a predetermined image file, the distribution of the image file is performed. A document delivery apparatus that performs the operation, and is connected to the document delivery apparatus via a network and requests the document delivery apparatus to deliver a predetermined image file in response to an operation instruction, and displays the document image of the delivered image file In a document browsing system comprising a document browsing device to be displayed on a section, area selection means for selecting an arbitrary area of a document image displayed on the display section, and coordinate information of a selection area selected by the area selection means By transmitting, the document distribution apparatus is instructed to execute a search using the selected area as a search key. Search instruction means and notification control means for notifying search results distributed from the document distribution device are provided in the document browsing device, and based on the coordinate information, the data type of the selection area is specified, Search key setting means for setting a search key according to the data type, search means for searching for a corresponding portion from the image file to be searched based on the search key, and browsing the document for the search result of the search means Delivery control means for delivering to the apparatus is provided in the document delivery apparatus.

  The document distribution device includes table storage means for storing table data in which text included in an image file is associated with coordinate information indicating a position of the text on the document image, and the search key setting means is By referring to the table data based on the coordinate information of the selection area, it is determined whether or not text is included in the selection area. If text is included, the text included in the selection area is Preferably, the search unit is set as a search key, and when the text is set as the search key, the search unit refers to the table data and searches for the same text as the search key.

  When it is determined that the search key setting means does not include text, the image of the selection area is set as the search key, and the search means is set when the image of the selection area is set as the search key, It is preferable to search for a similar image similar to the search key.

  The document distribution device includes a face detection unit that detects a face from an image and calculates a facial feature amount of the face when the face is detected, and the search key setting unit does not include text. The face detection means detects the face from the image of the selected area, and when a face is detected, the face feature amount of the face is set as the search key, and the search means When a feature amount is set as the search key, a face similar to the face feature amount of the search key may be searched.

  It is preferable that the distribution control means distributes coordinate information of a corresponding location as a search result.

  The document browsing device is a portable terminal, and the document distribution device has a model determining unit that determines a model of the document browsing device, and an image file in a data format corresponding to the model determined by the model determining unit. It is preferable that conversion means for converting is further provided, and an image file in a data format corresponding to the model is distributed to the document browsing apparatus.

  The document distribution apparatus includes coordinate conversion means for performing a coordinate conversion process between the coordinate system of the image file stored in the file storage means and the coordinate system of the image file being viewed displayed on the display unit. It is preferable.

  It is preferable that the search means search the image file being browsed displayed on the display unit.

  The search means may be configured to search all image files stored in the file storage means.

  The notification control means preferably notifies the search result by highlighting a portion corresponding to the search result.

  The present invention further includes a file storage unit that can store a plurality of image files representing document images, and distributes the image file in response to a request for distribution of the predetermined image file. A document that is connected to the document distribution device via a network, requests the document distribution device to distribute a predetermined image file in response to an operation instruction, and displays a document image of the distributed image file on a display unit In a control method of a document browsing system including a browsing device, an area selection step for selecting an arbitrary area of a document image displayed on the display unit, and coordinate information of a selection area selected by the area selection step are transmitted. Thus, the document distribution apparatus is instructed to execute a search using the selected area as a search key. Based on the search instruction step, the search key setting step for specifying the data type of the selection area based on the coordinate information and setting the search key corresponding to the data type, and the search key based on the search key It has a search step for searching for a corresponding part from an image file, a distribution step for distributing a search result of the search step to the document browsing device, and a notification step for notifying the distributed search result.

  In the present invention, the data type of the selected area is specified based on the coordinate information, and the search key corresponding to the data type is set, so even when an area other than text is selected on the document image, A search using the selected area as a search key can be performed.

It is explanatory drawing which shows the structure of a document browsing system. It is explanatory drawing which shows an example of a document image. It is explanatory drawing which shows an example of a document image correspondence table. It is explanatory drawing which shows an example of a text image corresponding | compatible table. It is a block diagram which shows the structure of a mobile telephone. It is a flowchart which shows the procedure in the case of performing the search in a document. It is a flowchart which shows the procedure in the case of performing another document search. It is explanatory drawing which shows the text image corresponding | compatible table which memorize | stores the text contained in a file divided into the block for every line.

  As shown in FIG. 1, the document browsing system 2 includes a document distribution server (document distribution device) 3 and a mobile phone (document browsing device) 4. The cellular phone 4 is connected to the document distribution server 3 via the Internet 6 by wirelessly communicating with the base station 5 and accessing the Internet 6 via the base station 5. Thereby, the document distribution server 3 and the mobile phone 4 can communicate with each other via the Internet 6 which is a public network.

  The document distribution server 3 is a server installed in a company network, stores various document files 10 created in the company, and stores image files 12 corresponding to the document files 10. To do. The document distribution server 3 distributes the image file 12 corresponding to the document file 10 to the cellular phone 4 when the cellular phone 4 requests the distribution of the predetermined document file 10.

  The mobile phone 4 is provided with a liquid crystal display (display unit) 7 for displaying various types of information and an operation unit (region selection means) 8 for inputting various types of operation instructions. The mobile phone 4 accesses the document distribution server 3 in response to an instruction from the user input via the operation unit 8 and outputs the image file 12 acquired from the document distribution server 3 to the liquid crystal display 7. As a result, the document image 14 corresponding to the document file 10 requested by the user is displayed on the liquid crystal display 7 as shown in FIG. In addition, the mobile phone 4 deletes the acquired image file 12 from the internal memory after the user finishes browsing the document image 14.

  In this way, the document browsing system 2 delivers the image file 12 in response to a request from the mobile phone 4 and prevents data from remaining on the mobile phone 4 after browsing, thereby suppressing the risk of information leakage. The contents of the document file 10 created in the company can be browsed even outside the company.

  Further, the document browsing system 2 searches for another document file 10 based on a search function in a document for searching a predetermined search key from the document image 14 being browsed and a search key selected on the document image 14 being browsed. And a function for searching other documents. For example, after the document image 14 is displayed, these searches are started by operating the operation unit 8 to display the menu screen on the liquid crystal display 7 and selecting from the menu screen.

  When the search is started, a pointer 15 is displayed on the document image 14 as shown in FIG. The user operates the operation unit 8 and clicks two arbitrary points while moving the pointer 15 to select an area to be used as a search key. At this time, the area to be used as a search key may be text, a diagram, a graph, or the like. When the user wants to use a predetermined text as a search key, as shown in FIG. 2B, the user selects an area so as to surround the text. On the other hand, when the user wants to use a figure, a graph, or a human face as a search key, the user selects an area so as to surround those images.

  When an area to be used as a search key is selected, an icon 16 for instructing execution of a search based on the search key is displayed on the document image 14 as shown in FIG. After the icon 16 is displayed, the user operates the operation unit 8 to move the pointer 15 and clicks the icon 16.

  In response to the click on the icon 16, the mobile phone 4 transmits an instruction for executing the search process and information on the search key to the document distribution server 3. When an instruction to execute the search process is input, the document distribution server 3 performs the search process based on the search key information and distributes the search result to the requesting mobile phone 4.

  When the mobile phone 4 receives the search result, the mobile phone 4 displays the search result on the liquid crystal display 7 and notifies the user of the search result. When searching within a document, as shown in FIG. 2D, the search result is notified by highlighting a portion corresponding to the search key. On the other hand, when another document search is performed, as shown in FIG. 2E, a list screen 17 that displays a list of file names of the document files 10 corresponding to the search key is displayed as a search result. In the list screen 17, each file name is a link for displaying the document image 14 corresponding to the document file 10. After the list screen 17 is displayed, the user operates the operation unit 8 to move the pointer 15 and clicks the file name of the desired document file 10. Then, the image file 12 corresponding to the document file 10 is read from the document distribution server 3 and the corresponding document image 14 is displayed on the liquid crystal display 7.

  The document distribution server 3 includes a CPU (search key setting unit, search unit, distribution control unit) 20, a system memory 21, an HDD (file storage unit, table storage unit) 22, and a network interface (I / F) 23. An image file generation unit 24, a text extraction unit 25, a face detection unit 26, a model determination unit 27, an image conversion unit 28, and a coordinate conversion unit 29. These units are connected to each other via a bus 30.

  The CPU 20 comprehensively controls each unit of the document distribution server 3. The system memory 21 temporarily stores various data generated in the process in which the CPU 20 performs control. The HDD 22 stores various programs and data for controlling the document distribution server 3. The CPU 20 controls the document distribution server 3 by reading out these programs and data from the HDD 22 and developing them in the system memory 21 and processing them sequentially.

  The HDD 22 is provided with a document file storage unit 32 and an image file storage unit 33. The document file storage unit 32 stores various document files 10 created in the company. The image file storage unit 33 stores the image file 12 corresponding to each document file 10. The HDD 22 stores a document image correspondence table 34 and a text image correspondence table (table data) 35.

  As shown in FIG. 3, the document image correspondence table 34 stores the document ID, the file name of the document file 10, and the file name of the image file 12 in association with each other. The document ID is identification information assigned to uniquely identify each document file 10 and is composed of a predetermined number of numbers or character strings. Thereby, the image file 12 corresponding to the document file 10 can be identified by referring to the document image correspondence table 34. In FIG. 3, one image file 12 is associated with one document file 10, but when the document file 10 has a plurality of pages, a plurality of pages corresponding to each page are included in one document file 10. An image file 12 is associated.

  As shown in FIG. 4, the text image correspondence table 35 associates the document ID, the characters included in the document file 10 and the image file 12 corresponding to the document ID, and the position of the characters on the document image 14. I remember. In the text image correspondence table 35, the position of the character is indicated by the coordinates of two points on the document image 14. Each of these coordinates consists of the coordinates of the upper left corner of the rectangular area surrounding the character and the coordinates of the lower right corner. For each of these coordinates, a coordinate system is used in which the upper left corner of the document image 14 is the origin, the displacement amount of the pixel in the right direction is + X, and the displacement amount of the pixel in the downward direction is + Y. .

  Thus, by referring to the text image correspondence table 35, it is possible to specify the characters included in the document file 10 and the image file 12 and their positions on the document image 14. For example, referring to the first line of the text image correspondence table 35 shown in FIG. doc document file 10 and KR-beat. It may be specified that the character “K” is included in the image file 12 jpg and “K” is located in the range of (0, 0)-(12, 12) of the corresponding document image 14. it can.

  The network I / F 23 is a known modem or router, and connects the document distribution server 3 to the Internet 6.

  The image file generation unit 24 virtually prints the document file 10 instructed by the CPU 20 to generate the image file 12 for each page from the document file 10 and stores the generated image file 12 in the image file storage unit 33. . At this time, the image file generation unit 24 generates the image file 12 with a predetermined resolution. As a result, the image files 12 stored in the image file storage unit 33 are all set to the same resolution.

  Further, when the document file 10 is one page, the image file generation unit 24 generates the image file 12 with the same file name as the document file 10 (see FIG. 2). On the other hand, when the document file 10 has a plurality of pages, the image file generation unit 24 assigns a serial number corresponding to the page to the same file name as the document file 10 and generates each image file 12 for each page. To do.

  The text extraction unit 25 performs a process of extracting all characters from the document file 10 when a predetermined document file 10 is instructed from the CPU 20, and also draws code (for example, Windows (registered trademark) issued by the operation system). The position of each extracted character on the document image 14 is specified based on GDI).

  When a new document file 10 is stored in the document file storage unit 32, the CPU 20 instructs the image file generation unit 24 to generate the image file 12 of the document file 10. Thereafter, the CPU 20 issues a new document ID to the document file 10. Then, after the image file generation unit 24 generates the image file 12, the CPU 20 associates the newly issued document ID, the file name of the document file 10, and the file name of the generated image file 12. It is stored in the image correspondence table 34.

  The CPU 20 also causes the image file generation unit 24 to generate the image file 12 and then instructs the text extraction unit 25 to extract characters from the same document file 10 and specify the position of each character. Then, the CPU 20 stores the document ID, the extracted character, and the position of the character on the document image 14 in association with each other in the text image correspondence table 35.

  As described above, when the new document file 10 is stored in the document file storage unit 32, the corresponding image file 12 is automatically generated, and the corresponding relationship is stored in the document image correspondence table 34. Further, all characters are extracted from the document file 10, the position of each character on the document image 14 is specified, and the corresponding relationship is stored in the text image correspondence table 35.

  When an image is input from the CPU 20, the face detection unit 26 detects a human face from the image using a known pattern recognition technique. Further, when the face detection unit 26 detects a face, the face detection unit 26 calculates a face feature amount of the face.

  The model discrimination unit 27 is provided with a model DB 36 in which a model ID indicating the model of the mobile phone 4 is associated with format information indicating the data format of the image file 12 that can display the model. When the model ID is sent from the mobile phone 4, the model discriminating unit 27 refers to the model DB 36 based on the model ID to identify the format information of the mobile phone 4 that has accessed the document distribution server 3. The format information is, for example, the type such as JPEG or bitmap, and the resolution and image size of the liquid crystal display 7.

  The image conversion unit 28 determines that the data format of the image file 12 generated by the image file generation unit 24 does not match the mobile phone 4 as a result of specifying the format information of the mobile phone 4 by the model determination unit 27. Then, a conversion process for converting the image file 12 into a data format corresponding to the format information specified by the model discriminating unit 27 is performed.

  For example, when the resolution of the image file 12 generated by the image file generation unit 24 is higher than the resolution of the liquid crystal display 7 of the mobile phone 4, the image file 12 cannot be normally displayed on the liquid crystal display 7. . In such a case, the image conversion unit 28 performs resolution conversion processing for converting the resolution of the image file 12 into a resolution corresponding to the liquid crystal display 7.

  Thereby, the image file 12 corresponding to the model of the accessed mobile phone 4 is generated. The converted image file 12 generated by the image conversion unit 28 is temporarily stored in the system memory 21. On the other hand, the original image file 12 before conversion is stored in the image file storage unit 33 as it is.

  When the resolution of the image file 12 is changed by the image conversion of the image conversion unit 28, the coordinate conversion unit 29 is between the coordinate system of the image file 12 before conversion and the coordinate system of the image file 12 after conversion. The coordinate conversion process is performed. As described above, the coordinate information indicating the position of each character stored in the text image correspondence table 35 is related to the resolution of the image file 12. For this reason, if the resolution of the image file 12 changes, the correspondence between the positions of the characters will be out of order. As described above, the coordinate conversion unit 29 performs coordinate conversion between the coordinate systems when the resolution of the image file 12 changes, thereby preventing the correspondence between the positions of the characters from being out of order.

  As shown in FIG. 5, in addition to the liquid crystal display 7 and the operation unit 8, the mobile phone 4 includes a CPU (search instruction unit, notification control unit) 50, a system memory 51, a liquid crystal driver 52, and a wireless communication unit 53. And. These units are connected to each other via a bus 54. The system memory 51 is provided with a ROM area for storing various programs and data for controlling the mobile phone 4 and a RAM area for temporarily storing various data generated during the control process. The CPU 50 reads out various programs from the system memory 51 and sequentially processes them to control each part of the mobile phone 4 in an integrated manner.

  An operation unit 8 is connected to the CPU 50. As a result, an operation instruction from the user is input to the CPU 50 via the operation unit 8. In the ROM area of the system memory 51, a model ID 55 indicating the model of the mobile phone 4 is stored.

  The liquid crystal driver 52 reads various image data from the system memory 51 in accordance with a control signal from the CPU 50, converts the image data into an analog composite signal, and outputs the analog composite signal to the liquid crystal display 7. Thereby, an image is displayed on the liquid crystal display 7. The wireless communication unit 53 performs wireless communication with the base station 5 and transmits / receives various data to / from the base station 5.

  Next, the procedure of processing when searching within a document will be described with reference to the flowchart shown in FIG. The user accesses the document distribution server 3 from the mobile phone 4 when he / she wants to browse the document file 10 from outside the company. Then, the user selects a desired document file 10 from the document file storage unit 32 and requests the document distribution server 3 to browse the document file 10. At this time, the CPU 50 of the mobile phone 4 reads the model ID 55 from the system memory 51, adds the model ID 55 to the browsing request signal, and transmits it to the document distribution server 3.

  When the CPU 20 of the document distribution server 3 receives the browsing request signal from the mobile phone 4, the CPU 20 sends the model ID 55 included therein to the model determination unit 27. The model discriminating unit 27 refers to the model DB 36 based on the model ID 55 and identifies the format information of the mobile phone 4. When the CPU 20 causes the model determination unit 27 to specify the format information, the CPU 20 determines whether or not the data format of the image file 12 matches the data format of the mobile phone 4 based on the format information.

  If the CPU 20 determines that the data format is correct, the CPU 20 refers to the document image correspondence table 34 and specifies the image file 12 corresponding to the requested document file 10. Thereafter, the CPU 20 reads the identified image file 12 from the image file storage unit 33 and distributes the image file 12 to the requesting mobile phone 4.

  On the other hand, if the CPU 20 determines that the data format does not match, the CPU 20 reads the image file 12 from the image file storage unit 33 and then sends the image file 12 to the image conversion unit 28. Then, the image file 12 is converted into a data format corresponding to the format information specified by the model discriminating unit 27, and the converted image file 12 is delivered to the requesting mobile phone 4. Thereby, an appropriate document image 14 corresponding to the model of the mobile phone 4 is displayed.

  When receiving the image file 12, the CPU 50 of the mobile phone 4 stores the image file 12 in the system memory 51 and instructs the liquid crystal driver 52 to display the image file 12. The liquid crystal driver 52 reads the image file 12 from the system memory 51 in accordance with an instruction from the CPU 50 and causes the liquid crystal display 7 to display the image file 12. As a result, the document image 14 is displayed on the liquid crystal display 7 (see FIG. 2A). The user can confirm the contents of the document file 10 by browsing the document image 14.

  When performing a search in a document, the user operates the operation unit 8 to display a menu screen on the liquid crystal display 7 and instructs the start of the search by selecting a search in the document from the menu screen. When the CPU 50 is instructed to start the search in the document, the CPU 15 displays the pointer 15 on the document image 14 (see FIG. 2B). Thereafter, the user operates the operation unit 8 to move the pointer 15 and clicks two arbitrary points to select an area to be used as a search key. When the area is selected, the CPU 50 displays the icon 16 on the document image 14 (see FIG. 2C). When the CPU 50 detects that the icon 16 has been clicked by an input from the operation unit 8, in response to this, the CPU 50 sends a document search execution instruction and coordinate information of two selected points to the document distribution server. 3 to send.

  When the CPU 20 of the document distribution server 3 receives the instruction to execute the search in the document and the coordinate information, the CPU 20 refers to the text image correspondence table 35 based on the coordinate information and puts text (character or character string) in the selected area. Whether or not is included is determined.

  At this time, if the resolution of the image file 12 distributed to the mobile phone 4 has changed due to the image conversion by the image conversion unit 28, the CPU 20 sends the received coordinate information to the coordinate conversion unit 29 and sends it to the mobile phone 4. The coordinate system corresponding to the resolution of the distributed image file 12 is converted to the coordinate system corresponding to the resolution of the original image file 12. Then, based on the converted coordinate information, the text image correspondence table 35 is referred to and it is determined whether or not text is included in the selected area.

  When determining that the text is included, the CPU 20 specifies that the data type of the area selected as the search key by the user is text, and sets the text as the search key. On the other hand, when determining that the text is not included, the CPU 20 determines that the user has selected an image such as a figure, a graph, or a human face as a search key. When the CPU 20 determines that the user has selected an image, the CPU 20 cuts out and extracts a portion corresponding to the selected region from the image file 12 corresponding to the document image 14 being browsed by the user, and the partial image corresponding to the selected region. Is generated. Thereafter, the CPU 20 inputs the generated partial image to the face detection unit 26 and causes the face detection unit 26 to detect a human face.

  The face detection unit 26 performs face detection on the input partial image. When a face is detected, the facial feature value of the face is calculated, and the facial feature value is input to the CPU 20. On the other hand, if a face is not detected, a non-detection signal indicating that is input to the CPU 20.

  When the face feature amount is input from the face detection unit 26, the CPU 20 specifies that the data type of the area selected by the user as the search key is a human face, and sets the face feature amount as the search key. . On the other hand, when a non-detection signal is input from the face detection unit 26, the CPU 20 specifies that the data type of the area selected as the search key by the user is another image, and sets the partial image itself as the search key. To do.

  After setting the search key, the CPU 20 searches the document file 10 and the image file 12 corresponding to the document image 14 being browsed by the user based on the search key. When the text is set as the search key, the CPU 20 refers to the text image correspondence table 35 and searches for the same text as the text of the search key from a location corresponding to the corresponding document file 10. When the same text is found, the coordinate information of the text is acquired as a search result.

  When the partial image is set as a search key, the CPU 20 searches for a similar image similar to the partial image from the corresponding image file 12. For example, the CPU 20 calculates a mean square error and an SN ratio by taking a difference for each pixel, and determines that the image is a similar image when the predetermined threshold is not exceeded. When a similar image is found, the coordinate information of the similar image is acquired as a search result.

  Further, when the face feature amount is set as a search key, the CPU 20 searches for a face similar to the face feature amount of the search key from the corresponding image file 12. For example, the CPU 20 inputs the corresponding image file 12 to the face detection unit 26 and causes the face detection unit 26 to detect all the faces included in the image file 12. Then, the difference between the facial feature amount of the search key and the facial feature amount of each face is calculated, and if the difference does not exceed a predetermined threshold, it is determined that the faces are similar. When a similar face is found, the CPU 20 acquires coordinate information of the face as a search result. As described above, in this example, the data type (text, image, human face, etc.) of the selected area is specified based on the coordinate information, and the search key corresponding to the data type is set. Even when an area such as an image other than is selected, a search using the selected area as a search key can be performed.

  When the CPU 20 performs a search based on the search key and acquires the coordinate information of the corresponding location as the search result, the CPU 20 distributes the coordinate information to the requesting mobile phone 4. At this time, if coordinate conversion is required, coordinate information is sent to the coordinate conversion unit 29. Then, the coordinate system corresponding to the resolution of the original image file 12 is converted to the coordinate system corresponding to the resolution of the image file 12 distributed to the mobile phone 4, and the converted coordinate information is distributed to the requesting mobile phone 4. To do.

  In this way, if only coordinate information is transmitted and received when searching and data such as text is not sent to the Internet 6, the risk of information leakage can be further reduced. In addition, since the amount of data is smaller than when sending and receiving text and the like, it is possible to reduce communication costs and communication time.

  When receiving the coordinate information as the search result, the CPU 50 of the cellular phone 4 highlights the area indicated by the coordinate information on the document image 14 (see FIG. 2D). Thereby, the search result of the in-document search is notified to the user.

  As shown in the flowchart of FIG. 7, when other document search is performed, the search key is set in the same procedure as in the document search, and then stored in the document file storage unit 32 and the image file storage unit 33. A search is performed on all document files 10 and image files 12.

  When the text is set as the search key, the CPU 20 refers to the text image correspondence table 35 to search for the document file 10 that includes the same text as the text of the search key, and acquires the file name of the document file 10 as the search result. To do. When the partial image is set as the search key, the CPU 20 searches the image file 12 including the similar image, and acquires the file name of the document file 10 corresponding to the image file 12 as the search result. Further, when the facial feature amount is set as a search key, the CPU 20 searches for an image file 12 including a similar face, and acquires the file name of the document file 10 corresponding to the image file 12 as a search result.

  When the CPU 20 performs a search based on the search key and obtains the file name of the corresponding document file 10 as a search result, the list screen 17 is displayed on the liquid crystal display 7 of the mobile phone 4 based on each file name. Screen data is generated, and the screen data is distributed to the mobile phone 4.

  When receiving the screen data, the CPU 50 of the mobile phone 4 stores the screen data in the system memory 51 and instructs the liquid crystal driver 52 to display the screen data. The liquid crystal driver 52 reads screen data from the system memory 51 in accordance with an instruction from the CPU 50 and causes the liquid crystal display 7 to display the screen data. As a result, the list screen 17 is displayed on the liquid crystal display 7 and the search result of the other document search is notified to the user (see FIG. 2E).

  Note that the method of notifying the search result of the other document search is not limited to the file name of the document file 10, for example, extracting the image of the corresponding part from each image file 12 having the part corresponding to the search key, You may alert | report by displaying the extracted image as a search result.

  In the above-described embodiment, the text image correspondence table 35 is configured by associating the characters included in the document file 10 and the image file 12 with the positions of the characters on the document image 14. If the table is configured, the amount of data in the table becomes enormous, and there is a concern that the search will take time.

  Therefore, as shown in the text image correspondence table 60 shown in FIG. 8, the text included in the document file 10 and the image file 12 is divided into blocks 62 for each line, and each block 62 and the document image 14 of the block 62 are displayed. The table may be configured by associating and storing the positions. In this case, a full text search is performed for each block 62 to identify a block 62 that includes the same text as the text of the search key, and then a corresponding portion may be extracted from the block 62.

  As described above, if the text image correspondence table 60 is divided into the blocks 62 for each line, the amount of data in the table can be reduced and the search time can be shortened as compared with the case where the characters are associated with each other. . The block 62 is not limited to one line, but may be, for example, a word or a phrase.

  In the above embodiment, the coordinate conversion process is performed when the resolution of the image file 12 has been changed by the image conversion of the image conversion unit 28. However, the coordinate conversion process by the coordinate conversion unit 29 is not limited to this. This may be performed in a situation where coordinate conversion is required between the coordinate system of the image file 12 stored in the image file storage unit 33 and the coordinate system of the image file 12 being viewed on the mobile phone 4. For example, even when the user enlarges or reduces the document image 14 displayed on the liquid crystal display 7, the coordinate system may be out of order. In such a case, coordinate conversion may be performed according to the magnification of enlargement or reduction.

  In the above embodiment, the characters are extracted from the document file 10 and the position of each character is specified. However, the present invention is not limited to this, and by using a well-known OCR technique, the characters are extracted from the image file 12 and each character is identified. The position may be specified.

  In the above-described embodiment, the mobile phone 4 is shown as the document browsing device. However, the document browsing device is not limited to this, and may be another portable terminal such as a PHS, a PDA, or a smartphone. The personal computer connected via a wired network such as a LAN is not limited to a portable terminal.

  In the above embodiment, the document distribution apparatus is configured by one document distribution server 3, but the present invention is not limited to this, and a document distribution apparatus may be configured by combining a plurality of servers.

  In the above embodiment, text, image, and human face are shown as the data type specified as the search key. However, the specified data type may be any information extracted from the document image 14.

  In the above-described embodiment, the example in which the present invention is applied to the case where the image file 12 generated by virtual printing the document file 10 is distributed has been described. However, the present invention is not limited to this, for example, on paper. The present invention may be applied when distributing an image file generated by reading a recorded document with a scanner.

2 Document browsing system 3 Document distribution server (document distribution device)
4 Mobile phone (document browsing device)
6 Internet (network)
7 Liquid crystal display (display part)
8 Operation part (area selection means)
10 document file 12 image file 14 document image 20 CPU (search key setting means, search means, distribution control means)
22 HDD (file storage means, table storage means)
26 Face detection unit (face detection means)
27 Model discrimination unit (model discrimination means)
28 Image conversion unit (conversion means)
29 Coordinate converter (coordinate converter)
35, 60 Text image correspondence table (table data)
50 CPU (search instruction means, notification control means)

Claims (11)

A document delivery device having file storage means capable of storing a plurality of image files representing document images, and delivering the image file in response to a request for delivery of the predetermined image file;
Document browsing apparatus connected to the document distribution apparatus via a network, requesting the document distribution apparatus to distribute a predetermined image file in response to an operation instruction, and displaying a document image of the distributed image file on a display unit In a document browsing system consisting of
Area selecting means for selecting an arbitrary area of the document image displayed on the display unit;
Search instruction means for instructing the document distribution apparatus to execute a search using the selected area as a search key by transmitting coordinate information of the selected area selected by the area selecting means;
The document browsing device is provided with notification control means for notifying a search result distributed from the document distribution device,
Search key setting means for specifying the data type of the selected area based on the coordinate information and setting a search key according to the data type;
Based on the search key, search means for searching for a corresponding part from the image file to be searched,
A document browsing system, wherein the document distribution apparatus includes distribution control means for distributing a search result of the search means to the document browsing apparatus. The document distribution device has table storage means for storing table data in which text included in an image file is associated with coordinate information indicating a position of the text on the document image,
The search key setting means determines whether or not text is included in the selection area by referring to the table data based on coordinate information of the selection area, and if the text is included, the selection Set the text contained in the area as the search key,
2. The document browsing system according to claim 1, wherein, when a text is set as the search key, the search means refers to the table data and searches for the same text as the search key. If the search key setting means determines that the text is not included, the search key setting means sets the image of the selection area as the search key,
3. The document browsing system according to claim 2, wherein when the image of the selection area is set as the search key, the search means searches for a similar image similar to the search key. The document distribution device includes a face detection unit that detects a face from an image and calculates a facial feature amount of the face when the face is detected;
When the search key setting means determines that the text is not included, the search key setting means causes the face detection means to detect a face from the image of the selection area, and when a face is detected, the face feature amount of the face is Set as search key,
4. The document browsing system according to claim 2, wherein the search means searches for a face similar to the face feature amount of the search key when a face feature amount is set as the search key.   5. The document browsing system according to claim 1, wherein the distribution control unit distributes coordinate information of a corresponding part as a search result. 6. The document browsing device is a portable terminal,
The document distribution device further includes a model determination unit that determines a model of the document browsing device, and a conversion unit that converts an image file into a data format corresponding to the model determined by the model determination unit. 6. The document browsing system according to claim 1, wherein an image file in a data format is distributed to the document browsing device.   The document distribution apparatus includes coordinate conversion means for performing a coordinate conversion process between the coordinate system of the image file stored in the file storage means and the coordinate system of the image file being viewed displayed on the display unit. The document browsing system according to any one of claims 1 to 6, wherein:   The document browsing system according to any one of claims 1 to 7, wherein the search means searches the image file being browsed displayed on the display unit.   The document browsing system according to any one of claims 1 to 7, wherein the search unit searches all image files stored in the file storage unit.   The document browsing system according to claim 1, wherein the notification control unit notifies the search result by highlighting a portion corresponding to the search result. A document delivery device having file storage means capable of storing a plurality of image files representing document images, and delivering the image file in response to a request for delivery of the predetermined image file;
Document browsing apparatus connected to the document distribution apparatus via a network, requesting the document distribution apparatus to distribute a predetermined image file in response to an operation instruction, and displaying a document image of the distributed image file on a display unit In a document browsing system control method consisting of:
An area selection step of selecting an arbitrary area of the document image displayed on the display unit;
A search instruction step for instructing the document delivery apparatus to execute a search using the selected region as a search key by transmitting coordinate information of the selected region selected in the region selection step;
A search key setting step for identifying the data type of the selection area based on the coordinate information and setting a search key according to the data type;
Based on the search key, a search step of searching for a corresponding part from the image file to be searched,
A distribution step of distributing a search result of the search step to the document browsing device;
A method for controlling a document browsing system, comprising: a notifying step for notifying a distributed search result.

Images