JP5289349B2 - Document file browsing system - Google Patents

Description

  The present invention relates to a distribution server that distributes an image file obtained by imaging a document file to a portable terminal in response to a document file distribution request from the portable terminal, a control method thereof, and a document file browsing system including the distribution server. Is.

  In recent years, as mobile terminals such as mobile phones have become more sophisticated, a browsing system that distributes data stored in an in-house server to external mobile terminals and enables data browsing on the mobile terminals is known. Yes. When the data acquired by the mobile terminal is data in text, JPEG, and HTML format, it can be browsed by application software installed in most mobile terminals.

  However, if the data acquired by the mobile terminal is data in a so-called structured document file format described in a format that can recognize the layout such as character type, line feed position, headline, paragraph, figure position, the contents of this data Few mobile devices have application software that can view Therefore, when distributing a document file to a mobile terminal, the server converts the document file into an image file and distributes it, and displays an image corresponding to the image file (hereinafter referred to as a document image) on the mobile terminal. Thus, a method of browsing the contents of a document file via a document image is often used.

  Patent Document 1 describes a document file browsing system in which a server analyzes a document file to generate an image file and extracts text information contained in the document file. In this document file browsing system, when a server receives a document file distribution request from a mobile terminal, the text information is distributed to the mobile terminal together with the image file. Thereby, in a portable terminal, in addition to a document image, text information can be displayed as needed. In this way, when a document image is displayed on a small-sized display of a portable terminal, even if characters are crushed and difficult to read in the document image, the contents of the document file can be easily displayed by displaying text information. I can grasp it.

Japanese Patent Laid-Open No. 2007-199983

  In Patent Document 1, both the image file and the text information are transmitted from the server to the mobile terminal. However, the display size and resolution of the mobile terminal are different for each model, and depending on the model, the characters in the document image are read. Sometimes you can. In such a case, there is no need to display text information on the display. In general, mobile terminals often exchange data with a server via wireless communication. Since this wireless communication has a smaller line capacity and a slower communication speed than wired communication, there has been a demand for measures to reduce the amount of data transmitted from the server to the portable terminal as much as possible.

The present invention has been made to solve the above problems, and an object thereof is to provide a Rubun document file browsing system can be reduced as much as possible the amount of data to be transmitted to the portable terminal from the distribution server.

In order to achieve the above object, the document file browsing system of the present invention is a document file browsing system comprising a distribution server and a portable terminal connected to the distribution server via a network, wherein the distribution server includes the portable terminal. From the document file storage unit storing the document file based on the distribution request received by the first distribution request receiving unit and the distribution request received by the first distribution request receiving unit, the document corresponding to the distribution request Document file acquisition means for acquiring a file, layout information acquisition means for analyzing the document file acquired by the document file acquisition means, and acquiring layout information of an object including at least text and an image included in the document file; , based on the layout information, the OH document file A region image generating means for generating an object imaged areas image file for each area of, based on the layout information, from the text areas of the document file, a text information acquisition acquires and stores text information on the text information storage section means and includes a first delivery means for delivering said area image files and the layout information to the portable terminal, and a second distribution request receiving means for receiving a distribution request of the text information from the portable terminal, the second distribution request receiving means text information corresponding to the distribution request is accepted, and the text information acquisition means for acquiring from the text information storage section, and a second distribution means for distributing the text information the text information acquisition means has acquired to the portable terminal, The portable terminal sends a document file distribution request to the first distribution request accepting unit. A first distribution request transmitting means for transmitting, a first acquisition means for acquiring the area image file and layout information distributed from the first distribution means, a layout of the area image file based on the layout information, and a document Layout means for generating image data; display means for displaying a document image based on the text image data; and display means for selectively displaying a text area in the document image based on the layout information; A selection means for selecting an arbitrary text area from among the text areas, and a second distribution request transmission for transmitting a distribution request for text information corresponding to the text area selected by the selection means to the distribution server Means, second acquisition means for acquiring the text information distributed from the second distribution means, and the second (2) display control means for causing the display means to display the text information acquired by the acquisition means .

  The distribution server includes: a model determination unit that determines a model of the portable terminal that has requested the distribution of the document file; and a text area included in the document file according to the model of the portable terminal that is determined by the model determination unit. A text region imaging determination unit that determines whether or not to perform the imaging, and an imaging of a region other than the text region that the text region imaging determination unit determines not to perform the imaging, It is preferable to include an image generation control unit that controls the image generation unit.

  The distribution server includes a storage unit that stores a data table in which a model of the portable terminal is associated with screen information indicating a display screen size and the number of pixels of the display unit for each model, and the text The area imaging determination means determines whether to execute the imaging of the text area based on the screen information corresponding to the model of the portable terminal determined by the model determination means with reference to the data table It is preferable to do.

If the first acquisition means does not acquire the area image file corresponding to the text area of the document file from the distribution server, the layout means does not include the data corresponding to the text area. It generates Zode over data, wherein the display control unit, based on the layout information, the area corresponding to the text area of the document image, it is preferable to display a mark indicating that it is a text area.

The first distribution request transmitting means of the portable terminal transmits a distribution request for the document file including unique identification information indicating the model of the portable terminal to the distribution server, and the model determining means of the distribution server includes: It is preferable to determine a model of the portable terminal based on the unique identification information included in the document file distribution request received by the one distribution request receiving unit.

  The display control means preferably displays the text information superimposed on the document image. Further, it is preferable that the display control means displays the text information in an enlarged manner in accordance with a display screen of the display means.

According to the present invention , the distribution server distributes the area image file obtained by imaging the document file for each area of the object and the layout information to the portable terminal in response to the document file distribution request from the portable terminal. When a text information distribution request corresponding to the text area in the document image is received from the mobile terminal, the text information acquired from the document file is distributed to the mobile terminal in advance. Unless it is, text information is not transmitted. Thereby, the amount of data transmitted to the mobile terminal can be reduced as much as possible.

  In addition, depending on the model of the mobile terminal, the text area of the document file is not imaged, and an area image file in which each area other than the text area that is not imaged is imaged is delivered to the mobile terminal. The amount of data transmitted to the mobile terminal can be further reduced.

It is the schematic of a document file browsing system. It is explanatory drawing of a layout information table. It is explanatory drawing of a text information table. It is a block diagram which shows the electric constitution of a portable terminal. It is explanatory drawing of the list screen displayed with a portable terminal. It is explanatory drawing of the document image displayed with a portable terminal. It is a flowchart for demonstrating the flow of the browsing process of a document file. It is explanatory drawing for demonstrating a text image display. It is the schematic of the document file browsing system of 2nd Embodiment. It is explanatory drawing for demonstrating a terminal information table. It is a flowchart for demonstrating the flow of the browsing process of a document file in 2nd Embodiment. It is a flowchart for demonstrating the flow of the production | generation process of an area image file. It is explanatory drawing for demonstrating the document image displayed by 2nd Embodiment.

  As shown in FIG. 1, the document file browsing system 10 includes a document distribution server 11 and a mobile terminal 12. The portable terminal 12 is connected to the document distribution server 11 via the Internet 15 by wirelessly communicating with the base station 14 and accessing the Internet 15 via the base station 14. Thereby, the document distribution server 11 and the portable terminal 12 can communicate with each other via the Internet 15.

  The document distribution server 11 is a server arranged in a company network, and stores various document files 17 created in the company. When the document distribution server 11 receives a distribution request for a predetermined document file 17 from the portable terminal 12, the document distribution server 11 converts the document file 17 into an image file 18 and distributes the image file 18 to the portable terminal 12.

  The document file 17 is created using application software such as document creation software, spreadsheet software, and presentation software, and is data in the above-described structured document file format. The document file 17 includes text and image objects such as photographs, figures, line drawings, and tables.

  The mobile terminal 12 is provided with a liquid crystal display 20 for displaying various information and an operation unit (selecting means) 21 for inputting various operation instructions. The portable terminal 12 accesses the document distribution server 11 according to the instruction input to the operation unit 21, and outputs information acquired from the document distribution server 11 to the liquid crystal display 20. For example, when the acquired information is an image file 18, a document image 22 corresponding to the document file 17 is displayed on the liquid crystal display 20.

  The document distribution server 11 includes a CPU (document file acquisition unit, text information acquisition unit) 24, a memory 25, an HDD 26, and a network I / F (first and second distribution request receiving unit, first and second distribution). Means) 27, a communication data control unit 28, a document file analysis unit 29, and an image generation unit 30 are provided. These units are connected to each other via a bus 31.

  The CPU 24 comprehensively controls each unit of the document distribution server 11. The memory 25 temporarily stores various data generated in the process in which the CPU 24 performs control. The HDD 26 stores various programs and data for controlling the document distribution server 11. The CPU 24 controls the document distribution server 11 by reading out these programs and data from the HDD 26 and developing them in the memory 25 and processing them sequentially.

  The HDD 26 is provided with a document file storage unit 34, an image storage unit 35, a layout information storage unit 36, and a text information storage unit 37 in addition to the above programs and data. The document file storage unit 34 stores various document files 17 created in the company. The image storage unit 35 temporarily stores an image file 18 corresponding to a document file 17 requested to be distributed from the mobile terminal 12 (hereinafter referred to as a distribution request document file 17).

  The layout information storage unit 36 temporarily stores a layout information table 39 indicating layout information of various objects included in the distribution request document file 17. The text information storage unit 37 stores a text information table 40 in which text information extracted from each text area of the distribution request document file 17 is collected.

  The network I / F 27 exchanges various data with the mobile terminal 12 via the Internet 15 or the like. Data received by the network I / F 27 from the portable terminal 12 includes a distribution request for list information (hereinafter referred to as a list distribution request) indicating a list of document files 17 in the document file storage unit 34 and a distribution request for the document file 17 ( A document file distribution request) and a text information distribution request corresponding to an arbitrary text area of the document image 22 (hereinafter referred to as a text distribution request).

  Conversely, the data that the network I / F 27 transmits to the portable terminal 12 is specified by the list information corresponding to the list distribution request, the image file 18 and layout information table 39 corresponding to the distribution request document file 17, and the text distribution request. Text information.

  The communication data control unit 28 processes data transmitted / received through the network I / F 27. For example, the communication data control unit 28 sends each distribution request received by the network I / F 27 to the CPU 24. In addition, the communication data control unit 28 converts the list information corresponding to each distribution request, the distribution request document file 17, the layout information table 39, and the text information into a predetermined data format suitable for wireless communication. Data is sent to the network I / F 27.

  The document file analysis unit 29 analyzes the distribution request document file 17 and acquires layout information of various objects such as text and images included in each page of the distribution request document file 17. The document file analysis unit 29 acquires text information from each text area of the document file 17. The document file analysis unit 29 includes a layout information acquisition unit 42 and a text information acquisition unit 43.

  The layout information acquisition unit 42 analyzes the layout of the distribution request document file 17 using, for example, a virtual printer driver. The virtual printer driver generates a page description language (PDL) indicating the type, position, and size of an object included in the page for each page of the distribution request document file 17, and renders the page description language for each page. Then, the image file 18 for each page is generated. The layout information acquisition unit 42 obtains layout information of each page of the distribution request document file 17 based on the PDL information for each page generated by the virtual printer driver, and generates the layout information table 39.

  The text information acquisition unit 43 determines a text area including the text of each page of the distribution request document file 17 based on the layout information table 39 generated by the layout information acquisition unit 42. Based on the determination result, the text information acquisition unit 43 acquires text information from all the text areas included in the distribution request document file 17 and generates the text information table 40.

  The image generation unit 30 performs virtual printing of the distribution request document file 17 using the above-described virtual printer driver, thereby imaging the document file 17 for each page and generating an image file 18 for each page. In this embodiment, virtual printing using a virtual printer driver is performed even in the layout analysis by the layout information acquisition unit 42 described above. Therefore, even if the image generation unit 30 is integrated with the document file analysis unit 29 described above. Good.

  The CPU 24 analyzes each distribution request received by the network I / F 27 and executes processing according to each distribution request. When the received distribution request is a list distribution request, the CPU 24 generates list information in which the file name and address of the document file 17 in the document file storage unit 34 are associated with each other, and uses the list information as a communication data control unit. Send to 28.

  When the received distribution request is a document file distribution request, the CPU 24 analyzes where the corresponding distribution request document file 17 is stored in the document file storage unit 34, and then the document distribution server 11. Each unit is caused to execute generation and transmission of the image file 18 and the layout information table 39. Further, when the received distribution request is a text distribution request, the CPU 24 searches corresponding text information from the text information storage unit 37 and causes each unit of the document distribution server 11 to transmit the text information.

  As shown in FIG. 2, the layout information table 39 includes a document ID, a page number of a page including the object, an object ID, an object type indicating the type of the object, a horizontal position, a vertical position, a width, And the height are stored in association with each other.

  The document ID is unique identification information given to the document file 17 in order to identify the document file 17 in the document file storage unit 34. The object ID is unique identification information given to an object in order to uniquely identify the object in the same page. As the object type, “text” is registered when the object is text, and “image” is registered when the object is an image such as a photograph, figure, line drawing, or table.

  The horizontal position and the vertical position are the X coordinate and Y coordinate of the upper left corner of each object when an arbitrary point (for example, the upper left corner) of each page is used as the origin. The width and height are the width in the X direction and the width in the Y direction of each object, and are represented by the number of pixels, for example. By referring to the layout information table 39, the type, position, and size of each object included in each page of the distribution request document file 17 can be determined.

  As shown in FIG. 3, the text information table 40 stores a document ID, a page number, an object ID, and text information corresponding to the document ID, the page number, and the object ID in association with each other. Thus, by referring to the text information table 40, it is possible to determine text information included in an arbitrary text area in the distribution request document file 17 based on the document ID, page number, and object ID.

  As shown in FIG. 4, in addition to the liquid crystal display 20 and the operation unit 21, the mobile terminal 12 includes a CPU (display control unit) 46, a memory 47, and a wireless communication unit (first and second distribution request transmission units, First and second acquisition means) 48, a communication data control unit 49, an image processing unit 50, a layout analysis unit 51, a text processing unit 52, and a liquid crystal driver 53. These are connected to each other via a bus 54.

  The CPU 46 reads out various programs from the memory 47 and sequentially processes them to control each part of the mobile terminal 12 in an integrated manner. The operation unit 21 is connected to the CPU 46. Thereby, an operation instruction from the user is input to the CPU 46 via the operation unit 21, and the CPU 46 issues various commands to each unit of the mobile terminal 12 according to the operation instruction.

  In addition to the above-described program, the memory 47 stores a terminal ID 56 indicating unique identification information of the mobile terminal 12 and viewer application software (hereinafter simply referred to as a viewer) 57 for browsing the document image 22. The wireless communication unit 48 exchanges the above-described various data with the document distribution server 11 via the Internet 15 or the like.

  The communication data control unit 49 analyzes the data received by the wireless communication unit 48 from the document distribution server 11, sends the list information to the CPU 46, sends the image file 18 to the image processing unit 50, and the layout information table 39 displays the layout analysis. The text information is sent to the text processing section 52. In addition, the communication data control unit 49 generates a list information distribution request, a document file distribution request, and a text information distribution request to be sent to the document distribution server 11 under a command from the CPU 46 and sends them to the wireless communication unit 48.

  The image processing unit 50 performs various kinds of image processing such as enlargement / reduction, rotation, and parallel movement on the image file 18 acquired from the communication data control unit 49, so that the image data of the document image 22 having a size suitable for the liquid crystal display 20 ( Hereinafter, the document image data) is generated. Note that the document image data includes image data for a plurality of pages when the distribution request document file 17 has a plurality of pages.

  The layout analysis unit 51 calculates the vertical position, horizontal position, width, and height registered in the layout information table 39 based on the contents of image processing such as enlargement / reduction performed by the image processing unit 50 after image processing. Correction is made to a value corresponding to the document image 22. By referring to the corrected layout information table 39, the type, object ID, position, and size of the object included in each page of the document image 22 can be determined.

  The text processing unit 52 generates text data for display using the font stored in the memory 47 based on the text information acquired from the communication data control unit 49.

  The liquid crystal driver 53 reads various data acquired from the document distribution server 11 from the memory 47 in accordance with a control signal from the CPU 46, converts the data into an analog composite signal, and outputs the analog composite signal to the liquid crystal display 20.

  When the mobile terminal 12 acquires list information from the document distribution server 11, as shown in FIG. 5, a list screen 59 showing a list of document files 17 in the document distribution server 11 is displayed on the liquid crystal display 20. In the list screen 59, each file name has a link 60 indicating the address of the document file 17 in the document distribution server 11. When the link 60 is clicked with the pointer 61 by the operation of the operation unit 21, a distribution request for the document file 17 corresponding to the link 60 is made to the document distribution server 11.

  When the mobile terminal 12 acquires the image file 18 and the layout information table 39 from the document distribution server 11, the document image 22 generated based on the image file 18 is displayed on the liquid crystal display 20 as shown in FIG. 6. Is displayed. A selection frame 64 for selecting the text area 63 is displayed in the document image 22. When an arbitrary text area 63 is selected in the selection frame 64 by operating the operation unit 21, a text information distribution request corresponding to the text area 63 highlighted in the selection frame 64 is made to the document distribution server 11. . Reference numeral 65 denotes an image area in which an image is displayed in the document image 22.

  Next, the flow of processing when browsing the document file 17 on the mobile terminal 12 will be described using the flowchart shown in FIG. When the viewer 57 is activated by the operation unit 21, the CPU 46 issues a list distribution request transmission command to the communication data control unit 49 and the wireless communication unit 48. In response to this transmission command, the communication data control unit 49 generates a list distribution request in a predetermined format including the terminal ID 56, and sends this list distribution request to the wireless communication unit 48. As a result, the list distribution request is transmitted to the network I / F 27 of the document distribution server 11 via the wireless communication unit 48 or the like.

  The list distribution request received by the network I / F 27 is input to the CPU 24 via the communication data control unit 28. Based on the list distribution request, the CPU 24 generates list information of the document file 17 in the document file storage unit 34 and sends this list information to the communication data control unit 28. Further, based on the terminal ID 56 included in the list distribution request, the CPU 24 issues a transmission command to the communication data control unit 28 and the network I / F 27, with the list distribution request source mobile terminal 12 as the destination. Thereby, the list information is appropriately converted by the communication data control unit 28 and then transmitted to the wireless communication unit 48 of the mobile terminal 12 via the network I / F 27 or the like.

  The communication data control unit 49 sends the list information received by the wireless communication unit 48 to the CPU 46. The CPU 46 generates list image data based on the list information, and temporarily stores the list image data in the memory 47. Next, the CPU 46 issues a display command to the liquid crystal driver 53. In response to this display command, the liquid crystal driver 53 reads the list image data stored in the memory 47 and outputs it to the liquid crystal display 20. As a result, the list screen 59 described in FIG. 5 is displayed on the liquid crystal display 20.

  When the operation unit 21 is operated and the desired link 60 is clicked with the pointer 61, the CPU 46 issues a document file distribution request transmission command to the communication data control unit 49 and the wireless communication unit 48. In response to this transmission command, the communication data control unit 49 generates a document file transmission request including the address indicated by the clicked link 60 and the terminal ID 56 and sends it to the wireless communication unit 48. As a result, a document file distribution request (for example, GET http://doc.com/doc/?doc id = 1 HTTP / 1.1 User Agent: Keitai 1) is transmitted to the network I / F 27 of the document distribution server 11.

  The document file distribution request accepted by the network I / F 27 is input to the CPU 24 via the communication data control unit 28. The CPU 24 analyzes the document file distribution request and acquires the address of the distribution request document file 17. Next, based on this address, the CPU 24 reads the distribution request document file 17 from the document file storage unit 34 of the HDD 26 and temporarily stores it in the memory 25.

  After storing the distribution request document file 17, the CPU 24 issues an analysis command to the document file analysis unit 29. In response to this analysis command, the layout information acquisition unit 42 of the document file analysis unit 29 operates. The layout information acquisition unit 42 reads the distribution request document file 17 from the memory 25, and virtually prints this distribution request document file 17 using a virtual printer driver.

  When virtual printing is executed, the layout information acquisition unit 42, based on the PDL for each page of the distribution request document file 17 generated by the virtual printer driver, the type, horizontal position, vertical position, width of the object included in each page Find layout information consisting of height. Further, the layout information acquisition unit 42 attaches an object ID that can be uniquely identified to each object within the same page.

  Next, the layout information acquisition unit 42 creates a layout information table 39 in which the document ID of the distribution request document file 17, the page number of the page including each object, and the object ID and layout information of each object are associated with each other. Generate. The layout information table 39 is temporarily stored in the layout information storage unit 36.

  After storing the layout information table 39, the text information acquisition unit 43 operates. The text information acquisition unit 43 refers to the layout information table 39 in the layout information storage unit 36 to determine the text area 63 included in each page of the distribution request document file 17 and then determines the text information from all the text areas 63. To get.

  In addition, the text information acquisition unit 43 refers to the layout information table 39 to obtain the document ID and the page number and object ID corresponding to each text information. Then, the text information acquisition unit 43 generates a text information table 40 in which the document ID, the page number, the object ID, and the text information are associated with each other. The text information table 40 is temporarily stored in the text information storage unit 37 of the HDD 26.

  After storing the text information table 40, the CPU 24 issues an image generation command to the image generation unit 30. Upon receiving this image generation command, the image generation unit 30 virtually prints the distribution request document file 17 using the virtual printer driver. As a result, the document file 17 is imaged for each page, and an image file 18 for each page is generated. Each image file 18 is temporarily stored in the image storage unit 35. As described above, since the virtual printing is executed by the layout information acquisition unit 42, the image file 18 obtained by the virtual printing may be stored in the image storage unit 35.

  After storing the image file 18, the CPU 24 reads the image file 18 and the layout information table 39 from the image storage unit 35 and the layout information storage unit 36, and sends them to the communication data control unit 28. In addition, the CPU 24 issues a transmission command to the communication data control unit 28 and the network I / F 27 with the destination of the portable terminal 12 as the document file distribution request source. As a result, the image file 18 and the layout information table 39 are transmitted to the wireless communication unit 48 of the mobile terminal 12 in the same manner as when the link information is transmitted.

  The image file 18 and the layout information table 39 received by the wireless communication unit 48 are sent to the communication data control unit 49. The communication data control unit 49 sends the image file 18 to the image processing unit 50 and sends the layout information table 39 to the layout analysis unit 51. Next, the CPU 46 issues an image processing command to the image processing unit 50. In response to this image processing command, the image processing unit 50 performs image processing on each image file 18. Thereby, document image data suitable for the size of the liquid crystal display 20 is generated. This document image data is temporarily stored in the memory 47.

  After storing the document image data, the CPU 46 issues a layout analysis command to the layout analysis unit 51. In response to this layout analysis command, the layout analysis unit 51 corrects the vertical position, horizontal position, width, and height registered in the layout information table 39 based on the image processing performed by the image processing unit 50. . Thereby, the size and position of the text area 63 included in each page of the document image 22 can be determined. The corrected layout information table 39 is sent to the CPU 46.

  The CPU 46 issues a display command to the liquid crystal driver 53. In response to this display command, the liquid crystal driver 53 reads out the document image data in the memory 47 and outputs it to the liquid crystal display 20. As a result, the document image 22 is displayed on the liquid crystal display 20.

  As shown in FIG. 8A, when a predetermined selection key of the operation unit 21 is pressed while the document image 22 is displayed, the CPU 46 determines the text area included in the document image 22 based on the layout information table 39. The size and position of 63 are determined. Based on the determination result, the CPU 46 issues a highlight display command for highlighting an arbitrary text region 63 in the document image 22 to the liquid crystal driver 53. As a result, the liquid crystal driver 53 highlights the text area 63 designated by the CPU 46 with the selection frame 64. Thereafter, each time the selection key is pressed, the text area 63 highlighted in the selection frame 64 is switched.

  Returning to FIG. 7, when a predetermined determination key of the operation unit 21 is pressed and an operation for acquiring text information is performed, the CPU 46 reads the document ID and the currently displayed document image 22 from the layout information table 39. The page number and the object ID corresponding to the text area 63 highlighted in the selection frame 64 are read out and sent to the communication data control unit 49. Next, the CPU 46 issues a text distribution request transmission command to the communication data control unit 49 and the wireless communication unit 48.

  Upon receiving a transmission command from the CPU 46, the communication data control unit 49 generates a text distribution request including the terminal ID 56, document ID, page number, and object ID, and sends this text distribution request to the wireless communication unit 48. As a result, a text delivery request (for example, GET http://doc.com/doc/?doc id = 1 / ctx id = 3 HTTP / 1.1˜) is transmitted to the network I / F 27 of the document delivery server 11. The

  The text distribution request accepted by the network I / F 27 is input to the CPU 24 via the communication data control unit 28. The CPU 24 acquires text information in which the document ID, page number, and object ID included in the text distribution request match from the text information table 40 in the text information storage unit 37. Next, the CPU 24 sends the text information to the communication data control unit 28 and issues a transmission command to the communication data control unit 28 and the network I / F 27 with the mobile terminal 12 as the text distribution request source as the destination. Thereby, the text information is transmitted to the wireless communication unit 48 of the mobile terminal 12.

  The text information received by the wireless communication unit 48 is sent to the communication data control unit 49, and further sent from the communication data control unit 49 to the text processing unit 52. Next, the CPU 46 issues a text data generation command to the text processing unit 52. In response to the text data generation command, the text processing unit 52 generates text data for display from the text information. This text data is temporarily stored in the memory 47.

  After storing the text data, the CPU 46 issues a text display command to the liquid crystal driver 53. In response to this display command, the liquid crystal driver 53 reads the text data in the memory 47 and outputs it to the liquid crystal display 20.

  As shown in FIG. 8B, a text image 67 corresponding to the text area 63 selected in FIG. 8A is overlaid on the previous document image 22 and displayed on the liquid crystal display 20. At this time, the CPU 46 controls the liquid crystal driver 53 so that the text image 67 is enlarged and displayed in accordance with the screen of the liquid crystal display 20.

  By displaying the text image 67, the user can easily grasp the content of the text in the document image 22 even on the small liquid crystal display 20 of the mobile terminal 12. As described above, the document distribution server 11 distributes the text information to the mobile terminal 12 when the user desires to confirm the content of the text in the document image 22. Can also be reduced.

  When the enter key of the operation unit 21 is pressed again, the display of the text image 67 is stopped and the document image 22 as shown in FIG. 8A is displayed on the liquid crystal display 20 again. Hereinafter, every time selection and selection determination operation of the text area 63 is performed on the operation unit 21, acquisition and display of text information from the document distribution server 11 are repeatedly executed.

  Next, the document file browsing system 70 according to the second embodiment of the present invention will be described with reference to FIG. In the first embodiment described above, the document distribution server 11 distributes the image file 18 obtained by imaging the distribution request document file 17 for each page to the mobile terminal 12. On the other hand, in the document file browsing system 70, a region image file 73 obtained by imaging the distribution request document file 17 for each object region of each page is distributed from the document distribution server 71 to the portable terminal 72.

  Further, the document file browsing system 70 determines whether or not to execute the imaging of the text area of the distribution request document file 17 according to the model of the portable terminal 72 having a different size and resolution of the liquid crystal display 20. Hereinafter, the document file browsing system 70 will be described in detail. In addition, about the thing same as said 1st Embodiment on a function and a structure, the same code | symbol is attached | subjected and the description is abbreviate | omitted.

  The document file browsing system 70 includes a document distribution server 71 and a portable terminal 72. The document distribution server 71 has basically the same configuration as the document distribution server 11 of the first embodiment. However, the document distribution server 71 includes a CPU (image generation control unit) 75, a text area imaging determination unit (model determination unit, text area imaging determination unit) 76, instead of the CPU 24 and the image generation unit 30. An area image generation unit 77 is provided. The HDD (storage means) 26 is provided with an area image storage unit 78 and a terminal information table 79 instead of the image storage unit 35.

  The area image storage unit 78 stores the area image file 73 described above. In the area image file 73, a page number and an object ID corresponding to the original object are attached to the image data as supplementary information.

  As shown in FIG. 10, in the terminal information table 79, the terminal ID 56, the model of the portable terminal 72 to which the terminal ID 56 is assigned, and the screen information of the liquid crystal display 20 in this model (the width and height of the display screen, And dpi indicating the number of pixels per unit length are stored in association with each other. Thereby, by referring to the terminal information table 79, the screen information for each model of the portable terminal 72 can be determined based on the terminal ID 56.

  Returning to FIG. 9, the text area imaging determination unit 76 refers to the terminal information table 79 to determine the screen information of the liquid crystal display 20 corresponding to the model of the document file distribution request source, and based on this determination result, It is determined whether or not to image the text area 63 of the distribution request document file 17. Specifically, when the character size in the text area 63 displayed on the liquid crystal display 20 is smaller than a predetermined threshold value, it is determined to stop imaging the text area 63.

  The area image generation unit 77 refers to the layout information table 39 acquired by the layout information acquisition unit 42 described above, and virtually prints the distribution request document file 17 for each area of the object included in each page using a virtual printer driver. Thus, the area image file 73 is generated.

  The CPU 75 basically performs the same control as the CPU 24 of the first embodiment. However, the CPU 75 designates an object region in the distribution request document file 17 to be imaged by the region image generation unit 77 based on the determination result of the text region imaging determination unit 76.

  The portable terminal 72 has basically the same configuration as the portable terminal 12 of the first embodiment. However, the mobile terminal 72 is provided with a CPU 81 and a layout processing unit 82 instead of the CPU 46 and the layout analysis unit 51 described above.

  The layout processing unit 82 lays out the area image file 73 based on the layout information table 39 acquired from the document distribution server 71 and generates document image data. As the document image data, when the area image file 73 of the text area 63 is acquired from the document distribution server 71, the same data as when imaged for each page as in the first embodiment is obtained. Conversely, when the area image file 73 of the text area 63 is not acquired, the data corresponding to the text area 63 is not included in the document image data.

  The CPU 81 basically performs the same control as the CPU 46 of the first embodiment. However, if the data corresponding to the text area 63 is not included in the document image data, the CPU 81 causes the area corresponding to the text area 63 of the document image 22 to be displayed indicating that it is the text area 63.

  Next, the flow of processing when browsing the document file 17 on the portable terminal 72 will be described using the flowchart shown in FIG. The processing flow is the same as that in the first embodiment described above until the document distribution server 71 generates the layout information table 39 and the text information table 40 based on the document file distribution request from the portable terminal 72. After the tables 39 and 40 are stored in the layout information storage unit 36 and the text information storage unit 37, respectively, the CPU 75 issues an imaging determination command to the text area imaging determination unit 76. This imaging determination command is given the terminal ID 56 included in the document file distribution request.

  As shown in FIG. 12, the text region imaging determination unit 76 operates in response to an imaging determination command from the CPU 75. First, the text region imaging determination unit 76 refers to the terminal information table 79 in the HDD 26 based on the terminal ID 56 and searches for the model of the portable terminal 72 corresponding to the terminal ID 56 and the screen information of the liquid crystal display 20. To do.

Next, the text area imaging determination unit 76 displays the number of pixels per character of the character and the character length in the image obtained by the virtual printing at the time of acquiring the layout information, and the screen of the liquid crystal display 20 corresponding to the terminal ID 56. Based on the information, the number p of pixels per character and the character length L when the region image of each text region 63 is displayed on the liquid crystal display 20 are obtained. Then, the text area imaging determination unit 76 sets the pixel per character described above when the preset threshold number of pixels per character is pt and the length threshold per character is Lt. It is determined whether the number p and the character length L satisfy the imaging stop condition consisting of the following formulas (1) and (2).
(1) pt> p
(2) Lt> L

  The text area imaging determination unit 76 determines imaging for the text area 63 that does not satisfy either of the above formulas (1) and (2), and at least one of the above formulas (1) and (2). For the text region 63 that satisfies one of them, the imaging stop is determined. The determination result of the text area imaging determination unit 76 is sent to the CPU 75.

  In response to the determination result of the text region imaging determination unit 76, the CPU 75 issues a region image generation command to the region image generation unit 77. At this time, the CPU 75 issues a command to stop imaging for the text area 63 for which the text area imaging determination unit 76 has determined to stop imaging.

  The area image generation unit 77 operates in response to an area image generation command from the CPU 75. The area image generation unit 77 refers to the layout information table 39 and generates the area image file 73 by virtually printing the distribution request document file 17 with the virtual printer driver for each object area of each page. At this time, the CPU 75 does not image the text area for which the imaging stop is designated by the CPU 75. As a result, the imaging of the text region on the screen of the portable terminal 72 is stopped for the text region that is too small to grasp the content. Each area image file 73 is stored in the area image storage unit 78 of the HDD 26 after being given a page number and an object ID.

  Returning to FIG. 11, the CPU 75 reads the area image file 73 and the layout information table 39 from the area image storage unit 78 and the layout information storage unit 36, respectively, and sends them to the communication data control unit 28. Thereafter, the area image file 73 and the layout information table 39 are transmitted to the wireless communication unit 48 of the mobile terminal 12 in the same manner as in the first embodiment.

  Each area image file 73 and layout information table 39 received by the wireless communication unit 48 are sent from the communication data control unit 49 to the image processing unit 50 and the layout processing unit 82, respectively. The image processing unit 50 appropriately performs image processing on each region image file 73 and then sends the image processing unit 50 to the layout processing unit 82. Next, the CPU 81 issues a layout command for the area image file 73 to the layout processing unit 82.

  Upon receiving a layout command from the CPU 81, the layout processing unit 82 lays out each area image file 73 based on the previously acquired layout information table 39 and the page information and object ID assigned to each area image file 73. Then, document image data is generated. The document image data is stored in the memory 47 after being converted into data suitable for the size of the liquid crystal display 20 by the image processing unit 50 as in the first embodiment. In addition, the layout processing unit 82 corrects the layout information table 39 and sends it to the CPU 81 as in the first embodiment.

  The CPU 81 issues a display command to the liquid crystal driver 53. In response to this display command, the liquid crystal driver 53 reads out the document image data in the memory 47 and outputs it to the liquid crystal display 20. When the area image file 73 of the text area 63 is acquired from the document distribution server 71, the document image 22 as described with reference to FIG. 8A is displayed on the liquid crystal display 20.

  On the other hand, when the area image file 73 of the text area 63 is not acquired from the document distribution server 71, the data corresponding to the text area 63 is not included in the document image data. In this case, as shown in FIG. 13A, the CPU 81 displays a mark 84 indicating the text area 63 in an area corresponding to the text area 63 of the document image 22 based on the layout information table 39. Thus, the liquid crystal driver 53 is controlled. Thereby, the user can recognize that the area where the mark 84 is displayed is the text area 63.

  Thereafter, as in the first embodiment, when an arbitrary mark 84 in the document image 22 is selected with the selection frame 64 and a selection determination operation is performed, the text indicated by the mark 84 is shown in FIG. 13B. A text image 67 corresponding to the region 63 is displayed on the liquid crystal display 20. Since the area image file 73 of the text area 63 whose contents are difficult to grasp on the screen of the mobile terminal 12 is not distributed to the mobile terminal 72, the amount of data to be distributed to the mobile terminal 72 than in the first embodiment Can be reduced.

  In the second embodiment, a mark 84 is displayed instead on the text area 63 on the document image 22 where the text area imaging determination unit 76 has determined to stop imaging. With respect to the text area 63, there is a high possibility that a text information distribution request is made to the document distribution server 71 in order to confirm the contents. For this reason, when the document distribution server 71 distributes the area image file 73 or the like to the portable terminal 72, the text information of the text area 63 for which the area image file 73 is not generated may be simultaneously distributed to the portable terminal 72.

  In such a case, the portable terminal 72 acquires the text information corresponding to the text area 63 when the selection decision operation for the arbitrary text area 63 in the document image 22 is performed. The text image 67 is displayed based on the completed text information. Moreover, the portable terminal 72 acquires from the document delivery server 71 as mentioned above, when the corresponding text information is not acquired.

  In the second embodiment, on the document image 22 displayed on the mobile terminal 12, the text region imaging determination unit 76 displays the mark 84 in the text region 63 determined to stop imaging. 84 is not limited to the mark having the shape shown in FIG. 13A, and may be a shape such as “x”, for example. Further, for example, the title of the document file 17 may be displayed instead of the mark 84.

  The layout information acquisition unit 42 of the first and second embodiments generates the layout information table 39 by virtually printing the distribution request document file 17 using a virtual printer driver. The layout information table 39 may be generated from the converted image file 18.

  For example, the image file 18 is analyzed, divided into regions for each object block included in the image, and region division processing (see Japanese Patent Application Laid-Open No. 2009-193254) for determining the attribute of each region is performed. A layout information table 39 can be generated. Further, by opening the document file 17 with a predetermined viewer application software, the image of the document file 17 is developed on the memory buffer, and the layout analysis table is similarly analyzed by performing the layout analysis by the above-described area division processing or the like. 39 can be generated.

  In this case, the text information acquisition unit 43 may acquire the text information from each text area of the image based on the layout information table 39 by a known OCR (Optical Character Recognition) process. Note that the method of acquiring layout information and text information from the document file 17 and its image is not limited to the method described above, and various known methods can be used.

  In the first and second embodiments, the mobile phone type mobile terminal has been described as an example. However, for example, the present invention is applied to various mobile terminals such as a PDA type and a notebook personal computer type. be able to.

DESCRIPTION OF SYMBOLS 10,70 Document file browsing system 11,71 Document delivery server 12,72 Portable terminal 17 Document file 18 Image file 21 Operation part 22 Document image 24,75 CPU
DESCRIPTION OF SYMBOLS 30 Image generation part 39 Layout information table 40 Text information table 42 Layout information acquisition part 43 Text information acquisition part 46,81 CPU
51 Layout Analysis Unit 63 Text Area 67 Text Image 76 Text Area Imaging Determination Unit 77 Area Image Generation Unit 82 Layout Processing Unit 84 Mark

Claims (7)

In a document file browsing system comprising a distribution server and a mobile terminal connected to the distribution server via a network,
The distribution server
From the mobile terminal, and the first delivery request receiving means for receiving a distribution request of the document file,
A document file acquisition unit that acquires a document file corresponding to the distribution request from a document file storage unit that stores the document file based on the distribution request received by the first distribution request reception unit;
Analyzing the document file acquired by the document file acquisition unit, and acquiring layout information of an object including at least text and an image included in the document file;
An area image generating means for generating an area image file obtained by imaging a document file for each area of the object based on the layout information;
Text information acquisition means for acquiring text information from each text region of the document file based on the layout information and storing it in the text information storage unit;
A first delivery means for delivering said area image files and the layout information to the portable terminal,
And the second delivery request receiving means for receiving a distribution request of the text information from the mobile terminal,
Text information acquisition means for acquiring text information corresponding to the distribution request received by the second distribution request reception means from the text information storage unit;
A second distribution means for distributing the text information the text information acquisition means has acquired to the portable terminal,
With
The portable terminal is
First distribution request transmitting means for transmitting a document file distribution request to the first distribution request receiving means;
First acquisition means for acquiring the area image file and layout information distributed from the first distribution means;
Layout means for laying out the area image file based on the layout information and generating document image data;
Display means for displaying a document image based on the sentence image data and displaying a text area in the document image based on the layout information so as to be selectable;
Selecting means for selecting an arbitrary text area from the text area in the document image;
Second distribution request transmission means for transmitting a distribution request for text information corresponding to the text area selected by the selection means to the distribution server;
Second acquisition means for acquiring the text information distributed from the second distribution means;
Display control means for causing the display means to display the text information acquired by the second acquisition means;
A document file browsing system comprising: The distribution server
A model discriminating means for discriminating a model of the portable terminal that has made a delivery request for the document file;
Text area imaging determination means for determining whether or not to execute imaging of the text area included in the document file according to the model of the mobile terminal determined by the model determination means;
An image generation control unit that controls the image generation unit so as to perform imaging of an area other than the text area that is determined not to be imaged by the text area imaging determination unit. Item 1. A document file browsing system according to Item 1 . The distribution server includes a storage unit that stores a data table in which a model of the mobile terminal is associated with screen information indicating the size and the number of pixels of the display unit of the display unit for each model,
Whether the text area imaging determination means performs imaging of the text area based on the screen information corresponding to the model of the portable terminal determined by the model determination means with reference to the data table The document file browsing system according to claim 2 , wherein the document file browsing system is determined. If the first acquisition means does not acquire the area image file corresponding to the text area of the document file from the distribution server, the layout means does not include the data corresponding to the text area. generates Zode over data, wherein the display control unit, based on the layout information, the area corresponding to the text area of the document image, and wherein the displaying a mark indicating that it is a text area according Item 4. The document file browsing system according to Item 2 or 3 . Wherein the first delivery request transmitting means of the mobile terminal, sends a delivery request for the document file that contains the unique identification information indicating the model of the portable terminal to the distribution server,
The model determination unit of the distribution server determines a model of the portable terminal based on the unique identification information included in the document file distribution request received by the first distribution request reception unit. The document file browsing system according to any one of 2 to 4 . Wherein the display control unit, a document file browsing system according to any one of claims 1 to 5, characterized in that to display by superimposing the text information on the document image. Wherein the display control unit, the text information, the display means a document file browsing system of claims 1 to 6 any one of claims, characterized in that enlarged and is displayed in accordance with the display screen.

Images