JP2008250941A - Document collecting method, document collecting program and document collecting device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make it possible to collect a wide variety of documents for mobile terminals. <P>SOLUTION: A document collecting server collects documents for personal computers from sites for personal computers having close links between the sites, and makes an analysis for extracting only URLs (uniform resource locators) (A) to (D) of documents for mobile terminals by applying a predetermined pattern matching rule (e.g., extraction or the like of URL for a portable version URL http://xxx) to the collected documents for the sites for personal computers utilizing a point of giving notice of sites for mobile terminals at the sites for personal computers, and a link structure between the sites for mobile terminals can be interpolated with information of sites for personal computers (black circles) by collecting documents for mobile terminals based on the URLs of documents for mobile terminals. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a document collection method, a document collection program, and a document collection apparatus for collecting documents for mobile terminals by following website links.

  In recent years, since mobile terminals such as mobile phones, PHS, and PDAs have become widespread, access to the Internet has been frequently made through these mobile terminals. A site for terminals is provided.

  Along with this, documents published on the Internet are used in hypertext to be used for various purposes such as collecting documents to be searched by search engines and collecting documents for extracting information. A method has been proposed for collecting hyperlinks from cues.

  For example, in Patent Document 1, it is determined whether a web page can be displayed on a mobile phone. If the web page can be displayed, the web page is saved and link information is acquired. In addition, a web page collection system is disclosed in which the next web page is acquired, the display possibility is recursively determined, and web pages highly compatible with a mobile phone are sequentially collected.

JP 2003-216525 A

  However, in the above-described prior art (Patent Document 1), although it is determined whether a document to be collected is for a portable terminal, a link between websites is just like a Web crawler that collects documents for a fixed terminal. Since it is based on the assumption that there are links, there is a problem that the number of documents for mobile terminal sites where links between websites are sparse is limited.

  This will be explained in detail. In the hypertext published for fixed terminals, hyperlinks are actively created not only for the local site but also for documents on other sites. However, in the hypertext published for mobile devices, a mechanism for small-scale billing by carriers has been built, and users are kept within their own site. Since this is important for document providers, it is reluctant to create hyperlinks to documents on other sites.

  In this way, in the mobile terminal site, since there are few links to other sites, it is difficult to detect an unknown website with a web crawler that only circulates the website, and a wide variety of mobile terminals. It is not possible to collect documents for use.

  From the above, when collecting documents provided on a mobile device site, how to expand the range of documents that can be collected and collect a wide variety of mobile device documents is an extremely important issue. ing.

  Therefore, the present invention has been made to solve the above-described problems (problems) of the prior art, and expands the range of documents that can be collected when collecting documents provided on a mobile terminal site. Accordingly, an object of the present invention is to provide a document collection method, a document collection program, and a document collection apparatus that can collect a wide variety of documents for portable terminals.

  In order to solve the above-mentioned problems and achieve the object, a document collection method according to the present invention is a document collection method in which a computer collects documents for mobile terminals by following links on websites, and the computer , A document collection process for a fixed terminal that collects documents for a fixed terminal from a site for a fixed terminal in the website, and position information of the document for a mobile terminal from the document for the fixed terminal collected by the document collection process for the fixed terminal A document analysis process for analyzing the mobile terminal, and a mobile terminal document collection process for collecting the mobile terminal document based on the location information of the mobile terminal document analyzed by the document analysis process. And

  In the document collection method according to the present invention, the fixed terminal document collection step further collects images included in the fixed terminal document, and the document analysis step includes the fixed terminal document collection step. When an image is collected as a document for a terminal, position information of the document for a portable terminal is analyzed from a predetermined code embedded in the image.

  Further, in the document collection method according to the present invention, the document analysis step analyzes the input form of the e-mail address of the portable terminal from the document for the fixed terminal collected by the document collection step for the fixed terminal, and the computer Further, an e-mail address transmitting step of transmitting a predetermined e-mail address to the site for the fixed terminal from which the document for the fixed terminal is collected by the document collecting step for the fixed terminal; A mail acquisition step of acquiring the response mail from the terminal and a mail analysis step of analyzing position information of the document for the portable terminal from the response mail acquired by the mail acquisition step are performed.

  Further, in the document collection method according to the present invention, the document collection step for the portable terminal uses the user agent representing the portable terminal to store the position information of the document for the fixed terminal collected in the document collection step for the fixed terminal. It is characterized by access.

  In the document collection method according to the present invention, the computer further collects documents collected using the user agent representing the portable terminal by the document collection step for portable terminals by the document collection step for fixed terminals. The duplication possibility determination step for determining whether or not the content is the same as the document for the fixed terminal is executed, and the document collection step for the portable terminal is determined to have the same content by the duplication possibility determination step. In this case, the document is discarded.

  A document collection program according to the present invention is a document collection program for causing a computer to execute a document collection process for collecting documents for mobile terminals by following website links. Document collection procedure for fixed terminal for collecting documents for fixed terminal, document analysis procedure for analyzing position information of document for portable terminal from documents for fixed terminal collected by document collection procedure for fixed terminal, and document analysis It is characterized by causing a computer to execute a document collection procedure for a portable terminal that collects the document for a portable terminal based on the position information of the document for a portable terminal analyzed by the procedure.

  The document collection device according to the present invention is a document collection device that collects documents for mobile terminals by following website links, and is a fixed device that collects documents for fixed terminals from a site for fixed terminals among the websites. Document collecting means for terminal, document analyzing means for analyzing position information of document for portable terminal from documents for fixed terminal collected by document collecting means for fixed terminal, and for portable terminal analyzed by said document analyzing means And a portable terminal document collecting unit that collects the portable terminal document based on the document position information.

  According to the present invention, a document for a fixed terminal is collected from a site for a fixed terminal among websites, position information of the document for a portable terminal is analyzed from the collected document for a fixed terminal, and the analyzed document for the portable terminal is analyzed. Since it is configured to collect documents for mobile terminals based on location information, the link structure between sites for mobile terminals can be interpolated with information on sites for fixed terminals, and it is scattered without being linked. A wide variety of mobile terminal documents can be collected from a wide range of mobile terminal sites.

  In addition, according to the present invention, when the images included in the document for fixed terminals are further collected and the images are collected as the documents for fixed terminals, the position information of the document for portable terminals is obtained from the predetermined code embedded in the images. Therefore, even if the site for the fixed device embeds the notification of the site for the mobile device in the image, the location information of the document for the mobile device can be extracted and collected. The range can be effectively expanded.

  Further, according to the present invention, the input form of the mobile terminal e-mail address is analyzed from the collected document for the fixed terminal, the predetermined e-mail address is transmitted to the site for the fixed terminal from which the document for the fixed terminal is collected, and the response Since the response mail is acquired from the mobile terminal to which the mail is responded and the position information of the document for the mobile terminal is analyzed from the acquired response mail, the notification of the site for the mobile terminal by the site for the fixed terminal is used. Even if the user's input operation is involved, the position information of the portable terminal document can be automatically extracted, and the range of portable terminal documents that can be collected can be effectively expanded.

  In addition, according to the present invention, the user agent representing the mobile terminal is used to access the collected location information of the document for the fixed terminal, so that the document to be provided differs depending on the access source device type. Documents for mobile terminals can be collected even from sites, and the range of documents for mobile terminals that can be collected can be expanded in many ways.

  In addition, according to the present invention, it is determined whether or not the document collected using the user agent representing the mobile terminal has the same content as the collected document for the fixed terminal, and it is determined that the document has the same content In addition, since the document is configured to be discarded, it is possible to discard the same extra information as the document for the fixed terminal even if the document is acquired as a portable terminal.

  Exemplary embodiments of a document collection apparatus (document collection method) according to the present invention will be described below in detail with reference to the accompanying drawings. In the following description, the document collection server according to the present invention will be described as the first and second embodiments, and then another embodiment included in the present invention will be described as the third embodiment.

  In the following first embodiment, the outline and features of the document collection server according to the first embodiment, the configuration of the document collection server, and the flow of processing will be described in order.

[Outline and Features (Example 1)]
First, the outline and features of the document collection server according to the first embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is an explanatory diagram for explaining an outline of the document collection server according to the first embodiment, and FIG. 2 is a conceptual diagram for explaining features of the document collection server according to the first embodiment.

  As shown in FIG. 1, this document collection server 10 outlines collecting documents for mobile terminals by following website links, and provides a wide variety of documents published on the web. In addition to being connected to the document providing server 30 via the Internet 1, it is also connected via a cable 3 to a mobile phone 50 for supporting collection of documents for mobile terminals.

  The document providing server 30 includes a document providing server 30A that provides a document for a fixed terminal (hereinafter, a document for PC), a document providing server 30B that provides a document for a portable terminal (hereinafter, portable document), There is a document providing server 30C that provides both the PC document and the portable terminal document.

  Here, the document collection server 10 according to the first embodiment collects the PC document from the PC site among the websites published on the Web, and obtains the position information of the portable document from the collected PC document. This is characterized in that the portable document is collected based on the analyzed position information of the portable document.

  That is, in the first embodiment, attention is paid to the fact that the site for the mobile site is being notified on the PC site, and the mobile document is collected through the URL to the mobile site described in the PC site. Therefore, it is possible to interpolate a sparse link structure between mobile sites.

  This will be explained with reference to FIG. 2. The document collection server 10 has a dense link between sites for PC sites (white circles), and it is easy to collect documents for PCs using an existing Web crawler or the like. Therefore, PC documents are first collected from the PC site. On the other hand, since the mobile site (black circle) is enclosed in the user's own site, the links between sites are sparse, and simply following the link in the mobile site is another site. Documents cannot be collected.

  Therefore, the document collection server 10 uses the fact that the notification of the mobile site is performed on the PC site, and uses a predetermined pattern matching rule (for example, mobile version URL) on the collected PC site document. http: // extracting the URL, etc.) to extract only the URLs (i) to (d) of the portable document, and the document based on the URL of the portable document A portable document is collected from the providing server 30. For example, in the site for PC, the document position information (address such as URL) of the mobile terminal version of its own site is notified to the user, and in the news site, a new service or topic for mobile terminals is announced. The service is posted as an article and its URL is notified to the user.

  Therefore, in the first embodiment, the PC document is collected from the PC site, and the mobile document is collected through the document position information to the mobile site described in the PC site. Therefore, it is possible to interpolate the link structure between mobile sites with PC site information, and not only from specific mobile site documents, but also from a wide variety of mobile sites scattered without being linked. It becomes possible to collect documents for.

[Configuration of document collection server]
Next, the configuration of the document collection server according to the first embodiment will be described with reference to FIG. FIG. 3 is a functional block diagram illustrating the configuration of the document collection server according to the first embodiment. As shown in the figure, the document collection server 10 includes a communication control IF unit 11 that is an interface for controlling various communications with the Internet 1 or the cable 3, a PC document management DB 12, and a portable document. A management DB 13 and a control unit 14 are provided.

  The PC document management DB 12 is a database for managing a web page (PC document) for a fixed terminal such as a personal computer. Specifically, for each PC document ID, document position information of the PC document. The collection status flag, the analysis status flag, and the document source code are stored in association with each other. For example, the example shown in FIG. 4 shows a situation where the source code of the document with the document ID “00001” for PC has been collected and has not been analyzed. This collection status flag is a flag indicating whether a PC document has been collected, has not been collected, or has failed to be acquired. “1” indicates that the document has been collected and “0” indicates that the document has not been collected. The acquisition failure is represented by “−1”, and the analysis status flag is a flag indicating whether the PC document has been analyzed, has not been analyzed, or analysis is not necessary. "1", "0" for unanalyzed, and "-1" for analysis unnecessary.

  The portable document management DB 13 is a database for managing web pages (portable documents) for portable terminals such as mobile phones, PHSs, PDAs, etc. Specifically, for each portable document ID, a portable document is stored. The document position information, the collection status flag, the User-Agent, and the document source code are stored in association with each other. The collection status flag is a flag indicating whether the portable document has been collected, has not been collected, or has failed to be acquired. , Acquisition failure is represented by “−1”.

  For example, in the example shown in FIG. 5, the source codes of the documents with portable document IDs “00001” and “00002” have been collected, and the source codes of the documents with portable document IDs “00003” and “00009” are collected. Indicates the status of not yet collected. On the other hand, in the example shown in FIG. 6, the source codes of the documents with portable document IDs “00001”, “00002”, “00004”, “00005”, “00008”, and “000009” have been collected. The source code of the documents with portable document IDs “00003”, “00006”, and “00007” indicates that acquisition is unsuccessful.

  The control unit 14 is a control unit that controls the document collection server 10 as a whole, and includes a PC document collection unit 14a, a document analysis unit 14b, a mail address transmission processing unit 14c, a mail acquisition / analysis unit 14d, and a portable unit. And a document collection unit 14e. In practice, programs corresponding to these functional units are stored in a ROM or a non-volatile memory (not shown), and these programs are loaded into the CPU and executed, and the PC document collection unit 14a, document analysis unit 14b, Processes corresponding to the mail address transmission processing unit 14c, the mail acquisition / analysis unit 14d, and the portable document collection unit 14e are executed.

  The PC document collection unit 14a is a processing unit that collects PC documents from the document providing server 30A or 30C. Specifically, the document for PC is collected from the document providing server 30A or 30C by following the link in HTML, and the collected document for PC is registered in the document management DB 12 for PC.

  The document analysis unit 14 b is a processing unit that analyzes position information of a portable document from a PC document stored in the PC document management DB 12. Specifically, the analysis for extracting the position information of the portable document is performed by applying the pattern matching rule shown in FIG. 7 to the PC document stored in the PC document management DB 12. For example, in the example shown in FIG. 8, the URL matches “http://jp.com” because it matches the pattern matching rule “mobile site URL. {0, 20} (http [s]: ¥ / ¥ /... "hutsutsu ..." is extracted.

  Further, when an image is collected as a PC document in the PC document management DB 12, the document analysis unit 14 b analyzes the position information of the portable document from a predetermined code embedded in the image. For example, when the QR code is decoded using the image read from the PC document management DB 12 as an input, and as a result, the decoding is successful and the decoded character string includes “http”, the position of the portable document The URL is additionally registered in the portable document management DB 13 as information and an uncollected flag is set.

  Here, the reason for performing such image analysis is that, when a mobile site is notified on a PC site, the URL itself is not always described, and as shown in FIG. This is because the position information of the portable document may be extracted even in such a case.

  The e-mail address transmission processing unit 14c is a processing unit that transmits a predetermined e-mail address to the PC-oriented site when the document analysis unit 14b analyzes the input form of the e-mail address of the portable terminal from the PC-oriented document. For example, as shown in FIG. 10, when the free input element of the character string and the mail domain selection element of the mobile terminal are analyzed from the form in the document for PC by the document analysis unit 14b, Then, the information corresponding to the mail domain selection element in the form is transmitted to the document providing apparatus 30A or 30C. Here, an example in which both the free input element of the character string and the mail domain selection element of the mobile terminal are included in the input form has been described, but the present invention is also applied to the case where the input form includes only the free input element. The same can be applied.

  The mail acquisition / analysis unit 14d is a processing unit that acquires the response mail from the mobile phone 50 to which the response mail is responded by the document providing device 30A or 30C and analyzes the position information of the portable document. Specifically, a backup of the response mail is acquired from the mobile phone 50, and an analysis is performed to extract a character string starting with “http” and ending with a blank or a line feed from the acquired response mail.

  Here, the transmission of the e-mail address and the acquisition / analysis of the response e-mail are performed because the URL itself is described when the mobile site is notified on the PC site, as shown in FIG. In some cases, the location information of the portable site can be obtained only after the user inputs his / her e-mail address. In this case, the location information of the portable document is automatically extracted.

  The portable document collection unit 14e is a processing unit that collects documents for portable terminals based on position information of portable documents stored in the portable document management DB 13. Specifically, among the portable document IDs stored in the portable document management DB 13, access is made to the document position information of the uncollected flag “0” stored as the collection status flag, and the document providing server 30B or 30C is accessed. To obtain the mobile document.

[Process flow]
Next, procedures of various processes of the document collection server 10 according to the first embodiment will be described. Here, (1) PC document collection processing, (2) document analysis processing, (3) image analysis processing, (4) email address transmission processing, (5) email acquisition / analysis processing, (6) mobile phone use The document collection process will be described in this order.

(1) PC Document Collection Processing As described above, here, the PC document collection processing according to the first embodiment will be described with reference to FIG. FIG. 12 is a flowchart illustrating a procedure of document collection processing for PC according to the first embodiment. As shown in the figure, the PC document collection unit 14a first adds the origin document position information to the PC document management DB 12 (step S1201).

  Subsequently, the PC document collection unit 14a acquires document position information whose uncollected flag is on from the PC document management DB 12 (step S1202). At this time, if there is no document position information in which the uncollected flag is on, the PC documents corresponding to all the document position information are collected, so acquisition of the document position information fails (Yes in step S1203). The process is terminated.

  If the document position information whose uncollected flag is ON can be acquired (No at Step S1203), the PC document collection unit 14a accesses the acquired document position information via the Internet 1 (Step S1204). ).

  At this time, if the PC document corresponding to the document position information can be acquired from the document providing server 30A or 30C (Yes in step S1205), the PC document collection unit 14a acquires the acquired PC document, the collected flag, and the unanalyzed flag. (Step S1206), the linked document and the position information of the referenced image are acquired from the PC document (step S1207), and the acquired unregistered document position information and uncollected flag are obtained. It is additionally registered in the PC document management DB 12 (step S1208).

  On the other hand, if the PC document corresponding to the document position information cannot be acquired from the document providing server 30A or 30C (No in step S1205), the PC document collection unit 14a sets the acquisition failure flag and the analysis unnecessary flag to the PC document management. Save in the DB 12 (step S1209).

  In this “PC document collection processing”, the processing from step S1202 to step S1209 is repeatedly performed by the PC document collection unit 14a until there is no document position information whose uncollected flag is on (No in step S1203). .

(2) Document Analysis Processing Next, the document analysis processing according to the first embodiment will be described with reference to FIG. FIG. 13 is a flowchart illustrating the procedure of document analysis processing according to the first embodiment. As shown in the figure, the document analysis unit 14b acquires a PC document whose unanalyzed flag is on from the PC document management DB 12 (step S1301).

  Here, if there is no PC document with the unanalyzed flag turned on, all PC documents have been analyzed, so acquisition of PC documents has failed (Yes in step S1302), and the processing is performed. finish.

  If the PC document having the unanalyzed flag turned on can be acquired (No in step S1302), the document analysis unit 14b determines whether the acquired PC document is an image, and this is an image. If not (No in step S1303), the pattern matching rule shown in FIG. 7 is applied to the PC document stored in the PC document management DB 12 to extract the position information of the portable document (step S1304). If the PC document is an image (Yes at step S1303), “image analysis processing” described later is performed to extract position information of the portable document embedded in the QR code or the like (step S1305).

  Thereafter, the document analysis unit 14b manages the position information of the portable document extracted using the pattern matching rule in this way or the position information of the portable document extracted through the “image analysis process” and the uncollected flag. It adds to DB13 (step S1306).

  Then, the document analysis unit 14b determines whether or not the form in the PC document includes the free input element of the character string and the mail domain selection element of the mobile terminal (step S1307). If (Yes at step S1307), a “mail address transmission process” described later is performed to transmit a predetermined mail address to the document providing server 30 that provides the document for the PC (step S1308).

  Subsequently, the document analysis unit 14b sets an analyzed flag in the document position information record analyzed in the above-described processing in steps S1301 to S1308 (step S1309), and again from the PC document management DB 12 A document for PC whose analysis flag is on is acquired (step S1301).

  Thereafter, the document analysis unit 14b repeats the processing from step S1301 to step S1309 until there are no PC documents whose unanalyzed flag is on (No in step S1302).

(3) Image Analysis Processing Next, image analysis processing according to the first embodiment will be described with reference to FIG. FIG. 14 is a flowchart illustrating a procedure of image analysis processing according to the first embodiment. This “image analysis processing” corresponds to the processing in step S1305 shown in FIG.

  As shown in FIG. 14, the document analysis unit 14b decodes the QR code by using the image read from the PC document management DB 12 as an input (step S1401). As a result, the decoding is successful and the decoded character string. If “http” is included in the URL (No in Step S1402 and Yes in Step S1403), the decoding result is specified as the position information of the portable document (Step S1404), and the process proceeds to Step S1306 shown in FIG.

  Even if the decoding is successful, if the decoded character string does not include “http” (No at Step S1402 and No at Step S1403) and if the decoding fails (Yes at Step S1402), the document analysis unit 14b specifies that the position information of the portable document has not been acquired (step S1405), and the process proceeds to step S1306 shown in FIG.

  As described above, when an image is collected as a PC document, since the position information of the portable document is analyzed from a predetermined code embedded in the image, the PC site notifies the portable site. Even in the case of embedded in the image, the position information of the portable document can be extracted, and the range of portable documents that can be collected can be effectively expanded.

(4) Mail Address Transmission Process Next, the mail address transmission process according to the first embodiment will be described with reference to FIG. FIG. 15 is a flowchart illustrating a procedure of mail address transmission processing according to the first embodiment. This “mail address transmission process” corresponds to the process of step S1308 shown in FIG. 13, and the document analysis unit 14b uses a free input element of a character string in the form in the PC document and the mail domain of the portable terminal. The process is started when it is determined that the selected element is included (Yes at step S1307).

  As shown in FIG. 15, the mail address transmission processing unit 14c acquires the action attribute of the form tag, determines the mail address transmission destination (step S1501), and then reads a mail address list (not shown) (step S1502).

  Here, at the beginning of reading of the mail address list, the processing has not been completed for all mail addresses (No at step S1503), and the mail address transmission processing unit 14c performs processing of unprocessed mail addresses from the mail address list. (Step S1504), and it is determined whether or not any mail domain selection element in the form of the PC document matches the domain of the mail address to be processed (step S1505).

  If there is something that matches the domain of the mail address to be processed (Yes at step S1505), the mail address transmission processing unit 14c sets the user name of the mail address to be processed as the value of the free input element of form. (Step S1506), the value of the form selection element is set to a value corresponding to the domain of the mail address to be processed (Step S1507), and the values of the free input element and the selection element are transmitted to the mail address destination (Step S1508). ), The mail address to be processed is processed (step S1509).

  If there is no domain that matches the domain of the processing target email address (No at step S1505), the email address transmission processing unit 14c determines that the processing target email address has been processed as it is (step S1509).

  Thereafter, the mail address transmission processing unit 14c repeats the processes from step S1504 to step S1509 described above until the processing is completed for all mail addresses described in the mail address list (No in step S1503).

(5) Mail Acquisition / Analysis Processing Next, mail acquisition / analysis processing according to the first embodiment will be described with reference to FIG. FIG. 16 is a flowchart illustrating the procedure of the mail acquisition / analysis process according to the first embodiment. This mail acquisition / analysis process is linked to the above-mentioned “mail address transmission process”, and if the mail address is transmitted to the document providing server 30A or 30C by the mail address transmission processing unit 14c, the document providing server 30A or The response mail from 30C is accumulated as unread mail.

  As shown in the figure, the mail acquisition / analysis unit 14d acquires a backup of the mail from the mobile phone 50 (step S1601), and checks whether there is an unread mail (step S1602).

  If it is confirmed that there is an unread mail (No at step S1602), the mail acquisition / analysis unit 14d identifies one of the unread mails as a processing target mail (step S1603), A character string starting with “http” and ending with a blank or a line feed is extracted from the processing target mail and specified as position information of the portable document (step S1604), and the position information of the portable document and the uncollected flag are set. While adding to the portable document management DB 13 (step S1605), the processing target mail is marked as read (step S1606).

  Thereafter, until there is no unread mail (No at Step S1602), the mail acquisition / analysis unit 14d repeats the processes from Step S1603 to Step S1606.

  In this way, the input form of the e-mail address of the mobile terminal is analyzed from the PC document, the predetermined e-mail address is transmitted to the PC site where the PC document is collected, and the response mail is responded by the PC site. Since the response mail is acquired from the mobile terminal and the position information of the mobile document is analyzed from the acquired response mail, the notification of the mobile site by the PC site is accompanied by a user input operation. Even if there is, the position information of the portable document can be automatically extracted, and the range of portable documents that can be collected can be effectively expanded.

(6) Portable Document Collection Processing Next, portable document collection processing according to the first embodiment will be described with reference to FIG. FIG. 17 is a flowchart illustrating the procedure of the portable document collection process according to the first embodiment. As shown in the figure, the portable document collection unit 14e acquires document position information whose uncollected flag is on from the portable document management DB 13 (step S1701).

  At this time, if there is no document position information for which the uncollected flag is ON, it means that portable documents corresponding to all the document position information are collected, and acquisition of the document position information fails (Yes in step S1702). The process is terminated.

  If the document position information whose uncollected flag is ON can be acquired (No at Step S1702), the portable document collection unit 14e accesses the acquired document position information via the Internet 1 (Step S1703). ).

  At this time, if the portable document corresponding to the document position information can be acquired from the document providing server 30B or 30C (Yes in step S1704), the portable document collection unit 14e stores the acquired portable document and the collected flag. (Step S1705) The position information of the linked document is acquired from the portable document (Step S1706), and the acquired unregistered document position information and the uncollected flag are additionally registered in the portable document management DB 13 ( Step S1707).

  On the other hand, if the portable document corresponding to the document position information cannot be acquired from the document providing server 30B or 30C (No in step S1704), the portable document collection unit 14e stores the acquisition failure flag in the portable document management DB 13. (Step S1708).

  In this “portable document collection process”, the steps from S1701 to S1708 are repeatedly performed by the portable document collection unit 14e until there is no document position information whose uncollected flag is on (No in step S1702). .

  As described above, in the first embodiment, the PC document is collected from the PC site among the websites published on the web, the position information of the portable document is analyzed from the collected PC document, Since the mobile document is collected based on the analyzed location information of the mobile document, the link structure between the mobile sites can be interpolated with the information on the PC site, and the link is not performed. It is possible to collect a wide variety of portable documents from a wide range of portable sites scattered around.

  Next, the document collection server according to the second embodiment will be described. In the second embodiment, the description of the same configuration and function as those of the first embodiment will be omitted, and only the difference between them will be described.

  Here, the second embodiment is characterized in that the location information of the PC document collected by the PC document management DB 12 is accessed using the “User-Agent” representing the mobile terminal. Portable documents can be collected even from websites that provide different documents according to the original device type.

  In other words, when accessing a URL for which the uncollected flag stored in the portable document management DB 13 is on, the User-Agent name in the HTTP request header is changed to the model name of the portable terminal and the document providing server 30 is accessed. Then, the document providing server 30 can identify the request as if it is a request from a portable terminal, and if the document to be provided differs depending on the device type of the access source, the portable document can be provided.

  Therefore, even if it is collected as a document for PC, if the same document position information is accessed with a mobile terminal, the possibility of obtaining a document for mobile cannot be excluded. Therefore, “User-Agent” representing the mobile terminal is set. It is necessary to re-access the position information of the document for the PC.

  Against this background, in the second embodiment, as shown in FIG. 18, one PC document with the unanalyzed flag turned on is acquired from the PC document management DB 12, and the document position information of the PC document is also acquired. Further, step S1801 for adding the uncollected flag as it is to the portable document management DB 13 is added in place of step S1301 shown in FIG. 13, which is different from the document analysis processing according to the first embodiment.

  Thereby, even if the position information of the portable document cannot be analyzed from the PC document, it can be set as the position information of the portable document to be collected, but on the PC document using the user agent representing the portable terminal. Even if the position information is re-accessed, there is a possibility that only documents having the same contents can be obtained.

  Therefore, in the second embodiment, as shown in FIG. 19, a document collected using “User-Agent” representing a mobile terminal has the same content (source) as the PC document stored in the PC document management DB 12. Step S1901 for determining whether the content is the same code), and when it is determined that the content is the same, an acquisition failure flag is set in the portable document management DB 13 and the document is discarded. Is different from the portable document collection processing according to the first embodiment.

  As described above, in the second embodiment, the “User-Agent” representing the mobile terminal is used to access the position information of the PC document collected by the PC document management DB 12. Mobile documents can be collected even from websites that provide different documents according to the device type, and the range of portable documents that can be collected can be expanded in many ways.

  Although the embodiments of the present invention have been described so far, the present invention may be implemented in various different forms other than the embodiments described above. Therefore, another embodiment included in the present invention will be described below.

(1) Application example For example, in the present invention, the performance possessed by the mobile terminal is retained for each mobile terminal, and the user agent representing the retained mobile terminal and the terminal information representing the performance of the mobile terminal are used. Thus, the position information of the document for the portable terminal stored in the portable document management DB 13 may be accessed.

  That is, when the portable document provided for each performance of the portable terminal (for example, the document size that can be processed, the display size, the resolution, the number of colors, the number of timbres of the sound source, etc.) differs, Documents can be collected, and the range of portable documents that can be collected can be expanded in many ways.

(2) Distribution / Integration of Functions In the first and second embodiments, the PC document collection unit 14a, the document analysis unit 14b, the mail address transmission processing unit 14c, the mail acquisition / analysis unit 14d, and the portable document collection unit Although the embodiment in which all the functional units 14e are aggregated in the document collection server 10 has been described, the present invention is not limited to this, and a part of these functional units can be distributed to an external device.

  For example, if the process of the portable document collection unit 14e is incorporated into the carrier server of the portable terminal, the document providing server 30 that uses the user agent name in the request header as well as the IP address of the request source as a criterion for access from the portable terminal. Can be identified as a request from a mobile terminal.

(3) Program In the above-described first embodiment, the document collection server (document collection device) has been described. However, by realizing the configuration of the document collection device by software, a document collection program having the same function is obtained. be able to. Therefore, here, a computer that executes a document collection program will be described.

  FIG. 20 is a functional block diagram illustrating the configuration of a computer that executes a document collection program according to the third embodiment. As shown in the figure, the computer 300 includes a RAM 310, a CPU 320, an HDD 330, a wireless LAN interface 340, and an input / output interface 350.

  The RAM 310 is a memory that stores a program, a program execution result, and the like. The CPU 320 is a central processing unit that reads a program from the RAM 310 and executes the program. The HDD 330 is a disk device that stores programs and data, the wireless LAN interface 340 is an interface for connecting the computer 300 to another computer via a wireless LAN, and the input / output interface 350 is an input / output device such as a display. It is an interface for connecting devices.

  The document collection program 311 executed in the computer 300 is stored in a database or the like of another computer system connected via the wireless LAN interface 340, read from these databases, and installed in the computer 300. . The installed document collection program 311 is stored in the HDD 330, read out to the RAM 310, and executed by the CPU 320.

(Appendix 1) A document collection method in which a computer follows a link on a website and collects a document for a mobile terminal,
The computer is
A document collection process for fixed terminals that collects documents for fixed terminals from a site for fixed terminals of the website;
A document analysis step of analyzing position information of the document for the portable terminal from the document for the fixed terminal collected by the document collection step for the fixed terminal;
Based on the location information of the document for the mobile terminal analyzed by the document analysis step, the document collection process for the mobile terminal that collects the document for the mobile terminal;
The document collection method characterized by performing.

(Supplementary Note 2) The document collection process for fixed terminals further collects images included in the document for fixed terminals,
In the document analysis step, when an image is collected as the document for the fixed terminal by the document collection step for the fixed terminal, the position information of the document for the portable terminal is analyzed from a predetermined code embedded in the image. The document collection method according to appendix 1, characterized by:

(Appendix 3) The document analysis step analyzes the input form of the e-mail address of the mobile terminal from the document for the fixed terminal collected by the document collection step for the fixed terminal,
The computer further comprises:
An e-mail address transmitting step of transmitting a predetermined e-mail address to the site for the fixed terminal from which the document for the fixed terminal is collected by the document collecting step for the fixed terminal;
A mail acquisition step of acquiring the response mail from the mobile terminal to which the response mail is responded by the site for the fixed terminal;
The document collection method according to appendix 1, wherein: a mail analysis step of analyzing position information of the document for the portable terminal from the response mail acquired by the mail acquisition step is executed.

(Additional remark 4) The said document collection process for portable terminals uses the user agent showing the said portable terminal, and accesses the positional information on the document for fixed terminals collected by the said document collection process for fixed terminals, It is characterized by the above-mentioned. The document collection method according to appendix 1, 2, or 3.

(Supplementary Note 5) The computer further includes:
It is determined whether or not the document collected using the user agent representing the mobile terminal in the document collection process for mobile terminals has the same content as the document for fixed terminals collected in the document collection process for fixed terminals While performing the duplication permission determination process,
The document collection method according to appendix 4, wherein the document collection process for portable terminals discards the document when it is determined by the duplication permission determination process that the contents are the same.

(Appendix 6) The computer further includes:
While performing a performance information holding step for holding the performance of the mobile terminal in a predetermined storage unit for each mobile terminal,
The portable terminal document collecting step uses the user agent representing the portable terminal held by the performance information holding step and the terminal information representing the performance of the portable terminal, and the portable terminal document analyzed by the document analyzing step The document collection method according to any one of appendices 1 to 5, wherein the location information is accessed.

(Appendix 7) A document collection program for causing a computer to execute a document collection process for collecting documents for mobile terminals by following website links,
Document collection procedure for fixed terminal that collects documents for fixed terminal from a site for fixed terminal among the websites,
A document analysis procedure for analyzing position information of the document for the portable terminal from the document for the fixed terminal collected by the document collection procedure for the fixed terminal;
Based on the location information of the mobile terminal document analyzed by the document analysis procedure, the mobile terminal document collection procedure for collecting the mobile terminal document,
A document collection program characterized by causing a computer to execute.

(Supplementary Note 8) The fixed terminal document collection procedure further collects images included in the fixed terminal document,
In the document analysis procedure, when an image is collected as the document for the fixed terminal by the document collection procedure for the fixed terminal, the position information of the document for the portable terminal is analyzed from a predetermined code embedded in the image. The document collection program according to appendix 7, characterized by:

(Supplementary Note 9) The document analysis procedure analyzes the input form of the e-mail address of the mobile terminal from the document for fixed terminals collected by the document collection procedure for fixed terminals,
In addition to the computer,
An e-mail address transmission procedure for transmitting a predetermined e-mail address to the site for the fixed terminal from which the document for the fixed terminal is collected by the document collection procedure for the fixed terminal;
A mail acquisition procedure for acquiring the response mail from the mobile terminal to which the response mail is responded by the site for the fixed terminal;
The document collection program according to appendix 7, wherein a mail analysis procedure for analyzing position information of the document for the mobile terminal is executed from the response mail acquired by the mail acquisition procedure.

(Additional remark 10) The said document collection procedure for portable terminals uses the user agent showing the said portable terminal, and accesses the positional information on the document for fixed terminals collected by the said document collection procedure for fixed terminals, It is characterized by the above-mentioned. The document collection program according to appendix 7, 8 or 9.

(Appendix 11) In addition to the computer,
It is determined whether or not the document collected using the user agent representing the portable terminal by the document collecting procedure for the portable terminal has the same content as the document for the fixed terminal collected by the document collecting procedure for the fixed terminal. While performing the duplication permission judgment procedure,
The document collection program according to appendix 10, wherein the document collection procedure for portable terminals discards the document when it is determined by the duplication permission determination procedure that the contents are the same.

(Supplementary note 12) In addition to the computer,
While performing the performance information holding procedure for holding the performance of the mobile terminal in a predetermined storage unit for each mobile terminal,
The mobile terminal document collection procedure uses a user agent representing a mobile terminal held by the performance information holding procedure and terminal information representing the performance of the mobile terminal, and the mobile terminal document analyzed by the document analysis procedure The document collection program according to any one of appendices 7 to 11, wherein the location information is accessed.

(Supplementary note 13) A document collection device for collecting documents for mobile terminals by following links on websites,
Document collection means for fixed terminals that collects documents for fixed terminals from a site for fixed terminals among the websites;
Document analysis means for analyzing position information of the document for the portable terminal from the document for the fixed terminal collected by the document collection means for the fixed terminal;
Based on the location information of the mobile terminal document analyzed by the document analysis means, the mobile terminal document collection means for collecting the mobile terminal document;
A document collecting apparatus comprising:

(Supplementary Note 14) The fixed terminal document collection means further collects images included in the fixed terminal document,
The document analyzing unit analyzes position information of the document for the portable terminal from a predetermined code embedded in the image when the image is collected as the document for the fixed terminal by the document collecting unit for the fixed terminal. Item 14. The document collection device according to Item 13, wherein the device is a document collection device.

(Supplementary Note 15) The document analysis means analyzes the input form of the e-mail address of the portable terminal from the document for fixed terminals collected by the document collection means for fixed terminals,
An e-mail address transmitting unit that transmits a predetermined e-mail address to the site for fixed terminals from which the document for fixed terminals is collected by the document collecting unit for fixed terminals;
Mail acquisition means for acquiring the response mail from the mobile terminal to which the response mail is responded by the site for the fixed terminal;
The document collection apparatus according to appendix 13, further comprising: mail analysis means for analyzing position information of the document for the portable terminal from the response mail acquired by the mail acquisition means.

(Supplementary Note 16) The portable terminal document collection unit accesses the position information of the fixed terminal document collected by the fixed terminal document collection unit using a user agent representing the portable terminal. The document collection device according to attachment 13, 14 or 15.

(Supplementary Note 17) Whether or not the document collected by the document collecting unit for portable terminal using the user agent representing the portable terminal has the same content as the document for fixed terminal collected by the document collecting unit for fixed terminal Further comprising duplication permission / inhibition judging means for judging
The document collection device according to appendix 16, wherein the portable terminal document collection unit discards the document when it is determined by the duplication permission determination unit that the contents are the same.

(Additional remark 18) The performance information holding means which hold | maintains the performance which the said portable terminal has for every said portable terminal in a predetermined memory | storage part,
The portable terminal document collecting means uses the user agent representing the portable terminal held by the performance information holding means and the terminal information representing the performance of the portable terminal, and the portable terminal document analyzed by the document analyzing means The document collection device according to any one of appendices 13 to 17, wherein the location information is accessed.

  As described above, the document collection method, the document collection program, and the document collection apparatus according to the present invention are suitable for collecting documents provided on a mobile terminal site.

3 is an explanatory diagram for explaining an overview of a document collection server according to Embodiment 1. FIG. FIG. 3 is a conceptual diagram for explaining features of the document collection server according to the first embodiment. 3 is a functional block diagram illustrating a configuration of a document collection server according to Embodiment 1. FIG. It is a figure which shows the structural example memorize | stored in document management DB for PCs. It is FIG. (1) which shows the structural example memorize | stored in portable document management DB. It is FIG. (2) which shows the structural example memorize | stored in portable document management DB. It is a figure which shows an example of a pattern matching rule. It is a figure (1) which shows the notice example of the site for mobiles published on the site for PCs. It is FIG. (2) which shows the notification example of the site for mobiles published on the site for PC. It is a figure which shows an example of the document used as the transmission object of a mail address. It is a figure (3) which shows the notice example of the site for mobiles published on the site for PCs. 6 is a flowchart illustrating a procedure of PC document collection processing according to the first embodiment. 6 is a flowchart illustrating a procedure of document analysis processing according to the first embodiment. 3 is a flowchart illustrating a procedure of image analysis processing according to the first embodiment. 5 is a flowchart illustrating a procedure of mail address transmission processing according to the first embodiment. 6 is a flowchart illustrating a procedure of mail acquisition / analysis processing according to the first embodiment. 3 is a flowchart illustrating a procedure for portable document collection processing according to the first embodiment. 12 is a flowchart illustrating a procedure of document analysis processing according to the second embodiment. 12 is a flowchart illustrating a procedure of portable document collection processing according to the second embodiment. FIG. 10 is a functional block diagram illustrating a configuration of a computer that executes a document collection program according to a third embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Internet 3 Cable 10 Document collection server 11 Communication control IF part 12 PC document management database 13 Portable document management database 14 Control part 14a PC document collection part 14b Document analysis part 14c Mail address transmission process part 14d Mail acquisition and analysis part 14e Mobile document collection unit 30 Document provision server 50 Mobile phone

Claims (7)

A document collection method in which a computer follows a link on a website to collect a document for a mobile device,
The computer is
A document collection process for fixed terminals that collects documents for fixed terminals from a site for fixed terminals of the website;
A document analysis step of analyzing position information of the document for the portable terminal from the document for the fixed terminal collected by the document collection step for the fixed terminal;
Based on the location information of the document for the mobile terminal analyzed by the document analysis step, the document collection process for the mobile terminal that collects the document for the mobile terminal;
The document collection method characterized by performing. The document collection process for fixed terminals further collects images included in the document for fixed terminals,
In the document analysis step, when an image is collected as the document for the fixed terminal by the document collection step for the fixed terminal, the position information of the document for the portable terminal is analyzed from a predetermined code embedded in the image. The document collection method according to claim 1. The document analysis step analyzes the input form of the e-mail address of the mobile terminal from the document for the fixed terminal collected by the document collection step for the fixed terminal,
The computer further comprises:
An e-mail address transmitting step of transmitting a predetermined e-mail address to the site for the fixed terminal from which the document for the fixed terminal is collected by the document collecting step for the fixed terminal;
A mail acquisition step of acquiring the response mail from the mobile terminal to which the response mail is responded by the site for the fixed terminal;
The document collection method according to claim 1, further comprising: executing a mail analysis step of analyzing position information of the document for the portable terminal from the response mail acquired by the mail acquisition step.   The document collection process for mobile terminals uses a user agent representing the mobile terminal to access position information of documents for fixed terminals collected by the document collection process for fixed terminals. The document collection method according to 2 or 3. The computer further comprises:
It is determined whether or not the document collected using the user agent representing the mobile terminal in the document collection process for mobile terminals has the same content as the document for fixed terminals collected in the document collection process for fixed terminals While performing the duplication permission determination process,
The document collection method according to claim 4, wherein the document collection process for mobile terminals discards the document when it is determined that the content is the same in the duplication permission determination process. A document collection program for executing a document collection process for collecting documents for mobile terminals by following a link on a website to a computer,
Document collection procedure for fixed terminal that collects documents for fixed terminal from a site for fixed terminal among the websites,
A document analysis procedure for analyzing position information of the document for the portable terminal from the document for the fixed terminal collected by the document collection procedure for the fixed terminal;
Based on the location information of the mobile terminal document analyzed by the document analysis procedure, the mobile terminal document collection procedure for collecting the mobile terminal document,
A document collection program characterized by causing a computer to execute. A document collection device that collects documents for mobile devices by following website links,
Document collection means for fixed terminals that collects documents for fixed terminals from a site for fixed terminals among the websites;
Document analysis means for analyzing position information of the document for the portable terminal from the document for the fixed terminal collected by the document collection means for the fixed terminal;
Based on the location information of the mobile terminal document analyzed by the document analysis means, the mobile terminal document collection means for collecting the mobile terminal document;
A document collecting apparatus comprising:

Images