JP2005301759A - Retrieval apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a retrieval apparatus contributing to prevention of deterioration in convenience by preventing retrieval results from including information on unauthorized contents. <P>SOLUTION: A crawling part 21 performs crawling while consecutively changing an extension header to show phonetic representation capability requesting HTTP into phonetic representation capability of a representative model in each type group. A decision part 21A detects whether a providing rule of contents is followed, while the crawling part 21 registers only the crawling results following the providing rule onto a retrieve index 22C by corresponding to a name of the model in the model group. A retrieval service providing part 23 retrieves from a retrieve index 22C in accordance with retrieval conditions (a password and the like) from a portable telephone terminal 50 and the name of the model making the HTTP request. A response part 23b generates retrieval results in accordance with a template 22D to transmits them to a Web browser 530 of the portable telephone terminal 50 via an HTTP server 23A. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a search device that provides information related to contents such as a ringing melody and an image in response to a request from an information terminal device such as a mobile phone terminal device.

  A mobile phone terminal device that can acquire data (contents) such as a ring tone, incoming melody, standby screen, or the like when waiting for an incoming call from an information providing server device such as an HTTP server via a network, and can be customized according to user preferences. It is known (for example, refer to Patent Document 1).

  As the number of contents that can be provided increases, it becomes necessary to classify data by directory and select data step by step, for example, by category, artist, or song. However, the display screen of the mobile phone terminal device is larger in size than the general-purpose information processing device such as a personal computer, and the information that can be displayed on one screen is limited. The number of operations to find will increase.

  For this reason, it is conceivable to use an information search service provided via a network such as the Internet for such data search. In such an information search service, content addresses provided by an information providing server device that provides content are collected in advance by crawling by a search robot and registered in the database for each content keyword.

When a keyword is supplied from the user's terminal device, the server device that provides the search service extracts information such as the address of the content corresponding to the keyword from the database and provides it to the terminal device as a search result (for example, non-patent) Reference 1).
JP 2000-76264 A (page 6-7, FIGS. 1 and 2) SEO JAPAN, “What is a search engine?”, 2003, [online], SEO JPAN, [Search January 9, 2004], Internet <URL: http://www.seojapan.jp/search-engines /search-engine.html>

  By the way, it is conceivable to set content provision rules such as the number of link hierarchies and page size in consideration of the convenience of the user, the display capability of the mobile phone terminal, and the like. Information on illegal content that does not comply with the provision rules.

  When the user tries to select content from such a search result, the number of selections increases, and even if the content is acquired, it cannot be displayed on the mobile phone terminal device, and convenience is reduced.

  The present invention has been made in view of the above-described problems, and provides a search device that can contribute to prevention of a decrease in convenience by preventing information on illegal content from being included in a search result. The purpose is to provide.

  In order to solve the above problem, a search device according to the present invention includes a crawling unit that collects (crawling) information about content provided by a content providing server, and a search that holds information about content according to crawling by the crawling unit. An index, a condition holding unit that holds a condition of content for registering information in the search index, and a control unit that controls crawling by the crawling unit or storage of information for the search index according to the condition held in the condition holding unit; It is characterized by providing. The condition held by the condition holding means is, for example, either a permission condition according to the type of content, or the number of link hierarchies from a predetermined address (for example, the address of the search start page) or the page size from which the crawling means starts searching. A condition such as a prohibition condition according to the value of can be considered.

  In the present invention, the control means controls the storage of the address for the crawling or search index by the crawling means according to the prohibition condition or permission condition held in the condition holding means, so that the address of the content corresponding to the prohibition condition is determined. It is possible to prevent storage in the search index, or it is possible to store the address of the content corresponding to the permission condition in the search index. For this reason, the search result searched from the search index does not include the address of the content corresponding to the prohibition condition or the content not corresponding to the permission condition.

  Thereby, it can contribute to prevention of the fall of the convenience by not including the information about unauthorized content in a search result.

  The present invention can be applied to an information providing system that provides data (contents) such as ringing melody and image to a plurality of types of mobile phone terminal devices having different display capabilities.

(overall structure)
As shown in FIG. 1, for example, an information providing system according to an embodiment of the present invention includes an information providing server group 10 for providing contents such as a ringing melody and a standby screen via a network 1 such as the Internet, and an information providing server group. 10 includes a search server (search device) 20 that provides a search service related to content provided by 10, and a mobile phone terminal device 50 and a mobile phone terminal device 60 that use the search service provided by the search server 20.

  The mobile phone terminal device 50 is accessible to the information providing server group 10 and the search server 20 via a mobile communication network 30 including, for example, a PDC (Personal Digital cellular) mobile communication network. In addition, the mobile phone terminal device 60 can access the information providing server group 10 and the search server 20 via the mobile communication network 40 including, for example, a W-CDMA (Wideband-Code Division Multiple Access) mobile communication network. It has become.

(Information providing server group configuration)
The information providing server group 10 includes, for example, a plurality of information providing servers (content providing servers) 100, 200,. Each information providing server 100 (200) provides the information storage unit 110 (210) that stores the content provided by the information providing server and the content stored in the information storage unit 110 (210) via the network 1. HTTP server 120 (220).

  The contents provided by these information providing servers 100 and 200 are managed hierarchically, for example, and individual contents can be selected by selecting from the index for each hierarchy.

  The information providing server 100 provides, for example, incoming melody song data as content. The information storage unit 110 is provided with song data storage areas 111, 112,... For storing song data for each song, for example. In each song data storage area 111, 112,..., Song data in one or more data formats corresponding to the display capability of the mobile phone terminals 50, 60 are stored for the same song. For example, the song data storage area 111 of the information providing server 100 in FIG. 1 stores song data of 40 sounds, 16 sounds, and 4 sounds (they indicate the number of simultaneous occurrences) corresponding to the song AAA. It shows the state.

  During an access request to the HTTP server 120, for example, information indicating the voice display capability of the mobile phone terminal device 50 (for example, “x-sound: ##” [## indicates the number of simultaneous pronunciations) The HTTP server 120 can recognize the voice display capability of the mobile phone terminals 50, 60, etc. according to this information.

  The information providing server 200 provides, for example, image data such as a standby image as content. The information storage unit 210 is provided with image data storage areas 211, 212,... For storing image data for each image, for example. Each of the image data storage areas 211, 212,... Stores image data in one or more data formats corresponding to the display capability of the mobile phone terminal devices 50, 60 for the same image. For example, in the image data storage area 211 of the information providing server 200 in FIG. 1, an image having 256 and 4096 colors corresponding to the image BA (these indicate the number of simultaneous colors) and a low pixel number and a medium pixel number. The data and the image data of 65536 colors and the number of high pixels (for example, 200 × 150 pixels) are stored.

  During an access request to the HTTP server 220, for example, information indicating the image display capability of the mobile phone terminal device 50 (for example, “x-display: ** [** indicates the number of display pixels” in an extension header in the HTTP request). Character string] ”,“ x-color: $$ ”($$ is a character string indicating the number of simultaneous colors)), and the HTTP server 220 determines that the mobile phone terminal device 50, An image display capability of 60 or the like can be recognized. The HTTP server 220 provides image data according to the image display capability.

(Search server configuration)
The search server 20 includes the crawling unit (crawling means) 21 for acquiring the address and data type of the content provided by the information providing server group 10 according to a predetermined keyword and the like, and the address and data type obtained by the crawling unit 21. A DB 22 is stored corresponding to a keyword and the like, and a search service providing unit (search means, generation detecting means) 23 for providing a search service to the mobile phone terminals 50, 60, and the like.

  For example, as shown in FIG. 2, the DB 22 defines a display capability correspondence table 22 </ b> A that holds the display capability for each model of the mobile phone terminals 50 and 60 for each predetermined model group, and a crawling pattern by the crawling unit 21. A collection pattern 22B to be stored, a search index 22C for holding a crawling result, and a template 22D used to generate a search result for each generation of the mobile phone terminal device 50 and the mobile phone terminal device 60 are stored.

  Further, the crawling unit 21 includes a provision rule determination unit (determination unit) 22A that determines whether or not the provision of content by the information provision servers 100, 200,... The crawling unit 21 repeats access to the information providing servers 100 and 200 according to the collection pattern 22B (crawling), and observes the provision rules according to the determination result of the provision rule determination unit 22A. The content access result is stored in the search index 22C.

  The search service providing unit 23 also functions as an HTTP server 23A functioning as a front end that responds to search service requests from the mobile phone terminals 50 and 60, and a search index 22C according to a keyword supplied via the HTTP server 23A. And a response unit (search result generating means) 23b that searches for the corresponding information and constructs a response message using the template 22D.

  The mobile communication network 30 is mobile to the mobile phone terminal devices 50 of the second generation (which performs data communication by circuit switching) and the 2.5th generation (which performs data communication by packet switching) according to the above PDC method. A circuit switch 31 that provides communication services and performs processing such as allocation of communication channels with the mobile phone terminal device 50, a packet switch 32 that performs processing such as exchange of packets for data communication, and a mobile phone Base stations (BS) 33a, 33b,..., 33n that perform wireless communication with the telephone terminal device 50, a base station controller BSC 34 that manages BSs 33a to 33n, and a second-generation mobile phone And a gateway device (GW) 35 that performs protocol conversion of communication by the terminal device 50.

  The mobile communication network 40 provides a mobile communication service to the above-described third-generation mobile phone terminal device 60 using the W-CDMA system, and communicates with the mobile phone terminal device (UE: User Equipment) 60. , 42m and RNCs 41a, 41b,..., 41m for controlling the base station devices 42a to 42m.

(Details of mobile phone terminals)
The mobile phone terminal device 50 can use a call service, a mail service, etc. via the mobile communication network 30, and use a content providing service provided by the information providing server group 10 and a search service provided by the search server 20. Can be done. This cellular phone terminal device 50 performs a high frequency (RF) unit 51 for processing a high frequency signal, an MPU 52, a memory 53, an operation key 54 for inputting an instruction from the user, and a display for the user. A display unit 55, an audio CODEC 56 that performs encoding / decoding of audio signals, an MIC 57, and a speaker 58 are provided.

  The MPU 52 executes, for example, a control program held in the memory 53, thereby controlling the communication via the mobile communication network 30, the communication control unit 510 that performs communication of the e-mail, and the above-described e-mail client 520. It functions as a Web browser 530 that displays a display when using the information providing service and the search service. Also, in the memory 53, an audio data holding unit 53a that holds audio data such as a ringing melody and an image data holding unit 53b that holds image data such as a standby screen are provided.

  Similarly to the mobile phone terminal device 50, the mobile phone terminal device 60 includes an e-mail client, a Web browser, and the like, and can use contents provided by the information providing servers 100 and 200.

  For example, as shown in FIG. 3, the above-described HTTP server 120 includes a request analysis unit 121 that analyzes a request from the mobile phone terminal device 50 and the like supplied via the network 1, and index data having an address indicating information to be provided , The content acquisition unit 123 that acquires content from the information storage unit 110 in response to an instruction from the request analysis unit 121, and the mobile phone terminal devices 50 and 60 from the information acquired by the content acquisition unit 123 And a response unit 124 that sends out a response to the above via the network 1. The HTTP server 220 has the same configuration as that of the HTTP server 120.

  As shown in FIG. 4, for example, the index data held in the index holding unit 122 is classified and configured hierarchically so that information (for example, song data) can be selected hierarchically. Similarly, the index data held in the index holding unit 122 is also hierarchically classified. These index data are composed of page description data in, for example, HTML (Hyper Text Markup Language) format. For example, a link indicating the address (URL, URI, etc.) of the lower index in the page description data of the upper index. Is described so that a hierarchical link structure is formed.

  With such a hierarchical index, a user can select a category from, for example, a comprehensive index, then select an artist from the category-specific index, and select a song from the artist-specific index. Song data can be selected.

  By the way, as the number of categories, artists, song data, etc. increases, the choices in the index of each hierarchy increase. As a result, the number of items in the index of each hierarchy increases, and it becomes necessary for the user to scroll to check the whole, for example, and the time and effort required to search for the target song increases. For this reason, for example, it is conceivable to subdivide the hierarchical structure. However, since the number of hierarchical selections increases, the user's effort does not decrease much.

  Therefore, in this information providing system, the search server 20 provides a search service according to a keyword or the like for information provided by the information providing servers 100, 200,.

(Overview of operation)
Hereinafter, in the song data storage area 111 of the information providing server 100, for example, 40-sound and 16-sound SMAF (Synthetic music Mobile Application Format) format data and 4-sound SMD format data are stored as song AAA data. The case where it is stored will be described.

  The crawling unit 21 acquires the address (URL) of the content (for example, song data) provided by the HTTP server 120 by following the link structure of the index data provided by the HTTP server 120, for example. First, the crawling unit 21 acquires data of the comprehensive index from the HTTP server 120 and sequentially searches the lower index to search for a description of the link of the music data. When the song data link is found, the determination unit 21A of the crawling unit 21 determines whether the prohibition condition held in the condition holding unit (prohibition condition holding unit) 21B is satisfied. This prohibition condition is for determining whether or not the content provision rule is complied with, and the determination unit 21A ends the process for the link if the content (for example, song data) does not conform to the provision rule. If the provision rule is followed, the crawling unit 21 can select any of the keywords (for example, “AAA”) in the keyword (k / w) list 22E in the DB 22 such as the file name of the song data and the description in the link description. Judge whether it is true. If there is a link corresponding to the keyword, a predetermined address corresponding to the link (for example, a page (link destination page) containing information such as advertisements and cautions) is registered in the search index 22C in association with the keyword.

  Asynchronously with the crawling operation as described above, the search service providing unit 23 extracts information on the content corresponding to the search condition supplied from the mobile phone terminal device 50 from the search index 22C, and the mobile phone terminal device 50 as a search result. To supply.

(Collecting information on content according to conditions)
In this information providing service, the number of link layers from the search start page, page size, invalid address, domain name, extension, anchor name (character string enclosed in <A> to </A>), Content provision rules are defined by ContentType (MIME-TYPE), <META tag>, etc., and contents that do not comply with the provision rules are excluded from the above search service. Specifically, contents that do not satisfy such provision rules (conditions) are not included in the search results by the search server 20. A specific operation will be described below.

  For example, as illustrated in FIG. 5, the crawling unit 21 holds content attribute information as a content information table for each content providing site or search start address. In this content information table, for example, an attribute number (No), an attribute name, and an attribute value are associated and held. In this content information table, as an attribute name, for example, a content ID (No: 1) for identifying the content, a content name (No: 2), a page address (top URL) for displaying the search result [for result display] ] (No: 3), content introduction sentence (No: 4), address for keyword transfer [keyword transfer URL] (No: 5), content category (No: 6), exclusion keyword (No: 7) ), Additional word (No: 8), deletion word (No: 9), address for starting collection of information about content [collection start URL] (No: 10), upper limit of the number of layers of indexes up to content [collection layer Number] (No: 11), upper limit number of pages to collect information about content [collection upper limit page] (No: 12), on collection Time (No: 13), availability of other hosts (No: 14), collection schedule [collection start time] (No: 15), collection schedule [cycle] (No: 16), index value increase (No: 17) , And attribute values corresponding to these are held. If the determination unit 21A separately stores the relationship between the number and the attribute name, it is sufficient to store the number and the attribute value in association with each other in the content information table. Furthermore, it may be a character string of values delimited by a predetermined delimiter such as “,”, and the number may be recognized at a position delimited by the delimiter.

  Part of the attribute value corresponding to the attribute name in the content information table reflects a part of the provision rule described above. Specifically, for example, the number of layers to be collected (No: 11) defines the number of layers from the collection start URL (No: 10), the upper limit number of pages to be collected (No: 12), and the collection of information An upper limit time (No: 13) is defined. The exclusion keyword (No: 7) defines a keyword to be excluded from the search target, and the deletion word (No: 9) defines a word to be deleted. None of these keywords and words are to be searched by the crawling unit 21.

  Further, for example, as shown in FIG. 6, the condition holding unit 21B stores a table including content conditions (permission conditions) that can be registered in the search index 22C. This table includes an index file extension that can be acquired by the crawling unit 21 and characters indicating MIME-TYPE of the index file whose information can be registered in the search index 22C. The determination unit 21A appropriately refers to this table in crawling control, control of accumulation of information obtained by crawling, and the like.

  Further, the condition holding unit 21B includes, for example, a table (FIG. 7) that defines a tag that is regarded as a link destination at the time of crawling by the crawling unit 21 and traces the link destination, and tags to be considered when collecting information in an index file or the like. A table to be defined (FIG. 8), a table to define HTTP response headers to be considered at the time of crawling (FIG. 9), and the like are stored. The tables shown in FIGS. 6 to 9 are not necessarily provided if the same determination is executed by a program.

  In addition, the condition holding unit 21B stores an illegal address table indicating illegal addresses, domain names, and the like as shown in FIG. 10, for example. In this table, the addresses of the information providing servers 100, 200, etc. that do not comply with the content provision rules that have been understood in advance are registered.

(Determination process)
The determination of the conditions as described above is executed according to the flowchart shown in FIG. 11, for example. First, for example, the determination unit 21A checks whether or not the server certificate of the information providing servers 100 and 200 to be collected is valid (S1). The process of S1 is executed only when accessing the information providing server group 10 using the https protocol.

  Next, the determination unit 21A performs a check according to the definition file for robot search (S2). As shown in FIG. 12, for example, the information providing servers 100 and 200 hold a robot search definition file “robots.txt” for the crawling unit 21 and the like. Send. The crawling unit 21 has a unique user agent (User-Agent) name, and the User-Agent name in the definition file “robots.txt” provided from the information providing servers 100 and 200 is its own User. Only when it matches the Agent name, information is collected from the information providing servers 100 and 200 according to the description in the definition file “robots.txt”.

  When the above processing (judgment phase before collection) ends, the determination unit 21A performs a check using a regular expression of the URL (S3), and only URLs according to the regular expression are targeted for crawling. The URL expression format is defined as a standard, and a URL that does not comply with the standard may cause a malfunction, so such a check is performed.

  Further, the determination unit 21A determines whether or not the extension of the file name in the URL is an extension specified in the table shown in FIG. Only crawling is performed (S4). Further, the determination unit 21A checks whether or not the domain name in the URL is specified in the illegal address table shown in FIG. 10, and only when the domain name is not specified in this table, crawling is performed. (S5). Further, the determination unit 21A performs a check on the anchor name according to FIGS. 7 and 8 described above, and performs crawling only for those other than the anchor (tag) that is defined as a non-collection target (S6). At this time, if there is a link to the image file in the anchor according to the table shown in FIG. If there is a link to the image file, it is regarded as an advertisement and information is not collected.

  When the above processing (judgment phase based on URL name before collection) is completed, the crawling unit 21 collects information from the target URL (S7). When information from the target URL is obtained, the determination unit 21A first determines whether or not the MIME-TYPE of the obtained information is registered in the above-described FIG. 6, and the registered MIME-TYPE is determined. Only the information of the information is targeted for information collection (S8). Next, the determination unit 21A performs a check using a <META> tag, and sets only information that has no description such as nofollow and noindex as targets of information collection (S9).

  Through the processing as described above, the determination unit 21A of the crawling unit 21 causes the search index 22C to register only information about content that satisfies the permission condition defined as described above or content that does not meet the prohibition condition. Information regarding content that does not fall under the above or content that falls under prohibited conditions is not registered in the search index 22C. In this way, by limiting the target of information collection by crawling, content that does not comply with the content provision rule is excluded from the target of information collection by crawling, and information related to such content is stored in the search index 22C. Can be prevented.

  In addition to the processing described above, the crawling unit 21 performs a time limit for performing crawling from a specific information providing server 100, 200 or start URL (collection upper limit time (No: 13) in FIG. 5), upper limit page. Number (No: 12), collecting information while judging whether it can be collected to another host (domain) (No: 14), and when these limits are exceeded, exception processing is performed and the information collection is terminated Let

  Further, the crawling unit 21 searches whether or not a search keyword exists in the collected pages as described above, and registers the search keyword in the search index 22C for each search keyword. At this time, when the additional word (No: 8) in FIG. 5 is set, the determination unit 21A searches the search index 22C corresponding to the additional word even if there is no additional word in the page. Register with. Specifically, even if there are no keywords such as “new arrival”, “POP”, and “indie” in the collected pages, information about the collected pages is registered in the search index 22C in correspondence with these keywords.

  Further, when the deleted word (No: 9) in FIG. 5 is set, the determination unit 21A does not register the deleted word in the search index 22C even if there is a deleted word in the page. Specifically, even if there is a keyword “image system” in the collected pages, information about the collected pages is not registered in the search index 22C.

  Further, when the exclusion keyword (No: 7) in FIG. 5 is set, the determination unit 21A, even if there is an exclusion keyword in the anchor tag in the page, the link destination indicated by the anchor No further information is collected for. Specifically, for example, “<a href =“ www. ddd. Even if there is a link such as “com”> Click here for nice encounters <a> ”, no information is collected for the linked page (www.ddd.com).

  In addition, information collection for content according to the maximum number of layers defined by the number of collection layers (No: 11) in FIG. 5 is performed as follows. For example, as shown in FIG. 13, the crawling unit 21 uses an illegal page (address AB) that does not comply with the content provision rule and a lower page linked from this page according to the determination result by the determination unit 21 </ b> A. The provided information is not registered in the search index 22C. For example, when one of the provision rules is that the content hierarchy is within a predetermined number (n), the determination unit 21A determines, for example, from the collection start URL defined by the above collection pattern as shown in FIG. The number of layers (x) is counted (S101, S105), and when the number of layers x becomes larger than n, crawling of the layers below it is stopped and crawling of the next collection pattern is started (S106).

  When the upper limit of the page size is set as the provision rule, the size of the acquired page data is detected in S103 in the figure, and if it is larger than the upper limit, it is not registered in the search index 22C. .

  As described above, when an illegal address, domain name, or the like is used as a provision rule, for example, when acquiring page data in S102 and S107 in FIG. It is determined whether or not an address registered in the illegal address table shown in FIG. 10 is included. If the address includes a registered address, the subsequent processing is stopped.

  For example, when the page (index) provided by the HTTP server 120 is in the state shown in FIG. 13 described above, crawling is performed for the links (address AA, address AB, address AC, address AD) in the page of address A. When this is done, for example, as shown in FIG. 15, the pages of address AA, address AB, and address AD comply with the provision rules, and therefore the crawling result is registered in the search index 22C for these pages and the lower layer pages. (S204, S208, S215), the address AC does not comply with the provision rule, so information in this page and its lower layers is not registered in the search index 22C.

  By such processing, it is determined whether or not the determination unit 21A complies with the provision rule of the content, and the crawling unit 21 registers information on the content that complies with the provision rule according to the determination result in the search index 22C. It is possible to prevent the search result extracted from the index 22C from including information about content that does not comply with the provision rules.

(Acquisition of information according to the display capability of the terminal device)
Further, in this information providing system, an appropriate search result corresponding to the display capability of the mobile phone terminal devices 50 and 60 is provided. Specifically, the above-described operation (crawling operation) is performed for each display capability of the mobile phone terminal devices 50 and 60. In the display capability correspondence table 22A, for example, as shown in FIG. 16, for each group of mobile phone terminal devices, identification information (group ID) indicating the group and a model name (representative) indicating the representative model in the group. And correspondence tables 22AA, 22AB, and 22AC indicating correspondence between model names and model names (model name lists) indicating models. These correspondence tables 22AA, 22AB, and 22AC are provided for each content type. Further, the display capability (for example, the number of simultaneous pronunciations, the corresponding format, etc.) for each model of the cellular phone terminal devices 50, 60 is stored in the DB 22 as a table as shown in FIG. In addition, when the contents for each display capability corresponding to the group ID are stored in the information storage units 110 and 210, the correspondence between the group ID and the contents can be understood by a method such as storing in a directory corresponding to the group ID. If so, it is not necessary to provide these correspondence tables. Alternatively, if the correspondence between the representative model of the model group and the model name list is clear, it is not always necessary to provide the group ID.

  When the crawling unit 21 requests data such as a comprehensive index from the HTTP server of the information providing server, the crawling unit 21 selects a correspondence table corresponding to the search target from the display capability correspondence table 22A, and for each model group in the selected correspondence table. An HTTP request having an extension header (hereinafter simply referred to as an HTTP extension header) generated using the model name of the representative model and information indicating display capability is transmitted. For example, when the address (URL) of the general index of the HTTP server 120 that provides song data is “http://meloJAM.com/index.html”, the HTTP request generated by the crawling unit 21 is, for example, “GET http : //meloJAM.com/index.html HTTP / 1.1 2G V-DN02 x-display: 150x120 x-color: C4096 x-sound: 4 / 6KB ”. Here, “V-DN02” in the HTTP extension header is a character indicating the model name of the mobile phone terminal device, and “2G” is a character indicating the generation of the mobile phone terminal device. “X-sound: 4” is a character indicating the number of simultaneous pronunciations (four sounds) of the mobile phone terminal device.

  In addition, “x-display: 150x120” in the extension header indicates that the number of display pixels is 150 × 120 pixels, and “x-color: C4096” indicates that the number of simultaneous colors is 4096 colors. “6 KB” indicates that the upper limit of page description data such as index data is 6 kilobytes.

  The crawling as described above is performed according to a collection pattern file having a configuration as shown in FIG. 18, for example. In this collection pattern, characters (for example, “PATTERN1”) indicating individual collection pattern names and characters (for example, “http: // www. aaa.co.jp/ ”etc.) and characters indicating the agent name indicating the settings used for the collection are defined.

  For each agent name, for example, in the agent definition file as shown in FIG. 19, the agent name, browser version, extension header for each model group, page upper limit value, etc. are defined. deep. This table may be generated, for example, using the display capability correspondence table 22A described above at the time of search, but may be created in advance and stored in the DB 22.

  The crawling unit 21 generates the above-described HTTP request with reference to the agent definition file shown in FIG. 19, and performs crawling according to the collection pattern shown in FIG.

  Further, for example, as shown in FIG. 20, the crawling unit 21 performs information “x−” indicating the voice display capability of the mobile phone terminal device in the HTTP extension header according to the agent defined in the collection pattern file of FIG. Sound: xxx "is changed in order, and the HTTP request to the HTTP server 120 is repeated (S301, S303, S305, S307).

  Further, the crawling unit 21 specifies the type of content corresponding to the HTTP request from the response (S302, S304, S306, S308) of the HTTP server 120 to each HTTP request, and registers the content type in the search index 22C of the DB 22.

  The HTTP server 120 has the index information shown in FIG. 4 for each group ID in FIG. 16 or each terminal capability in FIG. 17, and an index corresponding to the voice display capability of the mobile phone terminal device. It is designed to supply information. In the example of FIG. 1 described above, index information is included for the 4-sound SMD format, the 16-sound and 40-sound SMAF formats, but the 32-sound SMAF format does not provide index information because the HTTP server 120 does not provide it. Absent.

  When the HTTP request is supplied as described above (S301, S303, S305, S307), the request analysis unit 121 of the HTTP server 120 performs group ID corresponding to “x-sound: n” in the extension header of the HTTP request. (“N” is a character indicating the number of simultaneous pronunciations) the voice display capability on the terminal side is determined, and if there is index information corresponding to the voice display capability, the response unit 124 transmits the index information (S302, S304). , S308). On the other hand, when there is no index information corresponding to the voice display capability, the request analysis unit 121 causes the response unit 124 to transmit a response message indicating that the index information does not exist (S306).

  Further, the crawling unit 21 acquires index information existing in the information providing server 100, checks whether there is a file name, a character, or the like corresponding to the keyword registered in the DB 22 in advance, and the one corresponding to the keyword If there is, for example, as shown in FIG. 21, in the search index 22C, the voice display capability of the terminal indicates the group ID of the model group, a list of model names belonging to the model group, and a predetermined address corresponding to the content (for example, advertisement, attention) Etc. (pages including linked pages, etc.) etc. are registered corresponding to the keywords.

  By the operation as described above, the search index 22C corresponding to the voice display capability of the mobile phone terminal device is created. Since the corresponding model name is registered in the search index 22C, it is easy to extract the search result according to the model name of the mobile phone terminal device that requests the search service. Also, for the image data provided by the information providing server 200, the information (“x-display: XxY”, “x-color: yyy”) indicating the image display capability in the extension header is sequentially changed to change the HTTP server 220. By requesting index information and performing a keyword search in the index information as described above, a search index 22C corresponding to the image display capability of the mobile phone terminal device can be created as shown in FIG.

(Search service)
Asynchronously with the crawling operation as described above, the search service providing unit 23 provides a search service to the Web browser 530 and the like of the mobile phone terminal device 50.

  When the use of the search service is instructed by the user, the Web browser 530 requests the search service providing unit 23 for data for inputting search conditions. In response to this, when data is supplied from the search service providing unit 23, the Web browser 530 displays a search word input screen on the display screen of the display unit 55 as shown in FIG. When the voice display capability of the mobile phone terminal device 50 is 32 sounds, when the user inputs a search condition (for example, a song name “AAA”) and instructs the search, the Web browser 530 instructs the search service providing unit 23. An HTTP request including an extension header including the character indicating the search condition and the model name “V-T08” of the mobile phone terminal device 50 is transmitted (S401).

  The search service providing unit 23 searches for information corresponding to a character (for example, “AAA”) indicating a search condition in the HTTP request supplied from the Web browser 530 and a model name (for example, “V-T08”) in the extension header. A response message (search result) that is extracted from the index 22C and includes the number of hits, song name, link information for the song data address, etc. is generated and sent to the Web browser 530 (S402). When receiving such a response message, the Web browser 530 displays a search result list screen corresponding to the search result as shown in FIG.

  In the example shown in FIG. 1 described above, there is no song data of the song AAA corresponding to the voice display capability (8 sounds) of the mobile phone terminal device (model name “V-T08”) in the song data storage area 111, and it is obtained by crawling. In the retrieved index 22C, as shown in FIG. 21 described above, information about the eight-tone music data of the music AAA corresponding to the model name “V-T08” is not registered. Therefore, as shown in FIG. 22, the search result provided by the search service providing unit 23 has a hit count of 0 and does not include information on the song data of the song AAA.

  Further, when a search is requested from a mobile phone terminal device (for example, model name “V-SH53”) having a voice display capability of 40 sounds using the song name “AAA” as a search condition in the same manner as in the example of FIG. For example, as shown in FIG. 23, the extension header of the HTTP request supplied to the search service providing unit 23 includes the model name “V-SH53” of the mobile phone terminal device (S501). In the example shown in FIG. 1 described above, the music data storage area 111 has 40-tone music data corresponding to the music AAA, and the search index 22C corresponds to “V-SH53” as shown in FIG. The information about the 40-tone music data of the music AAA to be registered is registered. Therefore, as shown in FIG. 23, the search service providing unit 23 sets the address “http://meloJAM.com/cgi/abc.cgi?” And the keyword of the link destination page corresponding to the song data of the song AAA. The search result including the indicated information “keyword = AAA” as link information is provided to the Web browser 530 (S502).

  Information indicating the keyword included in the link information is supplied to the information providing server as a part of the GET command when requesting the data of the content selected by the user. The “AAA” part indicating the keyword is actually escape encoded (in the form of “% xx”) with a character code corresponding to the generation of the mobile phone terminal device. That is, for example, Shift-JIS is used as the character code in the case of the second generation mobile phone terminal device, and as the character code in the case of the 2.5th generation and third generation mobile phone terminal devices. For example, a character code corresponding to the setting of the mobile phone terminal device in Shift-JIS, UTF-8, EUC-JP, ISO-2022-JP is used.

  When the user who has confirmed the search result selects a song, the Web browser 530 provides the corresponding information providing server 100 with the song data corresponding to the song selected by the user in accordance with the link information corresponding to the selected song. A request is made (S503). This request (HTTP request) includes information “keyword = AAA” indicating a keyword in the extension header, and information (x-sound: 40) indicating that the voice display capability of the mobile phone terminal device 50 is 40 sounds. It is.

  Upon receiving such an HTTP request, the request analysis unit 121 of the information providing server 100 acquires the address of the content corresponding to the keyword “AAA” from the index holding unit 122, and a link destination having information such as an image such as an advertisement A description of the link to the content is added to the page data and sent to the response unit 124 (S504).

  The web browser 530 of the mobile phone terminal device displays an image corresponding to the data of the linked page on the display unit 55. When the user selects content acquisition, the Web browser 530 requests content information from the information providing server (S505). In response to this, when content data (in this case, music data of 40 sounds of music AAA) is supplied from the information providing server (S506), the Web browser 530 stores the supplied data in the memory 53.

  As a result, in this information providing system, an address of an arbitrary page can be provided as a search result, and keywords can be handed over to the information providing server. Therefore, for example, information such as advertisements can be displayed without increasing the operation burden on the user. It is possible to provide content via a page that the user has.

  By the way, in the template 22D in the DB 22, for example, as shown in FIGS. 24, 27, and 28, templates used for generating search results are stored for each generation of mobile phone terminal devices. The meaning of the variable in each template is shown in FIG. 25, and the meaning of the command is shown in FIG.

  The generation of the mobile phone terminal device can be determined by acquiring the generation corresponding to the model name from the table shown in FIG. In the second generation (2G) mobile phone terminal device, the Web browser 530 accesses the HTTP server 23A via the circuit switch 31 and the GW 35. At this time, the Web browser 530 adds identification information indicating the model of the mobile phone terminal device to the HTTP request. The GW 35 holds information such as a character indicating the model name corresponding to the identification information, a character indicating the resolution, and the like. The information such as the character indicating the model name corresponding to the identification information in the HTTP request is used as an extension header. Append to request. In the 2.5th generation (2.5G) mobile phone terminal device, the Web browser 530 adds a character or the like indicating the model name to the HTTP extension header, and accesses the HTTP server 23A via the packet switch 32. . Further, in the third generation (3G) mobile phone terminal device, the Web browser 530 adds a character or the like indicating the model name in the HTTP extension header, and accesses the HTTP server 23A via the RNC 41a (41b). Therefore, the search service providing unit 23 of the search server 20 can know the generation corresponding to the character indicating the model name in the HTTP extension header by referring to the table shown in FIG.

  The search service providing unit 23 uses the template shown in FIG. 24 if the access source mobile phone terminal device is the second generation, and uses the template shown in FIG. 27 if the access source mobile phone terminal device is the 2.5th generation. If the access source mobile phone terminal device is the third generation, a response message to the mobile phone terminal device is generated using the template shown in FIG.

  Specifically, for example, when the mobile phone terminal device is the second generation and the search result for “AAA” is one, the search generated by the response unit 23b using the template shown in FIG. The resulting data is, for example, as shown in FIG. An image displayed on the display unit 55 in accordance with such search result data is, for example, an image displayed in S502 in FIG.

  Further, when the mobile phone terminal device is the 2.5th generation and there are 11 search results for “AAA”, it is displayed on the display unit 55 according to the search result data generated by the response unit 23b. For example, the image is as shown in FIG. Furthermore, when the mobile phone terminal device is the third generation and there are 11 search results for “AAA”, an image displayed on the display unit 55 according to the search result data generated by the response unit 23b. For example, as shown in FIG. 31, information such as an explanation about each content can be displayed.

  In this way, by generating a search result using a template according to the generation of the mobile phone terminal device, the number of search results displayed and the content for each generation of the mobile phone terminal device, for example, according to the display capability of the mobile phone terminal device Etc., and appropriate search results can be generated.

  The GW 35, the packet switch 32, the RNC 41a (41b), and the search service providing unit 23 communicate with each other using the TCP / IP protocol as an upper protocol. Therefore, the search service providing unit 23 can also determine the generation of the mobile phone terminal device based on the IP address of the access source, and such a configuration can be adopted.

  As described above, the case of music data has been described as an example. Similarly, for image data, the search service providing unit 23 extracts data from the search index 22C according to the model name in the extension header of the HTTP request. The search result is transmitted to the mobile phone terminal device.

(effect)
If content that does not comply with the content provision rules such as the number of layers and page size is included in the search results, the number of selections by the user may increase, or the content may not be displayed even if it is acquired. It will reduce the sex.

  On the other hand, in this information providing system, information on illegal content that does not comply with the provision rules is not registered in the search index 22C according to the determination result of the determination unit 21A of the search server 20, and therefore the search index 22C The extracted search result does not include information on illegal content. For this reason, in this information provision system, it can contribute to prevention of the fall of convenience.

  In addition, when a search is performed without considering the display capability of the mobile phone terminal device, information that cannot be used in the mobile phone terminal device is included in the search result, and the user follows the link one by one, and the mobile phone terminal device It is necessary to determine whether the content can be displayed in

  On the other hand, in this information providing system, as described above, the search service providing unit 23 can supply only the song data corresponding to the model name of the mobile phone terminal device from the search index 22C as the search result. In the search index 22C, the model name of the mobile phone terminal device in the predetermined model group is registered in association with the information on the usable content, so only the information on the content that can be displayed on the mobile phone terminal device is registered. Can be supplied as a search result.

  Therefore, in this information providing system, it is possible to reduce the number of user operations until obtaining usable content, thereby contributing to a reduction in the user's operation burden. Moreover, since the possibility of accessing music data that cannot be used by the mobile phone terminal device can be reduced, it is possible to contribute to the reduction of unnecessary traffic and the saving of communication charges.

  In addition, since this information providing system performs crawling for each model group set for each type of content such as song data and image data, an appropriate search index 22C corresponding to the display capability of the mobile phone terminal is generated. The increase in the number of accesses to the information providing server can be suppressed.

  Further, in this information providing system, data in the search index 22C is generated for each model group having the same display capability, and a model name table in the model group is separately provided by registering the model name itself. Compared to the case, it is possible to reduce the number of times the data in the DB 22 is referenced and contribute to speeding up the search.

  Further, in this information providing system, since the image display capability such as the number of characters that can be displayed on the display unit 55 is determined for each generation of the mobile phone terminal device, a search result is generated using a template corresponding to the generation. Thus, an appropriate search result corresponding to the display capability of the display unit 55 can be generated.

It is a block diagram which shows the structure of the information provision system which concerns on Example 1 of this invention. It is a block diagram which shows the structure of the search server which comprises the said information provision system. It is a figure which shows the detailed structural example of the information provision server which comprises the said information provision system. It is a figure which shows the structural example of the index data currently hold | maintained at the index holding part of the said information provision server. It is a figure which shows the example of the content information table hold | maintained at the crawling part of the search server which comprises the said information provision system. It is a figure which shows the example of the prohibition conditions currently hold | maintained at the condition holding part of the said crawling part. It is a figure which shows the example of the table hold | maintained at the said condition holding part. It is a figure which shows the example of the table hold | maintained at the said condition holding part. It is a figure which shows the example of the table hold | maintained at the said condition holding part. It is a figure which shows the example of the unauthorized address table which hold | maintains the address of an unauthorized page. It is a flowchart which shows a determination process. It is a figure which shows the example of the definition file for a robot search. It is a figure which shows the example of an unauthorized page. It is a flowchart which shows the example of the determination process by the determination part of the crawling part which comprises the said search server. It is a sequence diagram which shows the example of the crawling operation | movement by the said crawling part. It is a figure which shows the example of the display capability corresponding table hold | maintained at DB of the search server which comprises the said information provision system. It is a figure which shows the example of the corresponding | compatible table hold | maintained at said DB. It is a figure which shows the example of the collection pattern currently hold | maintained at said DB. It is a figure which shows the example of the agent definition currently hold | maintained at said DB. It is a sequence diagram which shows the example of the crawling operation | movement by the said crawling part. It is a figure which shows the example of the content table stored in DB by the said crawling operation | movement. It is a sequence diagram which shows the example of operation | movement in the search service by the said search server. It is a sequence diagram which shows the example of another operation | movement in the said search service. It is a figure which shows the example of the template currently hold | maintained at said DB. It is a figure which shows the example of the variable in the said template. It is a figure which shows the example of the command in the said template. It is a figure which shows the other example of the said template. It is a figure which shows the other example of the said template. It is a figure which shows the example of the data of the search result produced | generated using the said template. It is a figure which shows the example of the image displayed by the data of another search result. It is a figure which shows the example of the image displayed by the data of another search result.

Explanation of symbols

10 information providing server group, 110, 120 information storage unit, 120, 220 HTTP server, 121 request analysis unit, 122 index holding unit, 123 content acquisition unit, 124 response unit, 20 search server, 21 crawling unit, 21A determination unit, 21B condition holding unit, 22 DB, 22A display capability correspondence table, 22B collection pattern, 22C search index, 22D template, 23 search service providing unit, 50, 60 mobile phone terminal device, 52 MPU, 530 Web browser, 53 memory, 53a Ringtone data holding unit, 53b Image data holding unit

Claims (4)

Crawling means for collecting (crawling) information related to the content provided by the content providing server;
A search index that holds information about the content according to crawling by the crawling means;
Condition holding means for holding a condition of contents for registering information in the search index;
A search device comprising: control means for controlling storage of the information for the crawling or the search index by the crawling means according to a condition held in the condition holding means.   The search apparatus according to claim 1, wherein the condition includes a permission condition according to a type of the content.   2. The search apparatus according to claim 1, wherein the condition includes a prohibition condition corresponding to any one of a number of link hierarchies and a page size from a predetermined address at which the crawling means starts searching. The content providing server may provide content according to information indicating content display capability in the information request command,
The crawling means searches for information related to the content using information indicating the content display capability of a representative model in the model group set for each content display capability,
The search index holds information related to the content obtained by the crawling means in association with identification information indicating the model name of the terminal device in the model group at the time of crawling,
The search device according to claim 1, further comprising search means for acquiring information related to the content in the search index in accordance with identification information indicating a model name in an information request command from a terminal device.

Images