JP2014178902A - Retrieval system, search term dictionary generation device, program, storage medium, and search term dictionary generation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a retrieval system, search term dictionary generation device, program, storage medium and search term dictionary generation method capable of enhancing retrieval efficiency.SOLUTION: A retrieval system comprises a database server 10 for storing data, a collection unit 211 for collecting data from the database server 10, and an index generation unit 213 for generating an index in which a keyword used for retrieval within the retrieval system and property information designating at least one of inside of the retrieval system and outside of the retrieval system as a target of retrieval are associated with each other on the basis of the collected data, and for registering the index in an index storage unit 205.

Description

  The present invention relates to a search system, a search word dictionary generation device, a program, a storage medium, and a search word dictionary generation method.

  Conventionally, various techniques relating to data retrieval are known (see, for example, Patent Documents 1 to 5).

  By the way, in the conventional technology as described above, since it is necessary to select a search target by the user and to perform a search for the selected search target, the search efficiency may be deteriorated.

  For example, in the conventional technology as described above, the user selects whether to search a data group in the corporate system or a data group on the Internet. When a data group in the corporate system is a search target, a data group in the corporate system is searched by a search engine for searching the corporate system and a data group on the Internet is searched. Search the data group on the Internet with a search engine for search.

  Here, for example, it is assumed that the user first selects the search in the data group in the company system, and the number of search results as the search result is small. In this case, it is assumed that the user newly selects a data group on the Internet and performs a search again. However, such a search method has poor search efficiency.

  If all the search objects are searched unconditionally, the number of searches is one, but in this case, the search takes time and the efficiency of the search is also poor.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a search system, a search word dictionary generation device, a program, a storage medium, and a search word dictionary generation method capable of improving the efficiency of search. And

  In order to solve the above-described problems and achieve the object, a search system according to an aspect of the present invention is a search system, and a data storage unit that stores data, and the data is collected from the data storage unit A collection unit, based on the collected data, a search term used for a search inside the search system, and attribute information for designating at least one of the inside of the search system and the outside of the search system as a search target; And a search word dictionary generating unit that generates a search word dictionary associated with the search word dictionary and registers it in the search word dictionary storage unit.

  According to the present invention, it is possible to increase the efficiency of search.

FIG. 1 is a block diagram illustrating an example of a configuration of a search system according to the present embodiment. FIG. 2 is a block diagram showing an example of the configuration of the index server of the present embodiment. FIG. 3 is a flowchart showing an example of index generation processing executed by the index server of this embodiment. FIG. 4 is a flowchart showing an example of search processing executed by the search system of this embodiment. FIG. 5 is a flowchart showing an example of attribute determination processing executed by the index server of this embodiment. FIG. 6 is a flowchart illustrating an example of attribute determination processing executed by the index server according to the modification. FIG. 7 is a diagram illustrating an example of a hardware configuration of each device of the search system according to the present embodiment and the modification.

  Hereinafter, embodiments of a search system, a search word dictionary generation device, a program, a storage medium, and a search word dictionary generation method according to the present invention will be described in detail with reference to the accompanying drawings.

  First, the configuration of the search system of this embodiment will be described.

  FIG. 1 is a block diagram illustrating an example of a configuration of a search system 1 according to the present embodiment. As shown in FIG. 1, the search system 1 includes a database server 10-1 to 10-N (N ≧ 2), an index server 20, an administrator terminal 30, a user terminal 40, and a search control server 50. Prepare. The database servers 10-1 to 10 -N (N ≧ 2), the index server 20, the administrator terminal 30, the user terminal 40, and the search control server 50 are connected via a LAN (Local Area Network) 2.

  Although it is assumed that the search system 1 of the present embodiment is mainly constructed by an economic entity such as a company, it is not limited to this.

  The search system 1 (LAN 2) is connected to the Internet 4 via the firewall 3 and can access an external search server 60 existing on the Internet 4.

  The database servers 10-1 to 10-N (an example of a data storage unit) store data relating to economic entities in which the search system 1 is constructed. For example, HDDs (Hard Disk Drive) and SSDs (Solid State) It can be realized by a computer having a large-capacity nonvolatile storage device such as a drive. Data related to economic entities mainly assumes document information (document files), image information (image files), audio information (audio files) associated with economic activities of economic entities, but is not limited to this. is not.

  In the following description, when there is no need to distinguish the database servers 10-1 to 10-N, they may be simply referred to as the database server 10.

  The index server 20 generates and manages an index used for search, and can be realized by a computer or the like.

  The administrator terminal 30 is a terminal device used by the administrator of the search system 1 and can be realized by, for example, a PC (Personal Computer).

  The user terminal 40 is a terminal device used by a user of the search system 1 and can be realized by, for example, a PC.

  The search control server 50 controls the search in the search system 1 (search in the index server 20) and the search outside the search system 1 (search on the Internet 4), and can be realized by a computer or the like. . The search control server 50 provides a search service in the search system 1 such as a search engine for search in the search system 1.

  The external search server 60 provides a search service on the Internet 4 such as a search engine for searching on the Internet 4 and can be realized by a computer or the like. As an implementation main body of the external search server 60, Google (registered trademark) or Yahoo! (Registered trademark).

  FIG. 2 is a block diagram showing an example of the configuration of the index server 20 of the present embodiment. As shown in FIG. 2, the index server 20 includes an appearance frequency information storage unit 201, a thesaurus storage unit 203, an index storage unit 205, a collection unit 211, an index generation unit 213, an index input / output unit 215, The index management unit 217, the search input / output unit 219, the search condition generation unit 221, and the search unit 223 are provided.

  The appearance frequency information storage unit 201, the thesaurus storage unit 203, and the index storage unit 205 are, for example, magnetic, optical such as HDD, SSD, memory card, optical disk, ROM (Read Only Memory), and RAM (Random Access Memory). It can be realized by a storage device that can store data electrically or electrically. The collection unit 211, the index generation unit 213, the index input / output unit 215, the index management unit 217, the search input / output unit 219, the search condition generation unit 221, and the search unit 223 are, for example, a processing device such as a CPU (Central Processing Unit) Can be implemented by software.

  The appearance frequency information storage unit 201 stores, for each search word, the internal appearance frequency in the search inside the search system 1 and the external appearance frequency in the search outside the search system 1 in association with each other.

  The search term is, for example, a keyword. The internal appearance frequency is a search inside the search system 1, that is, an appearance frequency of a keyword in the database server 10. The external appearance frequency is a search outside the search system 1, that is, a keyword appearance frequency on the Internet 4.

  The internal appearance frequency is obtained by, for example, a search unit 223 (to be described later) searching for keywords in the database server 10. The external appearance frequency is obtained, for example, when the external search server 60 searches for keywords on the Internet 4. It is assumed that the internal appearance frequency and the external appearance frequency are normalized by the population parameter (total number of searches).

  The thesaurus storage unit 203 stores a thesaurus dictionary used for keyword normalization. Examples of keyword normalization include a process of removing the notation “sway” and grouping synonyms.

  The collection unit 211 collects data from the database server 10. In the present embodiment, the collection unit 211 collects data from the database server 10 periodically (for example, once a day).

  The index generation unit 213 (an example of a search word dictionary generation unit) uses a keyword (an example of a search word) used for a search in the search system 1 based on the data collected by the collection unit 211, and the search system 1 An index (an example of a search word dictionary) is generated that associates attribute information that designates at least one of the inside and the outside of the search system 1 as a search target. Here, the index generation unit 213 determines a search target indicated by the attribute information based on the appearance frequency information stored in the appearance frequency information storage unit 201.

  For example, the index generation unit 213 performs natural language processing on the data collected by the collection unit 211 and extracts keywords by normalizing using the thesaurus dictionary stored in the thesaurus storage unit 203. Then, the index generation unit 213 refers to the appearance frequency information stored in the appearance frequency information storage unit 201. If the internal appearance frequency of the extracted keyword is greater than or equal to a threshold and greater than the external appearance frequency, at least the inside of the search system 1 is stored. The index information is generated by associating the attribute information designated as the search target with the keyword. Further, if the internal appearance frequency of the extracted keyword is not greater than the threshold and the external appearance frequency, the index generation unit 213 generates an index by associating at least attribute information specifying the outside of the search system 1 as a search target with the keyword. To do.

  Then, the index generation unit 213 registers the generated index in the index storage unit 205 (an example of a search word dictionary storage unit) via the index input / output unit 215.

  The index input / output unit 215 controls input / output to the index storage unit 205.

  The index management unit 217 (an example of a search word dictionary management unit) rewrites the attribute information of the index registered in the index storage unit 205 based on the external input. Specifically, the index management unit 217 rewrites the attribute information of the index registered in the index storage unit 205 via the index input / output unit 215 based on the input from the administrator terminal 30.

  As a result, the administrator of the search system 1 can obtain attribute information of highly confidential keywords such as development codes of new products, phrases related to important specifications of new products, and phrases related to new business entry fields. The search target can be specified in accordance with the actual situation, for example, such that the search target is not specified (only the inside of the search system 1 is specified as the search target).

  The search input / output unit 219 controls input / output with the search control server 50. For example, the search input / output unit 219 receives an input of a search request (a request that can specify a search target keyword) from the search control server 50, or an index that is a search result of the search unit 223, which will be described later, to the search control server 50. Or output.

  The search condition generation unit 221 generates a search condition (a condition that specifies a search target keyword) from the search request received by the search input / output unit 219. Specifically, the search condition generation unit 221 generates a search condition by normalizing the search request received by the search input / output unit 219 using the thesaurus dictionary stored in the thesaurus storage unit 203. .

  The search unit 223 (an example of an internal search unit) searches the index storage unit 205 via the index input / output unit 215 for an index that satisfies the search request generated by the search condition generation unit 221.

  The search input / output unit 219 returns the index that is the search result of the search unit 223 to the search control server 50.

  Here, the search control server 50 will be described.

  The search control server 50 (an example of a search control unit) provides the user terminal 40 with a search service within the search system 1 (such as a search engine for search within the search system 1 or a search portal). The search request is received from the user terminal 40 and output to the index server 20. The search control server 50 also receives an index that is a search result in the search system 1 from the index server 20.

  In the present embodiment, the search in the search system 1 is thus performed as a search for an index of data stored in the database server 10, so that the search speed in the search system 1 can be improved.

  When the attribute information included in the searched index specifies at least the outside of the search system 1 as a search target, the search control server 50 performs a search based on the search request received from the user terminal 40 on the external search server 60 ( Request to an example of an external search device. Thereby, the external search server 60 performs a search based on the search request on the Internet 4 and returns the search result to the search control server 50, and the search control server 50 obtains the search result of the external search server 60.

  When the attribute information included in the searched index specifies the inside of the search system 1 as a search target, the search control server 50 outputs the index to the user terminal 40 as a search result. The search control server 50 outputs the search result of the external search server 60 to the user terminal 40 when the attribute information included in the searched index specifies the outside of the search system 1 as a search target. Further, when the attribute information included in the searched index designates the inside and outside of the search system 1 as a search target, the search control server 50 uses the search result of the index and the external search server 60 as a search result. Output to the terminal 40.

  Next, the operation of the search system of this embodiment will be described.

  FIG. 3 is a flowchart showing an example of index generation processing executed by the index server 20 of this embodiment.

  First, the collection unit 211 collects data from the database server 10 (step S101).

  Subsequently, the index generation unit 213 performs natural language processing on the data collected by the collection unit 211 (step S103), and normalizes the keywords by using the thesaurus dictionary stored in the thesaurus storage unit 203, thereby obtaining the keywords. Extract (step S105).

  Subsequently, the index generation unit 213 determines the attribute information of the extracted keyword based on the appearance frequency information stored in the appearance frequency information storage unit 201, and generates an index by assigning the keyword (step) S107).

  Subsequently, the index generation unit 213 registers the generated index in the index storage unit 205 via the index input / output unit 215 (step S109).

  FIG. 4 is a flowchart showing an example of a search process executed by the search system 1 of this embodiment.

  First, the search control server 50 receives a search request from the user terminal 40 (step S201).

  Subsequently, the search input / output unit 219 of the index server 20 receives a search request from the search control server 50, and the search condition generation unit 221 generates a search condition from the search request received by the search input / output unit 219 (step) S203).

  Subsequently, the search unit 223 searches the index storage unit 205 via the index input / output unit 215 for an index that satisfies the search request generated by the search condition generation unit 221 (step S205), and the search input / output unit 219. Returns the index, which is the search result of the search unit 223, to the search control server 50.

  Subsequently, when the index is searched by the index server 20 (Yes in step S207), the search control server 50 designates at least the outside of the search system 1 as the search target by the attribute information included in the searched index. It is confirmed whether or not there is (step S209).

  When the attribute information included in the searched index specifies at least the outside of the search system 1 as a search target (Yes in step S209), the search control server 50 performs a search based on the search request received from the user terminal 40. A request is made to the external search server 60 (step S211), and a search result based on the search request is acquired from the external search server 60 (step S213).

  Subsequently, the search control server 50 integrates the index searched by the index server 20 and the search result of the external search server 60 (step S215), and outputs the search result to the user terminal 40 (step S217).

  In step S209, when the attribute information included in the searched index does not designate at least the outside of the search system 1 as a search target (No in step S209), the search control server 50 is searched by the index server 20. The index is output to the user terminal 40 as a search result (step S217).

  If no index is searched by the index server 20 in step S207 (No in step S207), the search control server 50 outputs no search result to the user terminal 40 as a search result (step S217).

  Even in the case where the index is not searched by the index server 20 in step S207 (No in step S207), the search control server 50 requests the external search server 60 to perform a search based on the search request received from the user terminal 40. You may do it.

  FIG. 5 is a flowchart showing an example of attribute determination processing executed by the index server 20 of this embodiment.

  First, the index generation unit 213 refers to the appearance frequency information stored in the appearance frequency information storage unit 201, and compares the internal appearance frequency and the external appearance frequency of the extracted keyword (step S301).

  As a result of the comparison, if the internal appearance frequency is greater than or equal to the threshold and greater than the external appearance frequency (Yes in step S303), the index generation unit 213 sets the attribute information that designates at least the inside of the search system 1 as the search target (internal search priority) Assigned to the keyword (step S305).

  On the other hand, if the internal appearance frequency is not less than the threshold and greater than the external appearance frequency (No in step S303), the index generation unit 213 sets the attribute information that designates at least the outside of the search system 1 as a search target (external search priority). It assigns to a keyword (step S307).

  As described above, according to the present embodiment, since an index including attribute information specifying a search target is generated, if a search is performed using this index, the user need not select the search target. Efficiency can be increased.

  In addition, according to the present embodiment, the search target is specified according to the difference between the internal appearance frequency and the external appearance frequency. Therefore, if a search is performed using this index, a search with a higher keyword appearance frequency is performed. A search can be performed on the target, and the efficiency of the search can be improved.

  Further, according to the present embodiment, since the administrator of the search system can rewrite the attribute information, it is possible to specify a search target in accordance with the actual situation. For this reason, it is possible to prevent an index of highly confidential data from leaking to the outside.

(Modification)
In addition, this invention is not limited to the said embodiment, A various deformation | transformation is possible.

  In the above embodiment, the administrator of the search system manually does not specify the attribute information of the highly confidential keyword so that the outside of the search system 1 is not specified as the search target (only the inside of the search system 1 is specified as the search target). The example of rewriting is described above, but the attribute information of keywords with high confidentiality may not be designated as search targets outside the search system 1 at the time of index generation.

  In this case, the database servers 10-1 to 10-N store normal data (an example of a first data storage unit) and store data that is more confidential than normal data (second data). An example of a storage unit).

  In addition, the appearance frequency information storage unit 201 has a first internal appearance frequency in a search in the database server 10 that stores normal data inside the search system 1 for each keyword, and high internal and confidentiality in the search system 1. The second internal appearance frequency in the search in the database server 10 that stores data and the external appearance frequency in the search outside the search system 1 are stored in association with each other.

  FIG. 6 is a flowchart illustrating an example of attribute determination processing executed by the index server 20 according to the modification.

  First, the index generation unit 213 refers to the appearance frequency information stored in the appearance frequency information storage unit 201, and compares the first internal appearance frequency and external appearance frequency of the extracted keyword (step S401).

  As a result of the comparison, if the first internal appearance frequency is not greater than the first threshold and the external appearance frequency (No in step S403), the index generation unit 213 sets at least the outside of the search system 1 as a search target (external search priority). The designated attribute information is assigned to the keyword (step S405).

  On the other hand, if the first internal appearance frequency is greater than or equal to the first threshold and greater than the external appearance frequency (Yes in step S403), the index generation unit 213 compares the first internal appearance frequency of the extracted keyword with the second internal appearance frequency. (Step S407).

  As a result of the comparison, if the second internal appearance frequency is greater than or equal to the second threshold and greater than the first internal appearance frequency (Yes in step S409), the index generation unit 213 does not designate the outside of the search system 1 as a search target (external The attribute information set to “search prohibited” is assigned to the keyword (step S411).

  On the other hand, if the second internal appearance frequency is not less than the second threshold and greater than the first internal appearance frequency (No in step S409), the index generation unit 213 sets at least the inside of the search system 1 as a search target (internal search priority). The designated attribute information is assigned to the keyword (step S413).

  According to the modification, it is possible to automatically prevent an index of highly confidential data from leaking to the outside.

(Hardware configuration)
FIG. 7 shows the hardware of the index server 20, the administrator terminal 30, the user terminal 40, and the search control server 50 (hereinafter referred to as each device of the search system 1 of the above embodiment and the modification) of the above embodiment and the modification. It is a figure which shows an example of a hardware structure.

  Each device of the search system 1 according to the embodiment and the modification includes a control device 801 such as a CPU, a storage device 802 such as a ROM and a RAM, an external storage device 803 such as an HDD, a display device 804 such as a display, An input device 805 such as a keyboard and a mouse and a communication device 806 such as a communication I / F (interface) are provided, and a hardware configuration using a normal computer is provided.

  The program executed in each device of the search system 1 of the above embodiment and the modification is a file in an installable or executable format, such as a CD-ROM, a CD-R, a memory card, a DVD (Digital Versatile Disk), The program is stored in a computer-readable storage medium such as a flexible disk (FD).

  The program executed by each device of the search system 1 according to the embodiment and the modification may be provided by storing it on a computer connected to a network such as the Internet and downloading it via the network. . Further, the program executed by each device of the search system 1 of the embodiment and the modification may be provided or distributed via a network such as the Internet. Moreover, you may make it provide the program executed with each apparatus of the search system 1 of the said embodiment and a modification previously incorporated in ROM etc. beforehand.

  The program executed by each device of the search system 1 according to the embodiment and the modification has a module configuration for realizing the above-described units on a computer. As actual hardware, the CPU reads out a program from the HDD to the RAM and executes the program, whereby the above-described units are realized on the computer.

1 Search system 2 LAN
3 Firewall 4 Internet 10-1 to 10-N (10) Database server 20 Index server 30 Administrator terminal 40 User terminal 50 Search control server 60 External search server 201 Appearance frequency information storage unit 203 Thesaurus storage unit 205 Index storage unit 211 Collection Unit 213 Index generation unit 215 Index input / output unit 217 Index management unit 219 Search input / output unit 221 Search condition generation unit 223 Search unit 801 Control device 802 Storage device 803 External storage device 804 Display device 805 Input device 806 Communication device

JP-A-11-149478 JP 2008-181273 A Japanese Patent No. 4445699 JP 2004-030466 A JP-A-11-053382

Claims (12)

A search system,
A data storage unit for storing data;
A collection unit for collecting the data from the data storage unit;
Based on the collected data, the search term used for the search inside the search system is associated with the attribute information that designates at least one of the inside of the search system and the outside of the search system as a search target A search word dictionary generating unit that generates a search word dictionary and registers it in the search word dictionary storage unit;
A search system comprising: An internal search unit for searching a search word dictionary satisfying a search request from the search word dictionary storage unit;
When the attribute information included in the searched search word dictionary designates at least the outside of the search system as a search target, the search is requested to an external search device based on the search request, and the search result is sent to the search control unit. ,
The search system according to claim 1, further comprising:   When the attribute information included in the searched search word dictionary specifies the search system as a search target, the search control unit outputs the search word dictionary as the search result and is searched. When the attribute information included in the search word dictionary designates the outside of the search system as a search target, the search result of the external search device is output as the search result, and the searched search word dictionary The said search word dictionary and the search result of the said external search device are output as the said search result, when the said attribute information contained specifies the inside and the outside of the said search system as a search object. Search system. An appearance frequency information storage unit that stores appearance frequency information that associates an internal appearance frequency in a search inside the search system with an external appearance frequency in a search outside the search system for each search word; Prepared,
The search system according to claim 1, wherein the search word dictionary generation unit determines a search target indicated by the attribute information based on the appearance frequency information.   The search word dictionary generation unit refers to the appearance frequency information, and if the internal appearance frequency of the search word in the search word dictionary is greater than a threshold value and greater than the external appearance frequency, the attribute information of the search word dictionary is The attribute of the search word dictionary is set so that at least the inside of the search system is designated as a search target, and the internal appearance frequency of the search word in the search word dictionary is greater than a threshold value and greater than the external appearance frequency. The search system according to claim 4, wherein the information is set to designate at least a search target outside the search system. The data storage unit includes a first data storage unit that stores normal data, and a second data storage unit that stores data having higher confidentiality than the normal data,
For each search term, a first internal appearance frequency in the search in the search system and in the first data storage unit, and a second internal appearance frequency in the search in the search system and in the second data storage unit, An appearance frequency information storage unit that stores appearance frequency information that associates external appearance frequencies in searches outside the search system,
The search system according to claim 1, wherein the search word dictionary generation unit determines a search target indicated by the attribute information based on the appearance frequency information.   The search word dictionary generation unit refers to the appearance frequency information, the first internal appearance frequency of the search word in the search word dictionary is greater than or equal to a first threshold and the external appearance frequency, and the second internal appearance. If the frequency is greater than or equal to a second threshold and greater than the first internal appearance frequency, the attribute information of the search word dictionary is set so as not to designate the outside of the search system as a search target, and the search word of the search word dictionary If the first internal frequency of occurrence is greater than the first threshold and greater than the external frequency, and the second internal frequency is not greater than the second threshold and greater than the first internal frequency, the search word dictionary The attribute information is set so that at least the inside of the search system is designated as a search target, and the first internal appearance frequency of the search word in the search word dictionary is equal to or greater than the first threshold and the external appearance frequency. If not greater, the search system according to claim 6, wherein the attribute information of the keyword dictionary is set to specify at least searched outside of the search system.   The search system according to claim 1, further comprising a search word dictionary management unit that rewrites the attribute information of the search word dictionary registered in the search word dictionary storage unit based on an external input. . A collection unit for collecting data from the data storage unit;
A search that associates a search term used for a search inside a search system with attribute information that designates at least one of the inside of the search system and the outside of the search system as a search target based on the collected data A search word dictionary generation unit that generates a word dictionary and registers the word dictionary in the search word dictionary storage unit;
A search word dictionary generation device comprising: A collection unit for collecting data from the data storage unit;
A search that associates a search term used for a search inside a search system with attribute information that designates at least one of the inside of the search system and the outside of the search system as a search target based on the collected data A search word dictionary generation unit that generates a word dictionary and registers the word dictionary in the search word dictionary storage unit;
Program to make the computer function.   A computer-readable storage medium storing the program according to claim 10. A collection step for collecting data from the data store;
A search that associates a search term used for a search inside a search system with attribute information that designates at least one of the inside of the search system and the outside of the search system as a search target based on the collected data A search word dictionary generation step of generating a word dictionary and registering it in the search word dictionary storage unit;
Search word dictionary generation method including