KR20060134701A - Distributed domain-oriented search services apparatus and method thereof using for centralized web resource automatic classification server - Google Patents

Abstract

A device and a method for processing a search service in a categorized small/middle scale unit system by using a central service server are provided to increase a search speed/efficiency of a lower system, and reduce expenses needed for managing a search engine and system load by making a searcher of the lower system separately process the search service for a corresponding category. A unit system manager makes a data collection URL(Uniform Resource Locator) list for collecting data by the central search server and a request list according to a categorized data classification system. A lower system manager receives the request list. A crawler collects information and documents through application data, DBMS(DataBase Management System) data, file documents, and web documents according to the received request list. An indexer stores the collected information/documents to a database, and generates an index database according to each category of the received data classification system to perform indexing work for connecting the document and a keyword. An index database repository stores the categorized index database by operating the crawler and the indexer.

Description

Distributed domain-oriented search services apparatus and method using using centralized web resource automatic classification server}

1 is a view showing the configuration of a conventional search engine.

Figure 2 is a block diagram showing a search service processing apparatus in a small and medium-sized unit system for each field using a central search server according to the present invention.

3 is a diagram illustrating a search service processing method in a small and medium unit system for each field using a central search server according to the present invention;

In the present invention, when implementing a search service in a small and medium-sized unit system, the unit system for providing information and data on the external field to the user inside the unit system without building an integrated search engine server system inside the unit system. The present invention relates to an apparatus and method for processing a search service in.

In recent years, with the widespread use of the Internet, it has become common to write most documents on a computer and distribute and obtain these documents through the Internet. Therefore, not only experts but also ordinary people access to communication networks such as the Internet, and often provide or obtain information on areas of interest. As such, search engines operating on the Internet are being used to enable a large number of unspecified members of the public to share information on areas of interest through a communication network.

Such a search engine stores index information and basic information about all documents provided using the Internet by a kind of automatic circulation program called a robot in a database form. At this time, basic information about the documents includes title, size, date, address of the website where the document is stored, summary statement, etc., and if a query is entered to search the document from the outside, the database is searched and searched by the query. Provide the list to the user.

FIG. 1 is a diagram illustrating a configuration of a conventional search engine. As shown in FIG. 1, a collector, an indexer, and a searcher are configured. The collector is called a spider or a fetcher. The collector periodically visits data collection websites to form information and documents, such as information stored in a database, and web pages and document files. It collects unstructured information such as The indexer stores information and documents collected by a collector in a database, and indexes keywords and documents for fast and efficient retrieval. The contents of the index database generated as a result of the processing of the crawler and the indexer are configured in the form of providing an information retrieval service for providing the relevant data and information immediately upon a search request through the input of a query word.

Among the search engines described above, the performance and quality of the search engines built in the unit system are not only 90% or more dependent on the collector and the indexer, but for the best operation, the continuous optimization of the collector and the indexer for the user environment is required. Most of the operation and maintenance of the search engine is required to optimize the collector and the indexer. Therefore, when implementing a search engine to implement a search service for internal users and internal customers in general small and medium-sized unit systems such as elementary, middle and high schools, and private hospitals, it is not only expensive but also optimized and managed. It was virtually impossible to achieve the return on investment from the effort and expense.

Therefore, the search engine collector and indexer, which requires a lot of effort and cost, and a professional manager, are integrated with the central search server, and only the sector-based index database is provided to the corresponding subsystem. There is a need for a very lightweight search engine without a simple and systemic load that enables a search service to be implemented using only a search machine.

The present invention has been made to solve the above problems, the search method in the sub-system generates each index database corresponding to the sub-system using the collector and the indexer of the central search server, the search of the sub-system The present invention provides a system and a method for interworking with a collector and an indexer of a central search server and a subsystem search period, and a method of controlling the collector and indexer of a central search server in consideration of a user environment of the subsystem and an index database in the subsystem. Its purpose is to provide management and delivery methods.

In order to achieve the above object, in the present invention, a searcher of a sub-system is placed in a sub-system together with an index database of a corresponding field provided by a central search server, so that a search service for the corresponding field may be processed independently. Collectors, indexers, and controllers, which speed and search efficiency, reduce the cost of management of the search engine, and influence the performance of the search engine, are processed by the central search server collectively to minimize the load on the system.

Referring to Figure 2 attached to the search service processing apparatus in the small and medium-sized unit system for each field using the central search server according to the present invention,

The central search server for delivering the request list created by the unit system manager and the unit system manager for creating a request list according to the data collection URL list of the data to be collected by the central search server and the data classification system by sector. The collector collects information and documents through application data, database management system (DBMS) data, file documents, and web documents according to the subsystem manager installed in the system and the request list received from the subsystem manager. .

The indexer stores information and documents collected by the collector in a database, and performs indexing to connect keywords and documents for fast and efficient retrieval according to the data classification system requested by the sub-system. Create an index database for each sector to provide an index database in the sector-specific subsystem.

The controller for generating the index database generated as a result of the processing of the collector and the indexer for each field may control the collector and the indexer according to the data collection URL list for each field and the setting of the data classification system for each field. Configure.

The index database generated by each sub-system field by operating the collector and the indexer is stored for each field in an index database repository, and an index database transmitter for transmitting sector-specific information and documents stored in the index database repository to a corresponding field index database. The sector information and documents stored in the index database repository are transmitted to the sector index database by an index database receiver which receives the sector information and the document transmitted from the index database transmitter and transmits the document to the sector index database.

The data collection URL and the data classification system requested by the sector-specific subsystems are delivered to the central search server subsystem manager by the subsystem manager to create a request list for each subsystem field. The central search server controller operates the collector and the indexer with reference to the request list for each sub-system field to generate an index database for each sub-system field, and sends the index database to the index database repository for storing by field. The central search server index database transmitter is transmitted to an index database receiver of a subsystem that requests an index database of a corresponding field by referring to a subsystem manager, and the index database is stored in a search server in a subsystem and is stored by a user by a subsystem searcher. Provide search services to

The searcher of the sector-specific sub-system is installed in the subsystem and displays the search result according to the search request through the input of a query in the corresponding sector index database that stores information and documents transmitted from the index database repository provided by the central search server. It is provided to users of subsystems accessed through web browsers.

The collector, indexer, controller, subsystem manager, and index database repository for each sub-system field are installed in the central search server, and the corresponding field index database and searcher are installed in the subsystem.

Referring to FIG. 3, a method of processing a search service in a small and medium-sized unit system for each sector using a central search server will be described in detail. A first step delivered to the system manager to create a request list for each sub-system field;

A second step of controlling, by the controller of the central search server, the collector and the indexer by referring to the request list for each sub-system field according to the request list created in the first step;

A third step of operating the collector and the indexer in the second step to generate an index database for each sector of the subsystem and to send it to the index database repository for storage for each sector;

A fourth step of transmitting, by the third step, field-specific information and documents stored in the index database repository to the index database of the subsystem through the index database transmitter with reference to the subsystem manager;

A fifth step of transmitting sector-specific information and documents transmitted to the index database transmitter in the fourth step to the index database receiver of the subsystem;

A sixth step of, by the index database receiver receiving the sector information and the document in the fifth step, transferring the sector information and the document to the index database of the subsystem;

A seventh step of providing a search result according to a query word by a subsystem searcher using a subsystem index database in which field information and documents are stored in the sixth step; Is made of.

According to the request list received from the sub-system manager in the second step, information and documents for each field are collected through application data, database management system data, file documents, and web documents, and the indexes linking the collected information with keywords and documents. And providing a search result according to a query input by a user connected to the web browser in the seventh step.

As described above, the preferred embodiment according to the present invention has been described, but the present invention is not limited to the above-described embodiments, and the present invention is not limited to the scope of the following claims without departing from the gist of the present invention. Anyone with ordinary knowledge will have the technical spirit of the present invention to the extent that various modifications can be made.

As described above, an apparatus and method for processing a search service in a small and medium-sized unit system for each field using a central search server according to the present invention introduces a search engine and implements a system when a search service is implemented in a small-sized unit system. Managers should be put in, but most small and medium-sized unit systems are difficult to introduce search engines or system administrators. Therefore, the central search server manages collectors, indexers and sub-database index databases to manage the subsystems. By providing an ultra lightweight search engine, it is possible to implement its own search service without purchasing a search engine and a system administrator.

In addition, in the case of a large-scale system having a hierarchical structure, when a user wants to build a search service system that suits their characteristics while operating each unit system independently and individually, the search service system without purchasing a search engine in each unit system Can be built.

Claims (6)

In a search service processing apparatus for a small- and medium-sized unit system that performs a search service for the corresponding field alone by placing a searcher of the sub-system together with the corresponding field index database provided by the central search server, A unit system manager for creating a request list according to a data collection URL list of data to be collected by the central search server and a data classification system for each field; A sub-system manager installed in the central search server for delivering the list of requests made by the unit system manager to the central search server; A collector for collecting information and documents through application data, database management system data, file documents, and web documents according to the request list received from the subsystem manager; An indexer for storing the information and documents collected by the collector in a database, and indexing the keywords and documents, thereby creating an index database for each field according to the data classification system requested by the sector-specific subsystem. ; A controller configured to control the collector and the indexer according to the data collection URL list for each field and the data classification system for each field so as to generate the index database generated as a result of the processing of the collector and the indexer for each field; An index database storage configured to operate the collector and the indexer to store the index database generated for each sub-system field by field; The collector, indexer, controller, subsystem manager, index database repository for each subsystem field is installed in the central search server, An index database transmitter for transmitting sector-specific information and documents stored in the index database repository to a corresponding sector index database; An index database receiver configured to receive field-specific information and documents transmitted from the index database transmitter and transmit the received field-specific information to a corresponding field index database; A searcher for providing a search result according to a search request to a user connected through a web browser through input of a query in a corresponding field index database storing information and documents of the index database repository through the index database transmitter and receiver; Search service processing unit in the small and medium-sized unit system for each field using a central search server consisting of. The method of claim 1, The central search server index database transmitter is transmitted to an index database receiver of a subsystem that requests an index database of a corresponding field by referring to a subsystem manager, and the index database is stored in a search server in a subsystem and is queried by a subsystem searcher. Search service processing apparatus in the small and medium-sized unit system for each field using a central search server, characterized in that to provide the search results according to. The method of claim 1, The apparatus for searching a service in a small and medium-sized unit system for each field using a central search server, wherein the corresponding field index database and a searcher are installed in the sub-system. In the search service processing method in the sub-system for each field using a central search server to install the collector, indexer, controller in the central search server to collectively process the agent, A first step in which the data collection URL and the data classification system requested by the sector sub-system are delivered to the central search server subsystem manager by the sub-system manager to create a request list for each sub-system sector; A second step of the controller of the central search server operating the collector and the indexer by referring to the request list for each sub-system field according to the request list created in the first step; A third step of operating the collector and the indexer in the second step to generate an index database for each sector of the subsystem and to send it to the index database repository for storage for each sector; A fourth step of transmitting, by the third step, field-specific information and documents stored in the index database repository to the index database of the subsystem through the index database transmitter with reference to the subsystem manager; A fifth step of transmitting sector-specific information and documents transmitted to the index database transmitter in the fourth step to the index database receiver of the subsystem; A sixth step of, by the index database receiver receiving the sector information and the document in the fifth step, transferring the sector information and the document to the index database of the subsystem; A seventh step of providing a search result according to a query word by a subsystem searcher using a subsystem index database in which field information and documents are stored in the sixth step; A search service processing method in a small and medium sized unit system by field using a central search server. The method of claim 4, wherein According to the request list received from the sub-system manager in the second step, information and documents for each field are collected through application data, database management system data, file documents, and web documents, and the indexes linking the collected information with keywords and documents. Search service processing method in the small and medium-sized unit system by field using the central search server. The method of claim 4, wherein In the seventh step, the sub-system searcher provides a search result according to a query input by a user connected to a web browser using a sub-system index database. How to handle the service.

Images