KR100399502B1 - Mass bibliography searching service system - Google Patents

Abstract

1. Field of invention

The present invention relates to a large-capacity bibliographic information retrieval service system including a flexible real-time main memory device resident type summary information retrieval system suitable for retrieving large-scale bibliographic information under a general operating system environment.

2. Technical problem to be solved by the invention

The present invention solves most of the delays occurring in the conventional disk-based surge information retrieval—data processing bottlenecks and delays in system response time for users—allowing relatively fast data access time and uniform performance distribution to enable large-scale surges. It provides the core technologies that can simultaneously achieve the two goals of improving information processing and retrieval speed and increasing the number of concurrent users for large groups of users, which are key to building information-based national library networks or digital library systems. It provides an open book information service system that can be operated under general operating system such as UNIX, and general database management system (DBMS), and can be operated independently from information management system based on large-scale bibliographic information management. Purpose have.

3. Solution and effect of technical problem

The present invention operates the same system and operates the same system as operating the bibliographic summary information in the existing database system by always resident bibliographic summary information in the main memory for real-time bibliographic information processing in the real-time application database system for the bibliographic information retrieval service To make it possible. This requires a main memory resident memory manager to maintain one database system in the main memory, and implements the summary information stored in the summary information manager to be operated through a search engine. Ultimately, it is possible to provide a large-scale bibliographic information search engine and management system using real-time application main memory resident database technique.

Description

Mass bibliography searching service system

The present invention relates to a large capacity bibliographic information retrieval service system under a general operating system environment.

Conventionally, a bibliographic information retrieval service system is possible with a retrieval server and a disk-based database system (DBS), where the retrieval server can process not only bibliographic information but also insertion, deletion and modification of bibliographic information. It provides a function, and the database stores bibliographic information and detailed data. If the user wants to provide detailed information, the information used for the search is mainly the summary information, and the summary information used for the search is called summary metadata because it may be slightly different from the data shown to the user.

In the case of a bibliographic information retrieval service system using a disk-based database system, which is generally used, the performance is slow because the disk needs to be accessed in order to find a record having the required data. In addition, if multiple users simultaneously request a search, bottlenecks may occur due to delays in execution. In particular, the biggest bottleneck is the access and selection of summary metadata. Currently, expensive commercial DBS is mainly used, but it does not solve the above problems, adding to the economic burden in terms of performance.

In addition, as the data to be processed becomes larger and more complicated with the development of the real-time system, the necessity of an application system using a real-time data processing engine capable of effective data processing within a limited time rather than the concept of fast data processing is emphasized. In particular, factory automation, reactor control systems, process control, medical systems, unmanned aerial control systems, network management, mobile communications, military early warning systems, etc., require technologies to effectively process large amounts of data in a timely manner.

The present invention devised to solve the above problems is relatively faster than the disk by processing the access and selection function for the summary metadata, which shows the biggest bottleneck in the bibliographic information search, in the main memory instead of the conventional disk. Ensure data access time and uniform performance distribution. That is, if the disk data storage and management module that has been used in the past according to the present invention is designed as a main memory resident type, all the data is always stored in the main memory to have a structure that guarantees a high speed service. This technology includes a technology that effectively connects a main memory resident real-time kernel composed of a memory storage manager and a recovery manager, a search engine responsible for search query processing and a communication protocol. Therefore, two goals can be achieved simultaneously: increasing the speed of information processing and retrieval, which is a key factor in the construction of a national library network or digital library system based on large-scale bibliographic information, and increasing the number of concurrent users for large groups of users.

1 is an overall system configuration diagram showing a preferred embodiment of a large-capacity bibliographic information retrieval service system including a main memory device resident type medicine information retrieval system according to the present invention.

FIG. 2 is an exemplary diagram showing a relationship between modules for search and update management in the overall system configuration shown in FIG.

3 is a flowchart illustrating a search and update process of the main memory device resident type information storage system according to the present invention.

4 is a flowchart illustrating a protocol delivery process for searching between a web storage server and a web server of a main memory resident suspension medicine information search system according to the present invention.

FIG. 5 is a code module diagram illustrating a shared memory storage structure for storing a search result of a storage summary information retrieval server of a main memory resident type summary information retrieval system according to the present invention.

Fig. 6 is a flowchart showing an algorithm for managing a search result of a bibliographic medicine information retrieval server of a main memory device resident biomedical information search system according to the present invention.

7 is a flowchart showing a protocol transfer process for modification between a bibliographic information retrieval server and an update monitor of a main memory resident type bibliographic information retrieval system according to the present invention.

Explanation of symbols on the main parts of the drawings

100: general user 110: web server

120: bibliographic information manager 130: bibliographic information information search system

131: Summary Drug Information Search Server 132: Summary Drug Information DB Engine

133: Surge Summary Information DB 140: Surge Information Retrieval System

141: surge information search server 142: surge information DB engine

143: bibliographic information DB 150: update monitor

The large-capacity bibliographic information retrieval service system according to the present invention is a bibliographic information retrieval server connected to a network to enable data transmission and reception with other computers such as a web server by a communication protocol such as TCP / IP, and a bibliographic information database executed by the bibliographic information retrieval server. A bibliographic information retrieval system comprising a bibliographic information database (DB) for storing bibliographic information data processed by the bibliographic information database engine in a bibliographic information form and a bibliographic information form; A web server that receives a request for retrieval of bibliographic information or bibliographic information from the general user through the network and displays the result to the general user in a web browser; And a bibliographic information retrieval service system configured to manage the bibliographic information retrieval system through the network, wherein the network includes data with another computer such as the bibliographic information retrieval server by a communication protocol such as TCP / IP. The medicine summary information search server connected to be capable of transmitting / receiving is stored in a main medicine information database engine (DB Engine) running in the medicine summary information search server and the medicine summary information search server. A bibliographic information retrieval system composed of a bibliographic information database (DB) processed by an information database engine; And a bibliographic information retrieval server and bibliographic information database of the bibliographic information retrieval system by the network to monitor and modify (insert, delete, update) the bibliographic information in the bibliographic information database in real time. If this occurs, copy the contents to a separate storage device, store the contents, and generate an update request message requesting that the bibliographic information database of the bibliographic information retrieval system be modified to correspond to the data modification of the bibliographic information database. Update monitor for transmitting to the bibliographic information search server; when the bibliographic information search request of the general user, the web server preferentially search the bibliographic information stored in the bibliographic information database to show the results to the user In addition, the bibliographic information search form According to whether or not the contents of the summary information database has been correctly modified to send a success message or a failure message to the update monitor, when the update monitor receives the success message, delete the modifications copied to a separate storage device, failure message If it receives, it is characterized in that the update message continues to be sent back to the bibliographic information search server until the success message.

In order to process the bibliographic information in real time, the bibliographic information resides in the main memory, which enables the service to be much faster while operating the same system as operating the bibliographic information in the existing database system. To this end, a main memory resident memory manager is required to maintain one database system in the main memory. The summary information stored in the summary information manager is operated through a summary information search engine.

In order to process real-time bibliographic information, it is preferable that the main memory resident database system, which is a core module of the present invention, is designed to have the following characteristics.

First, it is preferable that the summary information database system according to the present invention is configured to include a storage storage management module utilizing a high-speed indexing technique (T Tree) to basically support fast performance, that is, fast storage and access. .

Second, since the bibliographic information database of the present invention manages a unique table having a single record type, the concurrency control of the table unit provided by the existing database system has no meaning. Given the fast execution speed in main memory, it would rather reduce the overall performance.

Third, since the main memory resident database is volatile, periodic backups are necessary. This is maintained through a module called an update monitor, and it is desirable to use a recovery technique of the main memory resident database system.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a diagram illustrating an overall system configuration of a real-time bibliographic information retrieval service system having a new structure including a main memory resident database system, unlike a general retrieval system that processes all work using a single database system.

As shown in FIG. 1, the entire system of the bibliographic information retrieval service system according to the present invention includes a web server 110, a bibliographic information retrieval system 140, a bibliographic information retrieval system 130, Update monitor 150, and other users 100, bibliographic information manager 120 and the like.

The web server 110 shown in FIG. 1 receives a search request from the general user 100, constructs a search request message, and transmits the search request message to the bibliographic information retrieval system 130 or the bibliographic information retrieval system 140. If the result is returned, it serves to show to the general user 100 through a web browser.

Seokje information search system 130 shown in Figure 1 is composed of a summary information DB (133), a summary information search server 131 and a summary information search engine 132, search and update query for the Seokje medicine metadata To process The surge information retrieval system 130 is a characteristic part of the present invention as compared with the conventional bibliographic information retrieval service system.

The bibliographic information retrieval system 140 shown in FIG. 1 finds records corresponding to the control number transmitted from the bibliographic contract information retrieval system 130, and detailed information on specific summary information required by the general user 100. Process the search message for.

The update monitor 150 shown in FIG. 1 is a module provided to maintain consistency between the bibliographic information DB and the bibliographic information DB. If an update occurs in the bibliographic information database, the information is also sent to the bibliographic information DB to be updated and repeated until successful.

FIG. 2 is an exemplary view showing a relationship between modules for search and update processing in the entire search service system shown in FIG.

As shown in FIG. 2, the function of the large-capacity bibliographic information retrieval service system according to the present invention is a retrieval process (B) for bibliographic information (A) and correct bibliographic information (B). Can be divided.

First, when a search for bibliographic information is requested by the general user 100, the web server 110 makes this a search request message and is sent to the bibliographic information search server 131, and then to the bibliographic information DB 133. After performing a search using the stored summary metadata, the result is shown to the general user 100. When the general user 100 requests detailed information on specific information from the summary information of the enumerated data, the web server 110 constructs a search request message for the detailed information and transmits it to the bibliographic information search server 141. Then, the corresponding data is found from the bibliographic information database 143 and shown to the user.

There are three kinds of update related queries: insert, delete, and update. The update monitor 150 is required to maintain consistency between the bibliographic information DB and the bibliographic information DB when such a query occurs.

If an update is requested by the update management program 200 of the bibliographic information manager 120 rather than the general user, the data of the bibliographic information DB 143 is first modified. The update monitor 150 continuously monitors this, and when modification occurs, copies the contents to a separate storage location of the update monitor 150 and prepares an update request message for updating data in the book summary information database 131. do. If the message is delivered to the bibliographic information search server 131, and if the contents of the summary information database 133 are properly changed, it ends with receiving a success message and deletes the copied portion, but if it receives a failure message, it continues until the success message is received. Create an update message and resend it.

As shown in Fig. 1 and Fig. 2, general users, web servers, bibliographic information retrieval systems, and bibliographic information managers are similar to existing systems, but are bibliographic information retrieval systems and update monitors related to the retrieval and management of real-time summary metadata. Is a feature of the present invention.

3 illustrates a process for searching and updating in a real-time surge summary search server. First, when a message is received from a web server or an update monitor (301), a parsing process (302) must be performed to perform proper processing. Then, if a modification is required, that is, insert (303), delete (304), or update (305), the record is modified, and in the case of search (306), the car value or filter value is set according to the query. Will be performed. All these messages return their results after execution.

4 shows a protocol between the web server 110 and the slow summary search server 131 for performing a search during a search and update process in the real-time slow summary search server 131. In order to request the search summary search server 131 from the web server 110, first, a message “INIT orom” 110 is transmitted, and in response, the Seo summary search server 131 returns a new session number ( 403), which means creating a new session. Thereafter, when the search message is transmitted using the session number (403), the search server 131 returns the number of result records after the search (404). The web server again requests the desired number of result records (405), and finally returns (406) that number of result records. As such, the message delivery for retrieval does not end in one time, but requires three times of delivery because the user considers a case where the user wants the continuous data of several pages when the user requests a search using a web-based retrieval system. to be.

Fig. 5 shows a structure for storing control numbers of a record obtained as a result of the search. The search results use shared memory segments because they must be accessible by multiple processes. Because we maintain the results for each session as a whole, we arrange each session number and its results in two dimensions.

6 is an algorithm for managing the result values having the storage structure in FIG. Management is related to the whole process of conducting a search.

Upon receiving the initial message (601), a new session number is assigned (602). The session number can be used up to MAXSESSIONID (100), and the session number allocated after MAXSESSIONID is maintained as 1.

A session number entered with the search query 604 is checked to see if it is currently available (605).

The search result is stored in shared memory as control number of ctl_no [0] in rcs [SessionID] using the session number as the index of the array (606). Keep it. The reason why MAXSESSIONID and MAXSESSION are different here is to distinguish between different session numbers using the same index. For example, if you maintain only 50 MAXSESSIONIDs, such as MAXSESSION, you cannot tell whether the contents of res [3] .ctl_no are about session number 3 or 503.

For the GETR query 608, the desired number of elements in the array having the corresponding session number as an index is returned (609). In the case of requesting another result of one search 610, the GETR query receiving step 608 and the step 609 of returning the desired number of elements of the array having the corresponding session number as an index are repeated.

Fig. 7 illustrates a protocol between the update monitor 150 and the slow track search system 131 for the slow track information update processing 701, 702, and 703 in the real time slow track information search system. As mentioned above, there are three types of queries for modification, that is, data management: insert (701), delete (702), and update (703). After performing each, the success or failure (704, 705) is updated again. 150). If it fails (705), it repeats until it succeeds (704).

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawing.

The present invention as described above provides a core technology in the development of digital library system of domestic libraries and joint utilization of domestic library collection information, the introduction of expensive information retrieval engine when constructing a large-scale bibliographic information database and opening a smooth use system However, as the cost of introducing a commercial DBMS that can be used simultaneously with more than necessary users is reduced, it provides an opportunity to open and share information on the collections of 6,000 libraries in Korea, including public libraries, to the digital library environment at a low budget. Foreign currency waste can be prevented by minimizing the introduction of commercially available databases. In addition, by securing the core base technology of the main memory resident real-time database development, it is possible to spread the development of the application system using the same.

Claims (2)

A bibliographic information search server connected to a network to enable data transmission and reception with other computers such as a web server by a communication protocol such as TCP / IP, a bibliographic information database engine running on the bibliographic information search server, and the bibliographic information database engine. A bibliographic information retrieval system comprising a bibliographic information database (DB) that stores bibliographic information data processed in the bibliographic information form and the bibliographic information form; A web server that receives a request for retrieval of bibliographic information or bibliographic information from the general user through the network and displays the result to the general user in a web browser; And a bibliographic information manager for managing the bibliographic information retrieval system through the network. A bibliographic information search server connected to other computers such as the bibliographic information search server and the like by the communication protocol such as TCP / IP, a bibliographic information database engine (DB Engine) which is executed by the bibliographic information search server, and the A bibliographic information retrieval system, which is stored in a main memory of a bibliographic information retrieval server, and which is composed of a bibliographic information database (DB) processed by the bibliographic information database engine; And The network is connected to the bibliographic information search server and bibliographic information database by the network, and monitors the modification (insertion, deletion, update) of the bibliographic information in the bibliographic information database in real time. If so, copy and store the contents in a separate storage device, and generate an update request message requesting the bibliographic information database of the bibliographic information retrieval system to be modified to correspond to the data modification of the bibliographic information database. An update monitor for transmitting to the information retrieval server; When the bibliographic information retrieval request of the general user is provided, the web server preferentially searches the bibliographic information stored in the bibliographic information database to display the result to the user. system. The apparatus of claim 1, wherein the bibliographic information search server sends a success message or a failure message to the update monitor according to whether the contents of the bibliographic information database are correctly modified, and the update monitor receives a success message. Deletes the modifications copied to the large-sized, bibliographic information retrieval system, characterized in that to continue sending the update message to the bibliographic information retrieval server until a success message is received.