KR101275391B1 - Data indexing method and system for serch servise supporting unicode - Google Patents

Abstract

PURPOSE: A data indexing method for a search service supporting a unicode and a system thereof are provided to reduce the size of a storage space requiring data indexing by converting Korean data into a code for reducing the size of the data. CONSTITUTION: A data converting unit(612) inserts a division code for dividing Korean data into a starting part and an end part of the Korean data and converts the data into a conversion code for reducing the size of the Korean data. An indexing unit(614) indexes the converted Korean data. The division code is a Korean code maintaining a shape during the conversion of the division code. The division code codes the Korean data to reduce the size of the Korean data. [Reference numerals] (610) Indexing system; (612) Data converting unit; (614) Indexing unit; (620) Index database; (630) Search system; (632) Query input unit; (634) Query converting unit; (636) Search unit

Description

DATA INDEXING METHOD AND SYSTEM FOR SERCH SERVISE SUPPORTING UNICODE}

Embodiments of the present invention relate to a method and system for indexing and searching data to provide a search service that supports Unicode.

Recently, due to the spread of high speed internet and the rapid increase of high speed internet users, development of new services and diversification of service items are in progress. Among the services using the Internet, a representative service is a search service.

The search service means that when a query is input from a user, a search result corresponding to the input query (for example, a web site including the input query, an article including the input query, an image having a file name including the input query) ) Is a service that provides the user.

A search system providing such a search service may provide an autocomplete query for the user's convenience. When the user inputs some phonemes or syllables constituting the query, the autocomplete query word automatically completes a query including the input phonemes or syllables and recommends the completed query to the user.

Meanwhile, the search system indexes and stores various data in a database in order to provide a search result, an autocomplete query, etc. to a user. In this case, in order to maximize the convenience of the user, even if the user inputs only the first consonant of the Hangul as a query, the search system needs to separate and index the Hangul in alphabetical units so that a search result or an autocomplete query can be provided. In the case of Korean, 3 bytes of storage space are required for each phoneme. Therefore, indexing the Korean alphabet by phoneme requires more storage space than indexing using a general indexing method.

However, in this case, if the Hangul phoneme is transformed into fewer bytes using the conversion code to reduce the size of the Hangul data and then the transformed Hangul phoneme is indexed, the Hangul is indexed in the phoneme unit and the storage space required for data indexing is reduced. You can.

Meanwhile, the search system supports Unicode in order to provide a search service for languages of each country such as Chinese, Japanese, etc. in addition to Korean. However, if a conversion code for reducing the size of the Hangul data is applied to an environment that supports Unicode, the Hangul combination is transformed into a character such as Hanja, which makes it difficult to provide a normal search service.

Provided are a data indexing method and apparatus for a search service that supports Unicode, which can reduce the size of storage space required for data indexing in an environment supporting Unicode that provides various languages, and can provide a normal search service.

The method of indexing data in an environment supporting Unicode includes inserting a division code for distinguishing that the Hangul data is Hangul at the beginning and end of the Hangul data and reducing the size of the Hangul data in which the division code is inserted. Converting to a conversion code and indexing the converted Korean data.

According to one side, the classification code may be to maintain a fixed form upon conversion to the conversion code.

According to another aspect, the identification code may be a Hangul code.

According to another aspect, the conversion code may be a code for reducing the size of the Hangul data by encoding the Hangul data in a phoneme unit.

The method of searching for data in an environment supporting Unicode includes receiving a query, and inserting a division code for distinguishing that the query is Korean from the beginning and end of the query when the query is a Korean query. The method may include converting the query word into which the code is inserted into a conversion code for reducing the size of Korean data and searching for data corresponding to the converted query word.

The system for indexing data in an environment supporting Unicode inserts a division code for distinguishing that the Hangul data is Hangul at the beginning and the end of the Hangul data and reduces the size of the Hangul data into which the division code is inserted. It may include a data conversion unit for converting the conversion code and the index unit for indexing the converted Hangul data.

The system for searching Korean data in an environment supporting Unicode inserts a query input unit for receiving a query, and if the query is a Korean query, inserts a division code for distinguishing that the query is Korean at the beginning and end of the query. It may include a query word converter for converting the query word inserted with the classification code into a conversion code for reducing the size of the Hangul data and a searcher for searching data corresponding to the converted query word.

When indexing Hangul data in an environment supporting Unicode that provides various languages, insert a code for distinguishing that the data is Hangul at the beginning and end of the Hangul data and reduce the size of the Hangul data. By reducing the size of the storage space required for data indexing by avoiding collisions, a normal search service can be provided.

1 is a flowchart illustrating a method of indexing data in an environment supporting Unicode according to an embodiment of the present invention.
2 is a flowchart illustrating a method for searching data in an environment supporting Unicode according to an embodiment of the present invention.
3 to 5 are exemplary diagrams for explaining a difference between a search result according to an existing index method and a search result according to an index method according to the present invention.
6 is a block diagram illustrating a data indexing system and a data searching system according to an embodiment of the present invention.
7 is a diagram for explaining a process of indexing and searching data according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart illustrating a method of indexing data in an environment supporting Unicode according to an embodiment of the present invention.

Referring to the drawings, the data indexing system according to the present invention indexes data for a search service in an environment supporting Unicode. To this end, the data indexing system first determines whether the data to be indexed is Korean data. If the data is Hangul data, a division code for distinguishing that the data is Hangul is inserted at the beginning and the end of the Hangul data (S110). Then, the Hangul data with the division code inserted is converted into a conversion code for reducing the size of the Hangul data (S120), and the converted Hangul data is indexed (S130).

Here, the classification code is a code in which a shape is fixedly maintained when converting Hangul data into the conversion code for reducing the size of the Hangul data, and may be, for example, a Hangul code.

For example, the data indexing system inserts a Hangul code of "Han" at the beginning of the Hangul data and artificially inserts a Hangul code of "Wang" at the end when converting the Hangul data into the conversion code. The data located at can be displayed as Korean data.

Meanwhile, the transform code for reducing the size of the Hangul data may be a promised consistent code for reducing the size of the data while mixing a UTF (UCS Transformation Format) file and a non-UTF file. An example of such a code is “Lee Sung-Jin Code,” which is a code that reduces the size of Korean data by encoding Korean data in a phoneme unit.

Accordingly, the data indexing system according to the present invention inserts a code for distinguishing that the Hangul data is Hangul at the beginning and end of the Hangul data when indexing the Hangul data in an environment supporting Unicode that provides various languages. Convert the data into code to reduce the size of Korean data. As such, by preventing Korean characters from being recognized as words such as Chinese characters, the size of storage space can be reduced when indexing data, and a normal retrieval service without collisions can be provided.

2 is a flowchart illustrating a method for searching data in an environment supporting Unicode according to an embodiment of the present invention.

The data search system according to the present invention first determines whether a query received from a user is a Korean query in order to search for data in an environment supporting Unicode.

If the input query is a Korean query, the data search system inserts a division code for distinguishing that the query is Hangul into the beginning and end of the input query (S210), and inserts the query with the division code into the size of the Korean data. Convert to a conversion code to reduce (S220).

Here, the division code may be a Hangul code whose shape is fixed when converting to a conversion code, similar to the division code used for data indexing, and the conversion code is a code for reducing the size of the Hangul data by encoding the Hangul data in units of characters. Can be.

If the query received from the user is transformed into a conversion code, the data search system searches for data corresponding to the converted query in the pre-indexed data using the converted query (S230). Here, the indexed data may be data that is inserted into the classification code and converted into the conversion code, similar to the input query word.

3 to 5 are exemplary diagrams for explaining a difference between a search result according to an existing index method and a search result according to an index method according to the present invention.

First, referring to FIG. 3, when a user inputs a query of “ㅂ”, the search is performed as a recommendation query when the index is searched only by the conversion code according to the existing indexing method, and when the index is inserted and inserted according to the present invention. The result will be described.

When a user inputs a query "ㅂ", the existing indexing method exposes a special symbol having the same code value as the query word "ㅂ" as an autocomplete query as shown in FIG. 3. However, in the case of indexing according to the present invention, since "ㅂ" is recognized as Korean, an autocomplete query related to "ㅂ" may be exposed instead of a special symbol having the same code value as "ㅂ".

On the other hand, when the user enters the query "", "as shown in Figure 4, the existing index method may initially expose the autocomplete query related to" B ", but according to the existing index method, the Chinese characters irrelevant to" B "are exposed. However, in the case of indexing according to the present invention, the search may be performed by first searching for "AB" and exposing the query related to "AB" and then exposing the "rd" related autocomplete query which is transformed into the corresponding alphabet. have.

In addition, when the user inputs the query word "ㄷㅇ" as shown in FIG. 5, since the word "ㄷㅇ" does not exist, when the index is indexed according to the existing indexing method, the Chinese character having the same code value as "ㄷㅇ" should be exposed. "□" is exposed because the Chinese character corresponding to is a Chinese character not displayed on the browser. However, in the case of indexing according to the present invention, an "ed" related autocompletion query in which "" is converted into an alphabet may be exposed.

6 is a block diagram illustrating a data indexing system and a data searching system according to an embodiment of the present invention.

Referring to the drawings, the data indexing system 610 includes a data converter 612 and an indexer 614, and the data search system 630 includes a query inputter 632, a query converter 634, and a searcher ( 636).

The data conversion unit 612 inserts a division code for distinguishing that the Hangul data is Hangul at the beginning and end of the Hangul data in order to index the data using less storage space in a Unicode supporting environment. The Hangul data with the separator code inserted is converted into the conversion code to reduce the size.

The division code may be a Hangul code having a fixed shape when converted to a conversion code, and the conversion code may be a code for reducing the size of the Hangul data by encoding the Hangul data in a phoneme unit.

The index unit 614 indexes the converted Korean data into the index database 620 when the Korean data is converted into the conversion code by the data converter 612.

The index database 620 stores an autocomplete query, data for providing a search result, and the like. The index database 620 may be included in any one of the index system 610 and the search system 620 or may be configured as a separate device.

On the other hand, the query input unit 632 of the data search system 630 receives a query from the user and transfers it to the query converter 634.

When the query input from the query input unit 632 is a Korean query, the query conversion unit 634 inserts a division code for distinguishing that the query is Korean from the beginning and end of the query and inserts the division code. Is converted into a conversion code for reducing the size of Korean data.

In addition, the search unit 636 may convert data corresponding to the converted query word among a plurality of data converted into the conversion code and indexed to the index database 620 by using the query word converted into the conversion code by the query conversion unit 634. Navigate.

In this case, the searcher 636 may transform the query word converted into the conversion code into an alphabet query word corresponding to the search code and search for the corresponding data (search results, autocomplete query words, etc.) using the alphabet query word. .

7 is a diagram for explaining a process of indexing and searching data according to an embodiment of the present invention.

Hereinafter, a process of indexing and searching data by the data indexing system and the data searching system according to the present invention will be described in more detail with reference to FIG. 7.

First, the data indexing system indexes an autocomplete query for a query input by a user and data 710 to be indexed into an index database in an index database by using a conversion code for reducing the size of Korean data.

When the autocomplete query word and data are indexed to the index database through the indexing process, the data search system receives the query word from the user (730) and converts it using the conversion code (740). In operation 750, an autocomplete query word or data corresponding to the query word modified by the conversion code is searched in the index database, and the search result is output in operation 760.

Therefore, the data indexing method and system for the Unicode-supported search service according to the present invention is the beginning and end of the Hangul data when indexing the Hangul data in the environment supporting Unicode to provide a variety of languages through the indexing process By inserting a code for distinguishing that Hangul data is Hangul into the code and converting the Hangul data into a code for reducing the size of the Hangul data, the size of the storage space required for data indexing can be reduced. By preventing collisions that are transformed into words such as Chinese characters, a normal search service can be provided.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

Claims (17)

In a way to index data in an environment that supports Unicode,
Inserting a division code for distinguishing that the Hangul data is Hangul at the beginning and the end of the Hangul data and converting the conversion code into a conversion code for reducing the size of the Hangul data into which the division code is inserted; And
Indexing the converted Hangul data
Korean data indexing method comprising a. The method of claim 1,
The division code is,
The form remains fixed upon conversion to said conversion code
Korean data indexing method characterized in that. The method of claim 1,
The division code is,
Korean data indexing method characterized in that the Hangul code. The method of claim 1,
The conversion code is,
And a code for reducing the size of the Hangul data by encoding the Hangul data in a phoneme unit. In a way to explore data in an environment that supports Unicode,
Receiving a query;
When the query is a Hangul query, inserting a division code for distinguishing that the query is Hangul at the beginning and end of the query and converting the query with the division code into a conversion code for reducing the size of the Hangul data step; And
Searching for data corresponding to the converted query
Korean data searching method comprising a. The method of claim 5,
The division code is,
The Hangul data search method, characterized in that the Hangul code is fixedly maintained when the conversion to the conversion code. The method of claim 5,
The conversion code is,
And a code for reducing the size of the Hangul data by encoding the Hangul data in a phoneme unit. The method of claim 5,
The searching step,
And searching for data corresponding to the converted query word among a plurality of data converted and indexed by the conversion code using the converted query word. The method of claim 5,
Converting the converted query to an alphabetic query corresponding to the converted query; And
And searching for corresponding data using the alphabet query. In a system that indexes data in an environment that supports Unicode,
A data conversion unit for inserting a division code for distinguishing that the Hangul data is Hangul and converting the conversion code into a conversion code for reducing the size of the Hangul data into which the division code is inserted; And
Index unit for indexing the converted Hangul data
Korean data indexing system comprising a. The method of claim 10,
The division code is,
A Hangul data index system, characterized in that the Hangul code is fixedly maintained when the conversion to the conversion code. The method of claim 10,
The conversion code is,
And a code for reducing the size of the Hangul data by encoding the Hangul data in a phoneme unit. In a system for searching Korean data in an environment supporting Unicode,
A query input unit for receiving a query;
When the query is a Hangul query, inserting a division code for distinguishing that the query is Hangul at the beginning and end of the query, and converts the query with the division code into a conversion code for reducing the size of the Hangul data A query conversion unit; And
Search unit for searching the data corresponding to the converted query
Korean data navigation system comprising a. The method of claim 13,
The division code is,
The Hangul data search system, characterized in that the Hangul code is fixedly maintained when the conversion to the conversion code. The method of claim 13,
The conversion code is,
And a code for reducing the size of the Hangul data by encoding the Hangul data in a phoneme unit. The method of claim 13,
The searching unit searches,
And searching for data corresponding to the converted query word among a plurality of data converted and indexed by the conversion code using the converted query word. The method of claim 13,
The searching unit searches,
And converting the converted query word into an alphabet query word corresponding to the converted query word and searching for corresponding data using the alphabet query word.

Images