KR20160049753A - Apparatus for Processing Query by Using Dynamic Schema and Computer-Readable Recording Medium with Program therefor - Google Patents

Abstract

In the present invention, a query processing mode is configured to set each table schema relevant to each data group, and use stored data individually corresponding to each of the table schema to process a query. Provided are an apparatus for processing a query by using a dynamic schema and a computer-readable recording medium therefor. According to the present invention, the method comprises: a step of receiving a query; a step of generating a combination table schema by combining schemas corresponding to the query from schemas of a data group to be used for the query by analyzing the query; and a step of processing the query by generating the combination data corresponding to the combination table schema by using data corresponding to the schemas of the data group, to be used for the query. According to an embodiment of the present invention, a schema is dynamically generated to process data.

Description

TECHNICAL FIELD [0001] The present invention relates to a query processing apparatus using a dynamic schema, and a computer readable recording medium therefor. More particularly,

The present embodiment relates to a query processing apparatus using a dynamic schema and a computer-readable recording medium therefor.

The contents described in this section merely provide background information on the present embodiment and do not constitute the prior art.

A relational database is created by defining a variety of predefined structures of data as schemas and normalizing them. Designing a database is costly and time-consuming, and after a schema is determined once, the database structure changes due to the addition or deletion of a column in the table, causing a change in the overall schema. You can give.

To solve the above difficulties, creating and managing data of various structures as one table in the relational database has many difficulties such as allocation and management of data space for storing table data.

Accordingly, in the case of data storage and query processing using a database developed for distributing a large amount of data in a batch format like Hadoop, it is necessary to determine a value in the stored data as a key value In general, it is necessary to provide a method for mass data processing such as Hadoop, which is different from a general relational database, since it is common to perform a task of giving meaning to data at the time of data processing.

The present embodiment has a main object to provide an apparatus and method for processing a query using a dynamic schema.

The object of the present invention is to make it possible to dynamically generate various data schemas while providing an environment in which queries similar to SQL (Structured Query Language) can be used.

According to an aspect of the present invention, there is provided an apparatus for processing a query using an individual table schema corresponding to each data group and using data stored corresponding to the individual table schema, the apparatus comprising: a query receiving unit for receiving a query; A combination schema generation unit for analyzing the query and generating a combination table schema by combining a schema corresponding to the query from a schema of a data group to be used in the query; And a query processing unit for generating combination data corresponding to the combination table schema by using data corresponding to the schema of the data group to be used in the query and processing the query .

The individual table schema may include a key attribute and a non-key attribute, and attributes of keys of a plurality of individual table schemas may be set to be equal to each other.

Wherein the combination table schema sets a key attribute common to the plurality of individual table schemas as a key of the combination table schema and a non-key attribute of the combination table schema includes at least one non-key attribute in each of the plurality of individual table schemas .

The schema of the data group to be used for the query may be a plurality of individual table schemas corresponding to the plurality of data groups selected from the received data groups. The query processing unit may set a storage area corresponding to the combination table schema, map data corresponding to the first individual table schema among the plurality of individual table schemas to the storage area, The data corresponding to the individual table schema other than the first individual table schema may be sequentially mapped to the storage area to generate the combination data.

The query may be a query that generates the combination data and generates result data based on the combination data.

The dynamic schema query processing apparatus includes a field data receiving unit for receiving data composed of a plurality of fields; A data storage unit for storing the received data for each group; A schema input unit for specifying a data group to be processed and receiving an instruction including a schema setting request for a plurality of field data of the data group; And a schema setting unit for setting a schema for the designated data group using the plurality of field data according to the command.

Here, the command may include: setting an individual table schema corresponding to each data group for a plurality of data groups, storing data corresponding to the individual table schema, and setting each of the data groups to have the same key attribute Requesting a request.

According to another aspect of the present invention, there is provided a computer-readable storage medium storing a computer program for causing a computer to generate a corresponding individual table schema for each data group and storing data corresponding to the individual table schema, respectively; Receiving a query; Analyzing the query and generating a combination table schema by combining the schema corresponding to the query from the schema of the data group to be used in the query; And generating the combined data corresponding to the combination table schema by using data corresponding to the schema of the data group to be used in the query and processing the query. Media.

Wherein the stored data includes a plurality of data groups each having a separate table schema corresponding to each data group and storing data corresponding to the individual table schema, Lt; / RTI >

As described above, according to the present embodiment, a schema can be dynamically generated and data can be processed.

In addition, it is possible to construct an environment in which the schema of the data to be output is defined (Lazy binding) at the time of the processing of generating the corresponding data. The same effect can be obtained with a similar performance to that of a database formed of a single table in managing meta information such as a schema of a data dynamically and extracting information with a single query for various kinds of data.

Such a dynamic binding structure is very useful when various types of data are output depending on products in a single process line, such as a wafer manufacturing process, in order to store and utilize the data.

1 is a block diagram of a dynamic schema query processing apparatus according to an embodiment of the present invention.
2 is a diagram illustrating a schema for storing test results and stored test result data.
3 is a diagram illustrating a schema for storing test results different from the case of FIG. 2 and stored test result data.
4 is a diagram illustrating a combination table schema and corresponding stored data by analyzing the input query.
5 is a block diagram of a data processing unit 120 according to an embodiment of the present invention.
6 is a flowchart illustrating a dynamic schema query processing method according to another embodiment of the present invention.

Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. In the following description of the embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

FIG. 1 is a block diagram of a dynamic schema query processing apparatus 100 according to an embodiment of the present invention.

The dynamic schema query processing apparatus 100 according to an exemplary embodiment of the present invention includes a data receiving unit 110, a data processing unit 120, a query receiving unit 130, a combination schema generating unit 140, and a query processing unit 150 . Depending on the embodiment, the dynamic schema query processing apparatus 100 may be implemented by omitting some of its constituent elements or further including other constituent elements.

The data receiving unit 110 receives data to be stored.

For example, in a chip manufacturing process using semiconductor wafers, there are usually dozens of wafers in one wafer lot, and usually hundreds to thousands of chips are produced as one wafer. Generally, there are several hundred test items for one chip. In this case, test result data is generated for each test item.

When the data receiving unit 110 receives the test result data and receives the data, the data processing unit 120 generates a corresponding individual table schema for each received data group, and transmits the generated individual table schema to the individual table schema And stores the received data corresponding to each group. For example, an individual table schema is generated for each test result for one test item for the chip, and data is stored correspondingly.

FIG. 2 illustrates a schema for storing one test result and stored test result data, FIG. 3 illustrates a schema for storing a test result different from the case of FIG. 2, and FIG. to be.

2, when a test result is input, the data processing unit 120 combines the wafer number attribute and the chip number attribute as a data schema of Table A for storing the wafer number attribute (wafer number (Test item a, test item b) becomes a non-key attribute (Wafer No, Chip No, test item a, test item a) b) to generate a first schema that forms one record. Then, the data processing unit 120 stores the data group consisting of the test results corresponding to each chip in all the wafers in the wafer to be tested in the table storage space of Table A having the first schema.

The schema can be set by setting parameters such as a key attribute, a name of a non-key attribute, and a data size using a separate input device.

On the other hand, in the description of this embodiment, terms such as attribute, field, and column can be used in combination, but all are used in the same concept. In addition, although a case where one key is formed as a plurality of attributes has been described as an example, a key may be formed with one attribute depending on the embodiment.

In the case of FIG. 3, when a test result different from that of FIG. 2 is inputted, the data processing unit 120 bundles the wafer number attribute and the chip number attribute as a data schema of Table B for storing the wafer number attribute (Test item c, test item d, and test item e) corresponding to the experimental result become the non-key property (Wafer No, Chip No, Test No) A second schema that forms one record in the form of item c, test item d, test item e) is generated. Then, the data processing unit 120 stores the data group consisting of the test results corresponding to each chip in the table storage space of Table B having the second schema for all the wafers to be tested in the wafer rack.

In the case of FIGS. 2 and 3, a plurality of individual table schemas are stored by the data processing unit 120 such that the key attributes of a plurality of individual table schemas are identical to each other. In this case, Can be used to process this query.

The query receiving unit 130 receives a query input from a user of the dynamic schema query processing apparatus 100 using a predetermined input device. The query entered here may be written in SQL (Structured Query Language), but the present invention is not limited thereto and various languages can be used.

The combination schema generation unit 140 analyzes the query input to the query reception unit 130 and generates a combination table schema by combining the schema corresponding to the query from the schema of the data group to be used in the input query.

The combination table schema can set a key that is common to a plurality of individual table schemas used in a combination of a schema to a key of a combination table schema. The attributes of the combination table schema include at least one attribute .

4 is a diagram illustrating a combination table schema and corresponding stored data by analyzing the input query.

Create a table named table AB with test item a and test item b in Table A, test item c in table B, and test item d using "Wafer No, Chip No" as the key. The query 1 is described as an example.

The combination schema generation unit 140 checks the schema for Table A and Table B, which are the table names included in Query 1 above, and confirms that the (Wafer No, Chip No) A combination table schema for Table AB as shown in FIG. 4 is created by setting parameters such as the data type and size of the attribute including the test item a and the test item b, the test item c of Table B, and the test item d do.

The query processing unit 150 generates combination data corresponding to the combination table schema generated by the combination schema generation unit 140 using the data corresponding to the schema of the data group to be used in the input query, and processes the query.

The query processing unit 150 obtains the key values corresponding to the tables A and B, the data of the test items a and b of Table A corresponding to the key values, the data of the test items c and d of Table B And stores it in the corresponding storage area of the table having the combination table schema of FIG.

Since the database for mass data processing such as Hadoop is based on sequential access, in order to reduce the generation time of the combination table in generating a combination table such as Table AB, a storage area corresponding to the combination table schema of Table AB is set And then sequentially stores the data of the individual tables having the individual table schema.

That is, the data corresponding to the first individual table schema (for example, the key of Table A, the test item a, and the test item b data) among the plurality of individual table schemas used to form the combination table schema of Table AB are sequentially accessed And then mapping the data corresponding to the remaining individual table schema (i.e., the key of Table B, the test item c, and the test item d data) to the corresponding storage area of Table AB, And generates a combination data table corresponding to the combination table schema.

If the input query is a query (hereinafter referred to as query 2) that generates a new combination table using Table A, Table B, and Table C, the storage area for the combination table generated by processing Query 2 After the allocation, the data of Table A is mapped by sequential access to the area of the combination table, the data of Table B is mapped by sequential access to the area of the combination table, and the data of Table C is sequentially stored in the area of the combination table And accesses the data of each corresponding table sequentially.

In this way, it is possible to construct an environment in which the schema of the data that is desired to be output is defined (Lazy binding) at the time of the processing of generating the corresponding data. In addition, by managing meta information such as a schema of data dynamically, extracting information with a single query on various kinds of data can exhibit the same effect with similar performance to a database formed of a single table.

Such a dynamic binding structure is very useful when various types of data are output depending on products in a single process line, such as a wafer manufacturing process, in order to store and utilize the data.

5 is a block diagram of a data processing unit 120 according to an embodiment of the present invention.

The data processing unit 120 according to an embodiment of the present invention includes a field data receiving unit 510, a data storing unit 520, a query input unit 530, and a schema setting unit 540. The data processing unit 120 according to another exemplary embodiment of the present invention may be implemented by omitting some of the components or further including other components.

The field data receiving unit 510 receives data composed of a plurality of fields. Here, the data composed of a plurality of fields may be data of a format that is not divided by a plurality of fields without a schema, or may be a data table having a schema according to a data format to be used in the present embodiment.

The data storage unit 520 stores the received data for each predetermined group.

The schema input unit 530 designates a data group to be processed among the data groups stored in the data storage unit 520 and receives a query command including a schema setting request for a plurality of field data of the data group.

The schema setting unit 540 sets a schema for a specified data group using a plurality of field data of the corresponding data group according to a query command input from the schema input unit 530. [

If the data composed of a plurality of fields is data of a form in which the field is not a schema, the schema setting unit 540 sets a new schema for the corresponding data group.

If the data composed of a plurality of fields is a data table having a schema, the schema setting unit 540 may perform an operation of resetting the attribute name. In this case, the schema setting unit 540 can process the plurality of data groups so that the names of the attributes corresponding to the keys have the same key attribute.

6 is a flowchart illustrating a dynamic schema query processing method according to another embodiment of the present invention.

The dynamic schema query processing method according to another embodiment of the present invention includes a data receiving step S610, a data processing step S620, a query receiving step S630, a combining schema generating step S640, and a query processing step S650 .

In the data receiving process (S610), data to be stored is received from a user input device or an external data input device.

In the data processing step S620, a corresponding individual table schema is generated for each received data group, and the received data is stored for each group corresponding to the individual table schema.

In the query receiving process (S630), the user of the dynamic schema query processing apparatus 100 receives the input query using a predetermined input device.

In the combining schema generation process (S640), a query entered in the query receiving process (S630) is analyzed and a combination table schema is generated by combining the schema corresponding to the query from the schema of the data group to be used in the input query.

In the query processing step S650, the data corresponding to the schema of the data group to be used in the input query is used to generate combination data corresponding to the combination table schema generated in the combining schema creation step S640, and the query is processed.

A data processing step S620, a query receiving step S630, a combining schema generating step S640 and a query processing step S650 are performed by the data receiving unit 110, the data processing unit 120, The combination schema generation unit 140, and the query processing unit 150, respectively.

Although it is described in FIG. 6 that steps S610 to S650 are sequentially executed, this is merely illustrative of the technical idea of an embodiment of the present invention. In other words, those skilled in the art will understand that one of the steps S610 to S650 may be performed by changing the order described in FIG. 6 without departing from the essential characteristics of an embodiment of the present invention. 6 is not limited to the time-series order because it can be variously modified and modified by being executed in parallel.

The dynamic schema query processing apparatus 100 according to the embodiment of the present invention executes a program, a communication device such as a communication modem for performing communication with various devices or wired / wireless communication networks, a memory for storing data for executing a program, And a microprocessor for calculating and controlling the operation of the apparatus. According to at least one embodiment, the memory may be a computer such as a random access memory (RAM), a read only memory (ROM), a flash memory, an optical disk, a magnetic disk, or a solid state disk Readable recording / storage medium. According to at least one embodiment, a microprocessor can be programmed to selectively perform one or more of the operations and functions described in the specification. In accordance with at least one embodiment, the microprocessor may be implemented in hardware, such as an Application Specific Integrated Circuit (ASIC), in wholly or partially of a particular configuration.

As described above, the dynamic schema query processing method described in FIG. 6 can be implemented by a program and recorded in a computer-readable recording medium. A program for implementing the dynamic schema query processing method according to the present embodiment is recorded, and the computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of such computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and also implemented in the form of a carrier wave (e.g., transmission over the Internet) . The computer readable recording medium may also be distributed over a networked computer system so that computer readable code is stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the present embodiment can be easily inferred by programmers in the technical field to which the present embodiment belongs.

The foregoing description is merely illustrative of the technical idea of the present embodiment, and various modifications and changes may be made to those skilled in the art without departing from the essential characteristics of the embodiments. Therefore, the present embodiments are to be construed as illustrative rather than restrictive, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of the present embodiment should be construed according to the following claims, and all technical ideas within the scope of equivalents thereof should be construed as being included in the scope of the present invention.

110: Dynamic schema query processing device
110: Data receiving unit
120:
130:
140: Combination schema generation unit
150:
510: field data receiver
520: Data storage unit
530: Query input unit
540: schema setting unit

Claims (11)

An apparatus for processing a query using data stored in association with each individual table schema, wherein a corresponding individual table schema is set for each data group,
A query receiving unit for receiving a query;
A combination schema generation unit for analyzing the query and generating a combination table schema by combining a schema corresponding to the query from a schema of a data group to be used in the query; And
Generating a combination data corresponding to the combination table schema by using data corresponding to the schema of the data group to be used in the query and processing the query;
Wherein the dynamic schema query processing unit comprises: The method according to claim 1,
Wherein the individual table schema includes a key attribute and a non-key attribute, respectively. 3. The method of claim 2,
Wherein the plurality of individual table schemas are set such that the attributes of the keys are equal to each other. 3. The method of claim 2,
Wherein a key attribute common to the plurality of individual table schemas is set as a key of the combination table schema, and a non-key attribute of the combination table schema includes at least one non-key attribute in each of the plurality of individual table schemas. Query processing device. The method according to claim 1,
Wherein the schema of the data group to be used in the query is a plurality of individual table schemas corresponding to the plurality of data groups selected from the received data groups. 6. The information processing apparatus according to claim 5,
A storage area corresponding to the combination table schema, mapping data corresponding to a first individual table schema among the plurality of individual table schemas to the storage area, and mapping the first individual table schema And generates the combined data by mapping the data corresponding to the individual table schema except for the storage area to the storage area sequentially. The method of claim 1,
And generating the combined data and generating result data based on the combined data. 2. The dynamic schema query processing apparatus according to claim 1,
A field data receiving unit for receiving data composed of a plurality of fields;
A data storage unit for storing the received data for each group;
A schema input unit for specifying a data group to be processed and receiving an instruction including a schema setting request for a plurality of field data of the data group; And
A schema setting unit for setting a schema for the specified data group using the plurality of field data according to the instruction,
Wherein the dynamic schema query processing unit further comprises: 9. The method of claim 8,
The individual table schema corresponding to each data group is set for each of the plurality of data groups, and data is stored corresponding to the individual table schema, and each of the data groups has a request for schema setting so as to have the same key attribute And a dynamic schema query processing unit. On the computer,
Generating a corresponding individual table schema for each data group and storing data corresponding to the individual table schema;
Receiving a query;
Analyzing the query and generating a combination table schema by combining the schema corresponding to the query from the schema of the data group to be used in the query; And
Generating combination data corresponding to the combination table schema by using the stored data corresponding to the schema of the data group to be used in the query and processing the query
Readable recording medium having recorded thereon a program for executing the program. 11. The method of claim 10,
An individual table schema corresponding to each data group is set for each of a plurality of data groups and data is stored corresponding to the individual table schema, and each data group is generated by a command for requesting schema setting to have the same key attribute Readable recording medium.

Images