KR101602645B1 - Middleware device for efficient data collection and efficient data collection method of middleware device - Google Patents

Abstract

The present invention relates to an efficient data collection method for a middleware apparatus and a middleware apparatus for efficiently collecting data. As data is transmitted from a data transmission apparatus to a socket, a middleware apparatus selects a specific queue from a plurality of queues including a plurality of queues Storing the data transmitted to the socket in the specific queue; and transmitting, by the middleware apparatus, data stored in the queue to the socket, And storing the data stored in a specific queue that is idle according to the observation result in the database, thereby selecting a specific one of the plurality of queues included in the clustering queue and storing the selected queue in the socket By allocating, the data sent to the socket is queued The time required for temporary storage is shortened, and the total time for data collection and storage is saved.

Description

Technical Field [0001] The present invention relates to a middleware device for efficiently collecting data and an efficient data collection method of a middleware device,

The present invention relates to a data collection technique, and more particularly, to a middleware apparatus and an efficient data collection method for a middleware apparatus for efficiently collecting data, which improves the data collection efficiency of a middleware apparatus that collects data and stores the collected data in a database .

M2M (Machine to Machine) technology, which intelligently collects and transmits information by imposing a communication function on objects, has been studied and commercialized. By using this object communication, it is possible to collect information by collecting information collected from a specific sensor or information of a specific device through communication with other devices.

FIG. 1 is a diagram illustrating a conventional middleware device collecting and storing data. In FIG. 1, the client apparatus 1 for collecting and transmitting various information transmits data to the middleware apparatus 2, and the middleware apparatus 2 stores and stores the collected data in the database 3.

At this time, the client apparatus 1 includes a plurality of clients 1-1, 1-2, ..., 1-n, and each of the clients 1-1, 1-2, Transmits data to the sockets 2-1, 2-2, ..., 2-n of the corresponding middleware apparatus 2. [ However, the middleware device 2 can not store the data transmitted to the sockets 2-1, 2-2, ..., 2-n at once in the database 3, Is requested.

Korean Patent Publication No. 10-2013-0118593 (published on October 30, 2013)

SUMMARY OF THE INVENTION It is an object of the present invention to solve the above problems and to provide a middleware apparatus for efficiently collecting data, which can significantly reduce a time required for storage using a clustering queue in a middleware apparatus for collecting data and storing the collected data in a database, And to provide an efficient data collection method of the middleware device.

According to another aspect of the present invention, there is provided a middleware apparatus for efficiently collecting data, the apparatus comprising: a plurality of queues including a plurality of queues, A queue management module, a queue storage module for storing the data transmitted to the socket in the specific queue, and the plurality of queues included in the clustering queue, and for storing data stored in the specific queue in an idle state, And a data storage module for storing the data.

In the middleware apparatus for efficient data collection according to the present invention, the queue management module may adjust the number of the plurality of queues included in the clustering queue, or adjust the size of each memory allocated to the plurality of queues .

In the middleware apparatus for efficiently collecting data according to the present invention, the queue management module allocates the specific queue to the socket by referring to the available storage space of the plurality of queues.

In the middleware apparatus for efficient data collection according to the present invention, the data storage module stores data of an idle queue found first in a database or refers to an available storage space of a plurality of idle queues, And stores it in the database first.

According to another aspect of the present invention, there is provided a method for efficiently collecting data in a middleware apparatus, the method comprising the steps of: receiving data from a data transmitting apparatus to a socket, the middleware apparatus selecting a specific queue from a clustering queue including a plurality of queues, Storing the data transmitted to the socket in the specific queue; and checking whether the middleware apparatus has queues that are idle in the plurality of queues included in the clustering queue And storing the data stored in the specific queue that is idle in accordance with the observation result in the database by the middleware apparatus.

In the method of efficiently collecting data of the middleware apparatus of the present invention, before the step of allocating to the socket, the middleware apparatus adjusts the number of the plurality of queues included in the clustering queue, And a step of adjusting the size.

In the efficient data collection method of the middleware apparatus of the present invention, in the step of allocating to the socket, the middleware apparatus refers to the available storage space of the plurality of queues and allocates the specific queue to the socket.

In the method of efficiently collecting data in the middleware apparatus according to the present invention, the step of storing the data in the database may firstly store data of the idle queue found by the middleware apparatus in the database or refer to an available storage space of a plurality of idle queues And the data of the specific idle queue is first stored in the database.

In order to accomplish the above object, the present invention provides a computer readable recording medium on which a program for performing an efficient data collection method of the above-described middleware apparatus is recorded.

According to an efficient data collection method of a middleware apparatus and a middleware apparatus for efficient data collection of the present invention, a middleware apparatus for collecting data selects a specific queue among a plurality of queues included in a clustering queue and allocates the queue to a socket, The time taken to store the transmitted data in the queue is shortened. In addition, the middleware apparatus can find the queues in the idle state among the clustering queues, store the data stored in the idle queues in the database, and store the data stored in each queue in the database in sequence.

FIG. 1 is a diagram illustrating a conventional middleware device collecting and storing data.
2 is a diagram illustrating a state in which a middleware apparatus according to an embodiment of the present invention collects and stores data.
3 is a diagram illustrating a state in which a middleware apparatus according to another embodiment of the present invention collects and stores data.
4 is a diagram illustrating a configuration of a middleware apparatus according to the embodiment of FIG.
5 is a flowchart illustrating a process of collecting data by a middleware according to another embodiment of the present invention.

In the following description, only parts necessary for understanding the embodiments of the present invention will be described, and the description of other parts will be omitted so as not to obscure the gist of the present invention.

The terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings and the inventor is not limited to the meaning of the terms in order to describe his invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely preferred embodiments of the present invention, and are not intended to represent all of the technical ideas of the present invention, so that various equivalents And variations are possible.

The present invention relates to a middleware apparatus for collecting data. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 2 is a diagram illustrating a state in which the middleware apparatus 20 according to an embodiment of the present invention collects and stores data.

Referring to FIG. 2, a data transmission device 10, a middleware device 20, and a database 60 are shown.

The data transmitting apparatus 10 is an apparatus for collecting various information and transmitting the collected information to the middleware apparatus 20, and may be a device for transmitting and receiving information through object communication (M2M, Machine to Machine).

Object communication refers to a broadcasting and communication convergence infrastructure that can detect, store, process, and integrate information about people, objects and environments, and provide customized knowledge / intelligence information services that are safe and convenient anytime and anywhere. This kind of object communication extends the human-centered Internet infrastructure such as Broadband Integrated Network (BcN) and Next Generation Internet Address System (IPv6) to the area between human vs. object, object-to-object, to provide.

The data transmission apparatus 10 may include a sensor for detecting various situations and a communication interface for transmitting and receiving various messages and data through object communication.

The database 60 is a storage for storing data collected by the middleware apparatus 20. [ The database 60 can increase the efficiency of data retrieval and updating by structuring and storing the data.

The middleware device 20 functions to store data collected from the data transmission device 10 in the database 60. [

Middleware usually refers to system software that is responsible for communication between a client and a server or system software that is responsible for connecting a computer and a computer. In general, middleware is interpreted as a broad concept. This middleware provides extensibility between heterogeneous components and can be used to make a procedure of a specific application callable by another application or to distribute an object of an application program so that it can be shared among heterogeneous networks, It allows you to communicate and exchange messages and data between applications.

The middleware apparatus 20 of this embodiment has a communication interface for performing communication with each of the data transmission apparatuses 10 and extracts valid data from the data received from the data transmission apparatus 10 and sends the valid data to the database 60 Can be stored.

At this time, each of the objects 10-1, 10-2, ..., 10-n of the data transmission apparatus 10 is connected to each socket 20-1, 20-2, ..., , 20-n. The socket is an identifier for identifying a specific service of the middleware device 20. The middleware device 20 defines the protocol of the socket, the transmission type of the socket, and the protocol used by the socket to communicate, 1, 20-2, ..., 20-n.

The internal thread of the middleware apparatus 20 temporarily stores the data received through each socket 20-1, 20-2, ..., 20-n in the queue 30. [ Queues are ordered so that data is inserted on one side of the list and data is deleted on the other side, and the inserted data is first erased first. At this time, the middleware apparatus 20 sequentially stores the data stored in the queue 60 in order from the data stored in the queue 30 in order, and deletes the data written in the database 60 from the queue 30.

In the present embodiment, the middleware apparatus 20 may temporarily store the data in the internal queue 30 before writing the data in the database 60, thereby saving time for data collection. However, there is a limit in that waiting time for temporary storage of data occurs by storing the data received through the sockets 20-1, 20-2, ..., 20-n in a single queue 30 .

Another embodiment of the present invention, which has been improved in this respect, will be described with reference to FIGS. 3 and 4. FIG.

FIG. 3 is a diagram illustrating a state in which the middleware apparatus 40 according to another embodiment of the present invention collects and stores data. FIG. 4 is a diagram illustrating the configuration of the middleware apparatus 40 according to the embodiment of FIG.

Referring to FIG. 3, a data transmitting device 10, a middleware device 40, and a database 60 are shown.

The functions of the data transmitting apparatus 10 and the database 60 are similar to those described with reference to FIG. 2, and therefore, the different functions of the middleware apparatus 40 will be described below.

The data transmitting apparatus 10 is a device for collecting various information and transmitting the collected information to the middleware apparatus 40. The data transmitting apparatus 10 may include a sensor for detecting various situations and a communication for transmitting and receiving various messages and data through object communication, Interface.

The database 60 is a storage for storing data collected by the middleware apparatus 20. [

The middleware device 40 functions to store data collected from the data transmission device 10 in the database 60. [

The middleware apparatus 40 of this embodiment has a communication interface for performing communication with each of the data transmission apparatuses 10 and extracts valid data from the data received from the data transmission apparatus 10 and transmits the extracted data to the database 60 Can be stored.

At this time, each of the objects 10-1, 10-2, ..., 10-n of the data transmission apparatus 10 is connected to each of the sockets 40-1, 40-2, ..., , 40-n. The socket is an identifier for identifying a specific service of the middleware device 40. The middleware device 40 defines a protocol of the socket, a transmission type of the socket, and a protocol used by the socket to communicate with each socket 40- 1, 40-2, ..., 40-n.

Meanwhile, the middleware apparatus 40 has a clustering queue 50 including a plurality of queues 50-1, 50-2, ..., and 50-n. The clustering queue 50 is a bundle of queues 50-1, 50-2, ..., 50-n which are temporary storage of data.

At this time, the internal thread of the middleware apparatus 40 transmits the data received through each socket 40-1, 40-2, ..., 40-n to the corresponding queue 50-1, 50- 2, ..., 50-n, and stores them in the database 60. [

As shown in FIG. 4, the middleware apparatus 40 for performing this operation includes a queue management module 21, a queue storage module 22, and a data storage module 23.

When data is transmitted from the data transmission apparatus 10 to each of the sockets 40-1, 40-2, ..., 40-n, the queue management module 21 sends a plurality of queues 50-1, 50-2 Scheduling for selecting a specific queue from the clustering queue 50 including the queues 50-1 to 50-n and assigning the queues to the sockets 40-1, 40-2, ..., 40- .

For example, the queue management module 41 stores queues 50-1 and 50-n in each socket 40-1, 40-2, ..., 40-n using the following pseudo code: 2, ..., 50-n.

01: while (true)

02: waiting for a request for sending data from clients;

03: creates a socket for catching the request;

04: do-while

05: queue <- find an idle queue in the clustering queue

06: if queue is valid then

07: allocates the queue to the socket

08: end if

09: end do-while

10: end while;

In the above code, the middleware apparatus 40 waits until a request for data transmission is received from the objects 10-1, 10-2, ..., 10-n included in the data transmission apparatus 10, (40-1, 40-2, ..., 40-n) for communication with the base stations 10-1, 10-2, ..., 10-n. The queue management module 41 of the middleware apparatus 40 selects a queue from among the plurality of queues 50-1, 50-2, ..., 50-n included in the clustering queue 50, 50-1) and allocates them to a specific socket 40-1 to be used for receiving data from the object 10-1.

The queue management module 41 of the present embodiment adjusts the number of queues 50-1, 50-2, ..., 50-n included in the clustering queue 50 according to the situation, The size of the memory can be adjusted. For example, when there is insufficient space for writing data in the queues 50-1, 50-2, ..., 50-n, a new queue can be added to the clustering queue 50, , 50-2, ..., and 50-n, there may be some queues deleted from the clustering queue 50. [ 50-n in the case where the storage space is insufficient depending on the data storage state of the queues 50-1, 50-2, ..., 50-n, The size of the memory allocated to each of the queues 50-1, 50-2, ..., and 50-n can be reduced and managed appropriately when the storage space is excessive .

In addition, the queue management module 41 refers to the available storage space of the plurality of queues 50-1, 50-2, ..., 50-n included in the clustering queue 50, Can be assigned. For example, a queue with a relatively large amount of available storage space may be assigned to a specific socket first.

The queue storage module 42 stores the data transmitted to each socket 40-1, 40-2, ..., 40-n in the corresponding queues 50-1, 50-2, ..., 50-n.

For example, when a specific object 10-1 of the data transmission apparatus 10 transmits data to a specific socket 40-1 of the middleware apparatus 40 and the queue management module 41 transmits data to the sockets 40-1 The queue storage module 42 stores the data received by the socket 40-1 in the specific queue 50-1.

The data storage module 43 continuously observes the plurality of cues 50-1, 50-2, ..., 50-n included in the clustering queue 50 and the sockets 40-1, 40-2 , ..., 40-n), the data stored in the queues is stored in the database 60. The queue 60 stores the data in the queues.

For example, the data storage module 43 may store a plurality of cues 50-1, 50-2, ..., 50-n included in the clustering queue 50 using the following pseudo code, And then writes the data to the database 60.

01: while (true)

02: foreach (queue in clustering_queue)

03: if data exists in the queue then

04: save the data to a database

05: end if

06: end foreach

07: end while;

In the above code, the data storage module 43 writes the value of the specific queue to the database 60 when there is data in the idle specific queue.

During the observation of the plurality of queues 50-1, 50-2, ..., and 50-n included in the clustering queue 50, the data storage module 43 stores the data of the idle queue found first May be stored in the database 60 or may be scheduled by referring to the available storage space of a plurality of idle queues and storing data of a specific idle queue in the database 60 first.

The middleware apparatus 40 includes a clustering queue 50 including a plurality of queues 50-1, 50-2, ..., and 50-n, -1, 40-2,..., 40-n to store data, the time required for data storage can be shortened compared with the case of using a single queue. The data stored in the plurality of queues 50-1, 50-2, ..., 50-n are stored in the queue 50-1, 50-2, ..., 50- Are sequentially stored in the database 60, it is possible to prevent the delay of time due to the use of the clustering queue 50 as much as possible.

The process of collecting data by the middleware according to the present invention will be described with reference to FIG.

5 is a flowchart illustrating a process of collecting data by a middleware according to another embodiment of the present invention.

Referring to FIG. 5, the middleware apparatus selects a specific queue from a clustering queue including a plurality of queues and allocates the selected queue to the corresponding socket (S2) as data is transmitted from the data transmitting apparatus to an inner socket (S1).

Meanwhile, before step S1, the middleware apparatus adjusts the number of queues included in the clustering queue in consideration of the data reception state through the sockets and the data storage state of the clustering queue, Can be adjusted.

The middleware apparatus of step S2 may allocate a specific queue to the socket by referring to the available storage space of the plurality of queues included in the clustering queue.

Then, the middleware apparatus temporarily stores the data transmitted to the internal sockets in a specific queue allocated in step S2 (S3).

When data is stored in the plurality of queues included in the clustering queue 50, the middleware apparatus observes whether there is a queue in an idle state in a plurality of queues included in the clustering queue (S4).

If a specific queue in the idle state is found as a result of the observation in step S4, the middleware device stores the data stored in the specific queue in the database (S5).

The middleware apparatus in step S5 may first store the data of the idle queue found earlier according to the observation result in step S4, in the database.

In addition, the middleware apparatus of step S5 may store the data of the specific idle queue in the database by referring to the available storage space of the plurality of idle queues.

The method of efficiently collecting data of the middleware according to an embodiment of the present invention may be implemented in a form of a program readable by various computer means and recorded in a computer-readable recording medium.

It should be noted that the embodiments disclosed in the present specification and drawings are only illustrative of specific examples for the purpose of understanding, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein. Furthermore, although specific terms are used in this specification and the drawings, they are used in a generic sense only to facilitate the description of the invention and to facilitate understanding of the invention, and are not intended to limit the scope of the invention.

10: Data transmission apparatuses 10-1, 10-2, ..., 10-n:
20, 40: Middleware device 20-1, 20-2, ..., 20-n: Socket
30, 50-1, 50-2, ..., 50-n: queue 50: clustering queue
60: Database

Claims (9)

A queue management module for selecting a specific queue from a clustering queue including a plurality of queues and allocating the selected queue to the socket as data is transmitted from the data transmission device to the socket;
A queue storage module for storing data transmitted to the socket in the specific queue; And
A data storage module that observes the plurality of queues included in the clustering queue and stores data stored in the specific queue in an idle state in a database;
/ RTI &gt;
Wherein the queue management module adjusts the number of queues included in the clustering queue or adjusts the size of each memory allocated to the plurality of queues. delete The method according to claim 1,
Wherein the queue management module allocates the specific queue to the socket with reference to an available storage space of the plurality of queues. The method according to claim 1,
Wherein the data storage module stores the data of the idle queue found first in the database or stores the data of the idle queue in the database with reference to the available storage space of the plurality of idle queues. Middleware device for. Selecting a particular queue from a clustering queue including a plurality of queues and allocating the queue to the socket as the data is transmitted from the data transmitting device to the socket;
Storing the data transmitted to the socket in the specific queue by the middleware device;
The middleware device observing whether there is a queue in an idle state in the plurality of queues included in the clustering queue; And
Storing the data stored in a specific queue that is idle in the database according to an observation result of the middleware apparatus;
Lt; / RTI &gt;
Adjusting the number of the plurality of queues included in the clustering queue or adjusting the size of each memory allocated to the plurality of queues before allocating to the socket;
The method of claim 1, further comprising: delete 6. The method of claim 5,
Wherein the allocating to the socket allocates the specific queue to the socket by referring to the available storage space of the plurality of queues. 6. The method of claim 5,
The storing in the database may include storing data of an idle queue found first by the middleware device in a database or storing data of a specific idle queue in a database with reference to an available storage space of a plurality of idle queues Wherein the middleware device is a data warehouse. A computer-readable recording medium having recorded thereon a program for performing the method according to any one of claims 5, 7 and 8.

Images