JPH02110772A - Character string retrieving device - Google Patents

Abstract

PURPOSE:To increase a character string retrieving speed by executing processing in a pipe-line system by separately operating an input part, a processing part, and an output part. CONSTITUTION:The title device is composed of an input line 10, an output line 11, an input part 20, an input control part 21, a processing part 22, a processing control part 23, an output part 24, an output control part 25, storing parts 30-32, a storing part selector 40, and a storage control part 41. Further, the input part 20, the processing part 22, and the output part 24 separately operate in parallel, the completion of a field and the completion of a record can be detected at a high speed by the respective control parts 21, 23, and 25, and stream data are processed in the pipe-line system. Thus, a character string can be retrieved at a high speed.

Description

DETAILED DESCRIPTION OF THE INVENTION Field of Industrial Application The present invention is applicable to the search of large amounts of structured data.
This relates to a character string search device used in database systems, etc. that performs processing centered on data. It is rare. Conventional processing is performed in software using a general-purpose processor.

Problems to be Solved by the Invention However, there is a problem in that software processing using such a general-purpose processor takes too much time.

The present invention solves the above-mentioned problems of the prior art, and aims to provide a character string search device that enables processing such as search and replacement at high speed.Means for Solving the Problems The invention according to claim 1 is characterized in that stream data having a data structure in which one record is a set of one or more fields and control data expressing attributes of the stream data in synchronization with the stream data are collectively input data. An input section for inputting data, an input control section for analyzing the control data and controlling the input section based on the analysis result, and a processing section for searching and processing the input data record by record based on preset search data. a processing control unit that analyzes input control data and controls the processing unit based on the analysis result; an output unit that outputs the processing result in record units as stream data; and an output unit that analyzes the control data accompanying the processing result. an output control section that controls the output section based on the analysis result, and the input section, the processing section, and the output section each include the input control section,
The above object is achieved by operating independently under the control of the processing control section and the output control section.

The invention of claim 2 is the invention of claim 1, wherein n storage units (n≧3) store stream data and control data that synchronizes with the stream data and expresses attributes of the stream data in record units. The input section, the processing section, and the output section are respectively switched and used in sequence, and the input section, the processing section, and the 5/output section operate independently to achieve the above purpose.

The invention of claim 3 is the invention of 1M claim 1.

Control data input in synchronization with stream data is
A collection of data that expresses record delimiters within stream data, field delimiters within records, start and stop of the entire stream data, etc.
Based on this information, each control section detects the end of each field, the end of a record, etc., and controls the input section, processing section, and output section to achieve the above purpose.

Effects According to the present invention, in the above configuration, the input section, the processing section, and the output section operate independently, so that processing can be performed in a so-called pipeline manner.

Embodiment μ Below, an example of control data representing stream data and attributes of stream data synchronized with the stream data in a character string search device according to an embodiment of the present invention will be shown and explained.

In FIG. 2, A is stream data.

It has a data structure in which one record is a collection of one or more fields. B represents control data.

Stream data A is stream data in which one record is a collection of a name field and a gender field, and control data B expresses the attributes of stream data A using predetermined attribute codes. As an attribute code.

General data 00. Set the record start to 01 and the field start to 02. These stream data A,
It is clear that if the information of control data B is synchronized and used as stream data, the end of a record, the end of a field, etc. of stream data A can be automatically detected by detecting only control data B.

FIG. 1 is a block diagram of a character string search device according to an embodiment of the present invention.

In the figure, 10 is an input line for transmitting data to be processed, and 20 is an input section for inputting dream data from the input line 10. Reference numeral 21 denotes an input control unit that inputs control data input in synchronization with stream data and detects the end of a record, the end of a field, etc., and sends control signals to the input unit 20 and the storage control unit 41. This outputs the following.

22 is a processing unit that performs processing such as searching and adding data to the input data; 23 is inputting control data that is input in synchronization with the data input to the processing unit 22; This is a processing control unit that detects the end of a field and outputs a control signal to the processing unit 22 and the storage control unit 41. 24 is an output unit that outputs the processed data; 25 is an output unit that inputs control data that is output in synchronization with the processed data, detects the end of a record or the end of a field, and outputs the processed data; Also, it is an output control section that outputs a control signal to the storage control section 41.

30, 31, and 32 are storage units for storing stream data A and control data B synchronized with the stream data;
0 is stored in the storage section 30 by a control signal from the storage control section 41.
, 31, and 32, and 41 is a storage control section that outputs a storage section selection signal to the storage section selector 40 based on the control signal output from each of the control sections 21, 23, and 25. The storage units 30 , 31 , and 32 are connected via a storage unit selector 40 to the input unit 20 , the processing unit 22 , the output unit 24 , and the control units 21 , 23 , and 25 associated therewith. Reference numeral 11 is an output line, which is a transmission line for sending processing results to other devices.

The operation of the above configuration will be explained below.

First, the processing unit 22 is given an instruction specifying a search character and processing content, and an insertion character string in advance. For example, the command may be such that when data in a certain field matches a search string, it is replaced with an inserted string.

The operation of the character string search device according to this embodiment when it is in regular operation will be explained below.

At any given time, the storage units 30, 31, and 32 are connected one-to-one to either the input unit 20, the processing unit 22, or the output unit 24. Now, the storage units 30, 31 and 32 are respectively the input units 20. Processing unit 22. The explanation will be given assuming that it is connected to the output section 249.\-/.

Stream data A input from the input line 10 and control data B synchronized with the stream data are input to the input section 20.
and written into the storage unit 30.

At the same time, record breaks are detected using the control data B input to the input control section 21 and input to the input section 20 and the storage control section 41 . In the input unit 20, the input of the stream data A and the control data B is terminated in response to the record break signal input from the input control unit 21. The processing unit 22 processes data in the storage unit 31 in which one record has already been written by the input unit 20. This process is
This is performed according to a command set in advance in the processing unit 22, and the location of the field specified by the command is detected from the control data by the processing control unit 23.
The information is transmitted to the processing unit 22. Furthermore, since the processing of the processing section 22 is completed in units of records as in the input section 20, the processing control section 23 detects a record break from the control data and sends the data to the processing section 22 and the storage control section 41. By typing.

The 10-page processing unit 22 ends its operation. The output unit 24 outputs to the output line 11 the contents of the storage unit 32 to which records already processed by the processing unit 22 have been written. Note that, at this time, the output control section 25 detects a break in the record, similar to each of the control sections described above, and inputs it to the output section 24 and the storage control section 41. Similarly, the output section 24 ends its output in response to a signal from the output control section 25.

As described above, the input unit 20. When all of the processing section 22 and the output section 24 finish processing one record stored in the storage section connected to each, the storage control section 41 receives the processing information from each control section 21, 23.25. A signal indicating the end of is coming. The storage control section 41 outputs a storage section selection signal to the storage section selector 40 as soon as all the signals indicating the end of each process are received. The storage unit selector 40 selects the storage units 30, 31, and 32 from the processing unit 2 according to the storage unit selection signal from the storage control unit 41.
2° Reconnect the output section 24 and input section 20. In this state, if you perform an operation similar to the one described above, contact 11
・\-/ The processing unit 22 processes the record that was written to the storage unit 30 by the input unit 20 before reconnection, and the record that was processed by the processing unit 22 and written to the storage unit 31 before reconnection. The output unit 24 outputs the record to the output line 11,
The input unit 2 is stored in the storage unit 32 in which records that have already been output to the output line 11 and do not need to be stored are stored.
0 writes a new record.

As described above, the input section 20. Each time the processing unit 22 and the output unit 24 complete the operation for one record, that is, each time all the end signals from each control unit 21, 23, and 25 are output, the control signal from the storage control unit 41 The storage unit selector 40 reconnects the storage unit connected to the input unit 20 to the processing unit 22, and
Reconnect the storage unit that was connected to 2 to the output unit 24,
After reconnecting the storage unit that was connected to the output unit 24 to the input unit 20, the input unit 20. Processing unit 22. It is repeated that each output unit 24 performs an operation for one record. In this way, data can be processed one after another.

However, before shifting to this regular operation and after the regular operation ends, a situation occurs in which some of the input section 20, processing section 22, and output section 24 operate, and some do not.

As described above, in this embodiment, the input unit 20, the processing unit 22, and the output unit 24 operate independently and in parallel, and each control unit 21, 23, 25 controls the end of a field and the end of a record. can be detected at high speed, stream data can be processed efficiently, and high-speed processing is achieved.

As described in detail, the present invention inputs, processes, and outputs stream data in record units at high speed independently and synchronously by inputting stream data and control data in synchronization with the stream data. Since the data is processed and output as stream data, the processing is performed in a pipeline manner, making it possible to achieve high-speed string searches.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing the overall configuration of a character string search device in an embodiment of the present invention, and FIG. 2 depicts stream data and attributes of stream data synchronized with the stream data in an embodiment of the present invention. This shows an example of control data. 10...Input line, 11...Output line, 20
... Input section, 21... Input control section, 22... Processing section, 23... Processing control section, 24... Output section, 25.
・・Output control unit, 30° 31, 32 ・・Storage unit, 40
...Storage unit selector, 411. Memory control unit.

Claims (3)

[Claims] (1) An input unit that inputs stream data having a data structure in which one record is a set of one or more fields and control data that expresses attributes of the stream data in synchronization with the stream data as input data. an input control unit that analyzes the control data and controls the input unit based on the analysis result; a processing unit that searches and processes input data record by record based on preset search data; A processing control section that analyzes data and controls the processing section based on the analysis results; an output section that outputs the processing results in record units as stream data; and an output section that analyzes control data accompanying the processing results and uses the analysis results to output the processing results. and an output control section for controlling a character string search device, wherein the input section, processing section, and output section are controlled by the input control section, processing control section, and output control section, respectively, and operate independently. (2) n (n≧3) storage units are provided for storing stream data and control data that synchronizes with the stream data and expresses the attributes of the stream data in record units; 2. The character string search device according to claim 1, wherein the input section, the processing section, and the output section operate independently, each being used for an output section while being switched in turn. (3) The control data that is input in synchronization with the stream data is a collection of data that expresses the delimitation of records within the stream data, the delimitation of fields within the record, the start and stop of the entire stream data, etc. The character string search according to claim 1, wherein each of the control units detects the end of a field, the end of a record, etc. based on this information, and controls the input unit, processing unit, and output unit. Device.