JPH02109165A - Stream data processor - Google Patents

Abstract

PURPOSE:To change a large quantity of data at a high speed by using a device which handles data as a stream and performs continuously the retrieving, computing and changing operations. CONSTITUTION:The retrieving information and a process are designated at a retrieving part 5, and the data for substitution and addition are stored in the storage parts 2-4. Then the stream data to be retrieved are read into a storage device 1 via a bus 9 by an amount equal to the capacity of the device 1. The contents of the device 1 are read into the part 5 and compared with a retrieving character string. The place of the coincident stream data in the device 1 is stored, and the data is outputted after the entire contents of the device 1 are retrieved. In the case of substitution, the contents of the device 1 are outputted to a storage device 7 via a data selector 6 as long as the retrieving character string is not confirmed. Then the contents of the parts 2-4 are outputted to the device 7 via the selector 6 at retrieving in the stored place in accordance with the specific coincident retrieving character string. The character strings which are coincident with the retrieving character string are skipped and outputted. The data stored in the device 7 are successively outputted as the stream data.

Description

DETAILED DESCRIPTION OF THE INVENTION Field of the Invention The present invention relates to an IJ-system data processing device used in database systems and the like that process large amounts of data by changing or adding data.

Conventional technology In the past, when changing a part of a large amount of data while searching, a general-purpose processor was used to read and compare the data by random access, and if there was a match, it was a smart processor. Random access was used to read data to be changed one word at a time and write it to the storage device.

Problems to be Solved by the Invention However, random access by a general-purpose processor takes time to acquire and release a bus, and is inefficient in handling large amounts of data.

The present invention was made to solve one or more problems of the prior art, and an object of the present invention is to provide a device that can change a large amount of data at high speed.

Means for Solving the Problem In order to achieve this object, the present invention provides a device that is equipped with a storage device that stores data for modification in advance, and that continuously searches, calculates, and modifies the data by treating it as a stream. By having this, the above purpose is achieved.

Effect The present invention has the above-mentioned configuration, allows a stream to flow continuously,
When changing data as a result of a search or calculation, interrupt the data to be changed into a stream or delete part of the stream.

An embodiment of the present invention in which data is changed will be described below with reference to the drawings.

The figure is a block diagram of a stream data search device 30 in one embodiment of the present invention. A bus 9 is a bus into which data to be searched is input.

The storage device 1 temporarily stores data input from the bus 9, and outputs the stored data to the search unit 5 via the bus 10 and to the data selector 6 via the bus 1). The bus 8 provides the search unit 5 with search information and processing specifications (addition, replacement, etc.) from the outside, and data used for replacement and addition in the storage device 2.3.4.

The storage devices 2.3 and 4 store data used for changes and additions, and are connected to the search unit 5 by control lines 18, 19, and 20.
controlled by the output from The search unit 5 searches for a search character string manually generated from the bus 8 in advance.

Compare the bus IO from the storage device 1 with the data output by AI, and according to the processing specification input in advance from the bus 8, control lines 17.18°1.9.2
0 controls the output of the storage device 1.2.3.4, and the control line 21 controls the data selector 6. The data selector 6 outputs any of the outputs of the buses 1, 1, 1, 2, 13, and 14 to the storage device 7 through the control line 21 ((accordingly, the bus) 5. The contents of the storage device 7 are sent as a stream to the bus 1.
It is output to the outside through 6.

The operation of the stream data search device configured as above will be explained below. First, search information and processing specifications are provided to the search section 5, and replacement and additional data are provided to the storage sections 2, 3 and 4. here.

The search information is the search string 3 μ below, the replacement or additional data is the string to be output when the search string is found, and the search string and the string to be output are a pair. We are taking measures. In this state, the search target stream data is read into the storage device 1 through the bus 9 in an amount equal to the capacity of the storage device 1. The search unit 5 reads this content, compares it with the search string, and if there is a match, stores the location of that string in the storage device 1. After searching all the contents of [Storage device], output the data. At this time, in the case of replacement, if it is not the search string, the contents of the storage device 1 are output to the storage device 7 through the data selector 6, but if the location stored at the time of search is reached, which of the search string Storage devices 2 and 3 depending on whether there is a match or not.
Or the contents of 4 are sent to the storage device 7 through the data selector 6.
Output to. When the storage devices 2 and 3 have finished outputting, the contents of the storage device 1 are output again, but at this time,
Skip the string that matches the search string and output after that. Once all the contents of the storage device 1 have been output as on μ, -4l new stream data is read through bus 9 and the same operation as on μ is performed.

However, if the last part stored in the storage device 1 matches the search character string halfway, the part where the match begins in the storage device 1 is taken as the beginning of the primary search. By repeating the operations on μ, data is accumulated in the first-in, first-out storage device 7, and stream data is output by sequentially outputting the data to the outside. still.

In the case of addition, the above-described operation is performed by outputting all the contents of the storage device 1 without skipping them.

According to this embodiment, as described above, there are multiple storage devices for storing replacement and additional data, so three character strings can be replaced with other character strings or added by sending a -degree data stream. You can also do an.

Next, a second embodiment of the present invention will be described.

In the figure, two character strings are stored in the storage device 2.3.4, and the search unit 5 has a function of specifying the output of one of the character strings in each storage device. The function of JJO.

In this embodiment, the same operation as in the first embodiment is performed, but when outputting from the storage device 2.3.4, the 17C1 search unit specifies which character string of the storage device to output. do.

According to this embodiment, the storage device can be replaced and added by several microns as described above.

Next, a third embodiment of the present invention will be described.

Assume that the data is structured and has the concept of records, and each record consists of several fields. Record breaks and field breaks are identified by special codes. In this agreement, the storage devices 1, 2, and 3.4 shown in Figure 1 shall have the function of marking the delimiter between records and fields, and of storing the starting position of the field of currently stored data. 17. Search unit 5, storage device 1. , 2.3.4, it is possible to specify the fields to be output.

In this embodiment, the storage device I inputs data in units of records. Search by specifying the field.

You can also do it with If you store a record in the storage device 23.4 in advance, if you want to add data stored in the storage device 2, 3.4V'c after a certain record as a result of a search, the storage device After outputting the data of 1, the data of storage device 2.3 or 4 is output. When replacing a record, the record in storage device 1 is not output, and the record in storage device 1 is replaced from storage device 2, 3, or 4.
Output records. When adding 1 field, add the field to be searched in addition to the search string as search information.

Specify the fields to add. The storage devices 2, 3.4 store several pieces of data in field units, and the search unit 5 uses the matching data as a result of the search to find the number of data that has not been stored in the storage unit 2.3.4. This field specifies whether to use the field as additional data. In this state, if there is a character string that matches the search character string in storage device 1, it is output from storage device 1 with the field change before adding 5, and then it is stored in the pre-specified storage device. One designated field is output, and then the remaining data in the storage device 1 is output again. This operation allows one field to be added. The replacement of one field is almost the same as the addition of one field 7100 described above, but in the field designated for replacement, it is executed by skipping one field of data in the storage device.

In this embodiment, as shown in μ, the storage devices 1, 2, 3
．． 4 can read and output records and fields, so you can replace and add records,
and can replace and add fields.

DETAILED DESCRIPTION OF THE INVENTION As described above, the present invention has a structure that includes a storage device that temporarily stores stream data and a storage device that stores multiple pieces of replacement or addition data. It is easy to insert or delete, and can be easily replaced or added. Furthermore, by providing a storage device with a function to recognize records and fields, it is possible to handle structured data.

[Brief explanation of the drawing]

The figure is a block diagram of a stream data processing device in an embodiment of the present invention. 30...Stream data processing device, 1.2.3
．． 47... Storage device, 5... Search section, 6. Data selector. 8, 9.10. ],,1.12.13.14.1.5
．． 16. Bus. 1.7.18.1.9.20...Control line.

Claims (2)

[Claims] (1) a first storage device that temporarily stores a stream of character data; a plurality of storage devices that store data used to change the contents of the stream; 1. A stream data processing device comprising: means for comparing data with a character string designated in advance; and means for selectively outputting data from one of the plurality of storage devices based on the comparison result of the comparison means. (2) Data stored in multiple storage devices has a data structure in which one record is a set of one or more fields, and is stored in units of one or more fields or records, and any field can be 2. The stream data processing apparatus according to claim 1, wherein the stream data processing apparatus outputs the stream data in the order of .