JPH04225430A - Buffering system for stream type language - Google Patents

Abstract

PURPOSE:To attain the effective communication between the processes in the parallel processing state of a stream type language in a buffering system of the language where the data given from a process are read by another process by providing a data division type, setting the data division type to the data type of a list when plural data are divided, and reading collectively the hitherto data through a process. CONSTITUTION:A data division type is set at a CAR part which forms a list together with a CDR part, and a write process writes the data type and the data into the CAR part of the list to successively link the corresponding lists with each other and also points a read process through the CDR part of the last list. Then the pointed read process reads the data collectively out of the CDR part only when the data division type is set at the CAR part of the list.

Description

[Detailed description of the invention]

0001

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a buffering method in a stream language in which data from one process is read by another process. With the spread of parallel computers, there is a desire to efficiently implement languages that run on parallel computers. A typical example of such a language is a stream language in which multiple processes perform processing in parallel while exchanging data with each other via a list (stream). It is desired to efficiently exchange data using this stream type language.

0002

2. Description of the Related Art Conventionally, there are two processes p(x) and c(x), and as shown in FIG. c(x) reads this and processes it. At this time, if the data from process p(x) has not yet been written to the CAR part of the list, that is, the CAR part is UNDEF (undefined), then process c(x)
The process of is interrupted here, and as shown in FIG. 2(b), process c(x) is pointed to from this UNDEF in the list. Then, when process p(x) writes data, process c(x) reads and processes this data. When data comes all over the place like this,
The process c(x) was repeatedly interrupted and restarted each time.

0003

[Problem to be Solved by the Invention] As mentioned above, the process c(x) for reading data has to be repeatedly interrupted and restarted each time the data arrives intermittently, resulting in a very poor overall processing efficiency. There was a problem that it became. The present invention provides a data delimiter type, sets this data delimiter type to the data type of the list when delimiting multiple data, and the process reads all the data up to this point. Its purpose is to enable efficient communication between processes.

0004

[Means for Solving the Problems] FIG. 1 shows a diagram of the principle configuration of the present invention. In FIG. 1, List 1 is a CAR part that sets the data type and data, and a CDR part that sets a pointer to the process that links and reads the next List 1.
It consists of two parts.

[0005] Data delimiter type 2 gives an instruction to the reading process to read data all at once.

[0006]

[Operation] As shown in FIG. 1, the present invention provides a data delimiter type 2 that reads data all at once as a data type, and allows the writing process to write the data type and data to the CAR section of list 1 and link them sequentially. At the same time as repeating, point the reading process from the CDR part of list 1 at the end, and only if data delimiter type 2 is set in the CAR part of list 1, the reading process pointed from the CDR part will be the CAR part. I am trying to read all the data written in .

Therefore, when delimiting multiple pieces of data, a process that sets data delimiter type 2 in list 1 and reads data up to this data delimiter type all at once reads the data, so that the process during parallel processing of the stream type language It becomes possible to perform efficient communication between the two.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, the configuration and operation of an embodiment of the present invention will be explained in detail with reference to FIG. In FIG. 1, list 1 is composed of a CAR section and a CDR section, and is used here to exchange data between processes. C
The AR part contains the data type (for example, INT: integer type),
A data delimiter type representing data delimiters according to this embodiment,
and write data. In the CDR section, the following list 1
It writes an address that links to a file, or writes an address that points to a process that reads it.

[0009] Data delimiter type 2 is for the reading process pointed from the CDR part of list 1.
This gives an instruction to read the data written in the CAR section of the linked list 1. Process P is a process that writes data to list 1. Process C is a process that reads data from list 1.

Next, the operation will be explained. (a) in Figure 1 is
This shows a state in which the writing process P has written data “1”. This means that the writing process P is the CAR in list 1.
In the section, data type “INT (integer type)” and data “1” are added.
” as shown in the figure, and write UNDE in the CDR section.
F (undefined) and stores the address pointing to the reading process C. In this embodiment, reading is not performed unless data delimiter type 2 is written to the CDR section.

FIG. 1B shows a state in which the writing process P has written data "2". This means that the writing process P writes the data type “INT” into the CAR section of List 1.
(Integer type)" and data "2" are written as shown in the figure, and UNDEF (undefined) and an address pointing to the reading process C are stored in the CDR section. Similarly, when the writing process P writes the data "3" Not “
10” in sequentially linked list 1.

FIG. 1C shows a state in which the writing process P has written the data delimited type. This means that the writing process P writes "data delimited type" to the data type of the CAR section of List 1, and instructs the reading process to read all the data written to the CAR section of List 1 all at once. In response to this writing of data delimiter type 2, the reading process C reads data from the CAR parts of all linked lists 1 at once and processes it.

As described above, the writing process P sequentially writes data to the CAR section of list 1, and
When "data delimited type" is written as the data type of the part, the reading process C reads and processes all the data written in the CAR part of List 1 at once, so that the conventional reading process C can process it. There is no need to interrupt, restart, or repeat the process, and it becomes possible to efficiently communicate between the writing process P and the reading process C.

[0014]

[Effects of the Invention] As explained above, according to the present invention,
The process that writes data when dividing multiple data sets data delimiter type 2 in list 1, and the process that reads data up to this data delimiter type reads them all at once, so the conventional reading process processing This eliminates the need for repeated interruptions and restarts, and data can be read in batches for each data break, allowing for efficient communication between processes. This makes it possible to efficiently communicate between processes during parallel processing of stream-based languages and improve the processing speed of the entire system.

[Brief explanation of the drawing]

FIG. 1 is a configuration diagram of one embodiment of the present invention.

FIG. 2 is an explanatory diagram of a prior art.

[Explanation of symbols]

1: List 2: Data delimited type

Claims (1)

[Claims] 1. In a buffering method in a stream type language in which data from a process is read by another process, a data delimited type is provided as a data type to be set in a CAR part of a CAR part and a CDR part that constitute a list, The writing process writes the data type and data to the CAR part of the list and sequentially links the list, and the reading process writes the data type and data to the CAR part of the list, and the reading process writes the data type and data to the CAR part of the list.
The stream is characterized in that the reading process pointed to by the CDR part reads data in bulk only when the DR part is pointed to and the data delimiter type is set in the CAR part of the list. Buffering methods in typed languages.