AU1640501A - FIFO overflow management - Google Patents

Description

S&FRef: 535232

AUSTRALIA

PATENTS ACT 1990 COMPLETE SPECIFICATION FOR A STANDARD PATENT

ORIGINAL

Name and Address of Applicant: Actual Inventor(s): Address for Service: Invention Title: Canon Kabushiki Kaisha 30-2, Shimomaruko 3-chome, Ohta-ku Tokyo 146 Japan Kok Tjoan Lie Spruson Ferguson St Martins Tower,Level 31 Market Street Sydney NSW 2000 FIFO Overflow Management ASSOCIATED PROVISIONAL APPLICATION DETAILS [33] Country [31] Applic. No(s) AU PQ5557 [32] Application Date 11 Feb 2000 The following statement is a full description of this invention, including the best method of performing it known to me/us:cumens received a Documents received on: .2 3 JAl l OHL, Befth N I 5815c -1- FIFO OVERFLOW MANAGEMENT Field of Invention The present invention relates to FIFO apparatus and, in particular, to the use of such apparatus in a pipeline processor arrangement.

Background The performance of individual submodules in a pipeline processor arrangement depends on the incoming command and/or data rate, and the complexity of operation on those commands and/or data that the submodule is required to perform. The time taken by a submodule to execute a command varies according to the complexity of the command and also to the stall direction and frequency of the downstream submodule. In those cases where the rate of execution of commands varies for two neighbouring pipeline submodules, a first-in-first-out register apparatus (FIFO) of a predetermined length is usually inserted between the submodules to absorb some latencies associated with the first (upstream) submodule while the second (downstream) submodule is stalled or busy.

The size of the FIFO is usually a compromise between performance and cost, unfortunately there may never be an optimum size as the stall pattern may greatly vary for the two submodules involved.

Summary of the Invention It is an object of the present invention to substantially overcome, or at least ameliorate one or more deficiencies with existing arrangements.

In accordance with one aspect of the present invention there is disclosed a method of improving the performance of a pipeline system in which a FIFO is incorporated in said pipeline between an upstream processing module and a downstream processing module, each of said modules having access to a common external memory, 25 said method being characterised by: detecting when said FIFO is substantially full and transferring commands from said upstream module to said external memory; and interpreting commands from each of said FIFO and said external memory to said downstream module to determine a source of following ones of said commands.

In accordance with another aspect of the present invention there is disclosed a pipelined processor system comprising: an upstream processor module; a downstream processor module; a FIFO arrangement coupling an output of said upstream module to an input of said downstream module to thus form a processor pipeline; 535232.doc -2a memory module accessible by each of said processor modules; and an overload arrangement by which a filling of said FIFO arrangement is detected and said output of said upstream module is directed for intermediate storage in said memory module and by which said downstream module can interpret commands received from each of said FIFO arrangement and said memory module to determine a source of subsequent commands.

Other aspects of the invention are also disclosed.

Brief Description of the Drawings The prior art and an embodiment of the invention will now be described with reference to the drawings in which: Fig. 1 is a schematic block diagram showing conventional approach of pipelined modules with an interposed FIFO; Fig. 2 is a schematic block diagram representation showing a pipelined system with interposed FIFO according to preferred embodiment of the present invention; and Fig. 3 shows example of the contents of the external memory and FIFO of Fig. 2 including the two special commands.

Detailed Description of Embodiments of the Invention Fig. 1 shows a conventional pipelined system 10 having an upstream submodule 12, a downstream submodule 16, and a FIFO 14 placed between two 00o$ submodules 12 and 16, and interconnected by connections 17, 19. Each of the submodules 22 and 26 have variable latencies to execute or generate commands. The FIFO 14 has a number of internal registers or memories 18, and as a consequence of a traditional operation thereof, the upstream submodule 12 is free to generate commands at j. least until the registers 18 are full, whereupon the submodule 12 will be stalled. With 25 variable latency, it is possible that the downstream submodule 16 is then able to process the commands with minimal latency and consequently drain the contents of the FIFO 14 at a faster rate than the upstream module 12 can generate or supply those contents. In such circumstances, the overall performance of the arrangement is only slightly improved compared to a configuration in which the submodules 12 and 16 are directly coupled, as the downstream submodule 16 will have to wait for the upstream submodule 12 to generate more commands. Further, the performance of the system 10 is very much dependent on the size of the FIFO 14, being the number of registers 18, which is usually chosen as a compromise between performance and cost.

Fig. 2 shows a system 20 according to the preferred embodiment, having upstream and downstream modules 22 and 26 respectively, and a local FIFO 24 535232.doc -3positioned therebetween. Both submodules 22 and 26 also have access to a common external local memory 32, this being a feature of many submodule configurations, particularly where the submodules 22 and 26 are each formed within the same integrated circuit package. The external local memory 32 typically provides for random access localised storage for operations performed individually or collectively by the processor submodules 22 and 26. In this description, reference is made to "commands" being passed between the submodules 22 and 26 and such references are to be interpreted without limitation as including instructions, data, signals or any information that may be passed between the submodules 22and 26 as required or determined by their respective functions.

While the FIFO 24 is not full, the upstream submodule 22 passes commands into the FIFO 24 and the downstream submodule 26 fetches commands from the FIFO 24 as per conventional approach discussed above. When the FIFO 24 becomes full or substantially full, the upstream submodule 22 is not stalled as in the conventional is approach of Fig. 1, but rather is able to continue on generating commands for the downstream submodule 26. However, instead of passing the generated commands into the FIFO 24, the upstream module 22 transfers the commands to the local memory 32.

For optimal performance, transfers to the external memory 32 are performed in "burst mode fashion", known in the art of memory utilization, preferably in groups of 8 ooo.

or 16 commands for a single memory transaction. This operation is repeated for that period during which FIFO 24 remains or is substantially full. To facilitate burst mode transfer, the upstream submodule 22 outputs commands via a connection 50 to a holding buffer 30 which has a capacity of the predetermined burst size. Such an approach reduces any latency associated with access to the local memory 32, which otherwise can be quite 25 severe if only a small number of commands were to handled for each memory access.

The state of the FIFO 24 is communicated to the upstream module 22 by two signals 38 and 46. When the FIFO 24 becomes substantially full, for example with only one or two, or some other predetermined number of locations remain empty, the signal 46 is asserted which causes the upstream submodule 22 to place a first special command into the FIFO 24 via the connection 48. At such time, the submodule 22 immediately commences sending commands to the external memory via the holding buffer 30. The first special command 60 is an instruction "fetch_from_RAM", and is seen in Fig. 3 loaded into the FIFO 24. When received by the downstream submodule 26 via the FIFO 24, the first special command 60 directs the downstream submodule 26 to fetch following commands from the external memory 32, instead of the FIFO 24. The address 535232.doc -4to fetch the commands in the external memory 32 is specified as one of the parameters in the first special command The upstream submodule 22 continues to store commands into the external memory 32 via the holding buffer 30, until such time as the FIFO 24 is made available.

The FIFO 24 also generates the signal 38 identifying to the upstream submodule 22 that there are at least a certain number of free or available locations 28 in the FIFO 24. For example, this may occur when the FIFO 24 is, say, about three-quarters full.

Upon detecting such an "available" condition of the FIFO 24, the upstream submodule 22 writes to the external memory 32 a second special command 62 "fetch_from_FIFO", also seen in Fig. 3, immediately after a "last" command is stored into the external memory 32. The second special command 62 acts as an instruction for the downstream submodule 26 to fetch following commands from the FIFO 24 and continue fetching from the FIFO 24 until another "fetch from RAM" command 60 is encountered.

15 In this fashion, where the FIFO 24 has, say, 24 locations, and the holding buffer 30 has 8 locations, the holding buffer 30 may be loaded with 6 commands followed by one of the second special commands 62 (fetch_from_FIFO) thereby enabling a single burst -mode memory transaction to occur with the memory 32 sufficient to free space •within the FIFO 24 for storing further commands.

With such arrangements, memory space in the FIFO 24 or external memory 32 is not wasted with special commands 60 and 62 interleaving with actual commands.

.ooooi Operation of the downstream submodule 26 is similar to and complements that of the upstream submodule 22. The downstream submodule 26 has two possible sources of receiving commands, one from the FIFO 24, and the other from the external .i 25 memory 32. Again, for optimal performance, a further holding buffer 34 is provided to store commands being fetched via a connection 44 in burst mode fashion from the external memory 32 by the downstream submodule 26.

With reference to Fig. 3, the submodule 26 fetches (ordinary) commands 64 from the FIFO 24 until a "fetch from RAM" command 60 is encountered that indicates that following commands 66 are located in the external memory 32 starting from a given address. The downstream submodule 26 must fetch the commands 66 from the memory 32 and place those command in the holding buffer 34, and at the same time, switch the command source from the FIFO 24 to the holding buffer 34.

Such operation is achieved by a multiplexer 36 positioned between the FIFO 24 and holding buffer 34, and the downstream submodule 26. The multiplexer 36 is 535232.doc controlled by a signal 58 generated by the downstream submodule 26 on receipt of the special command 60. The holding buffer 34 can be maintained full through pre-fetching, which can further reduce any latency associated with access to the external memory 32.

The downstream submodule 26 is then able to continue fetching from the external memory 32 via the holding buffer 34 until the special command 62 "fetch from FIFO" is found, on receipt of which the submodule 26 switches the multiplexer 36 via the signal 58 so that commands are then sourced from the FIFO 24.

With the system 20, the size of the FIFO 24, compared with the prior art FIFO 14, can be reduced to compensate against provision of the holding buffers and 34 that are needed at the output 50 of upstream submodule 22 and input 54 to the downstream submodule 26. Such a reduction in size of the FIFO 24 is considered by the present inventor to have little effect on the overall performance in typical applications as the net effect of the system 20 is a FIFO having a dynamic capacity but which operates without any substantial latency, excepting that imposed by the transfer and handling of Is the special commands described above.

The FIFO system 20 finds application in pipelined processing arrangements which are provided with local memory that is available for use by members of the pipeline. Typically, such memory has a capacity many times larger than memory which ooowould be configured or used by a traditional FIFO. Examples of such arrangements include graphic object rendering hardware in which certain rendering processes are pipelined and operate according to instructions passed along the pipeline or according to data stored in memory, such data being for example generated, modified or used by the pipelined processes. The preferred embodiment comprises an implementation within a synchronous graphic pipelined processor having two or more submodules, each submodule having a different task to perform.

The forgoing describes only one embodiment of the present invention and modifications may be made thereto without departing from the scope of the present invention.

In the context of this specification, the word "comprising" means "including principally but not necessarily solely" or "having" or "including" and not "consisting only of'. Variations of the word comprising, such as "comprise" and "comprises" have corresponding meanings.

535232.doc

Claims (6)

1. A method of improving the performance of a pipeline system in which a FIFO is incorporated in said pipeline between an upstream processing module and a downstream processing module, each of said modules having access to a common external memory, said method being characterised by: detecting when said FIFO is substantially full and transferring commands from said upstream module to said external memory; and interpreting commands from each of said FIFO and said external memory to said downstream module to determine a source of following ones of said commands.

2. A method according to claim 1, wherein said interpreting is performed by said downstream module. ee

3. A method according to claim 1 wherein, on detecting said FIFO as being substantially full, said upstream module outputs a first special command to said FIFO indicating that following commands are to be sourced from said external memory, wherein upon receipt of said first special command from said FIFO, said downstream ee.module sources said following commands from said external memory.

4. A method according to claim 1, further comprising detecting when said FIFO has a predetermined number of vacant locations and, when so, instructing said upstream module to cease transferring commands to said external memory, a terminal one of said transferred commands being a second special command which, when received by said 25 downstream module from said external memory, causes said downstream module to source said following commands from said FIFO. A method according to claim 1, wherein transfer of commands to and from said external memory occurs in burst mode comprising a predetermined data transfer size, said method comprising the further steps of buffering commands output from said upstream module to said external memory, and from said external memory to said downstream module, to facilitate burst mode transfers.

6. A pipelined processor system comprising: an upstream processor module;

535232.doc a downstream processor module; a FIFO arrangement coupling an output of said upstream module to an input of said downstream module to thus form a processor pipeline; a memory module accessible by each of said processor modules; and an overload arrangement by which a filling of said FIFO arrangement is detected and said output of said upstream module is directed for intermediate storage in said memory module and by which said downstream module can interpret commands received from each of said FIFO arrangement and said memory module to determine a source of subsequent commands. 7. A system according to claim 6, wherein said overload arrangement comprises a switching device for selectively coupling an output of one of said FIFO arrangement and said memory module to an input of said downstream module. 15 8. A system according to claim 7, wherein said switching device is controlled by said downstream module as a consequence of interpreting a special command received from either one of said FIFO arrangement or said external memory. 9. A system according to claim 8, wherein said special command is generated by an ooo° S ee 20 upstream module in response to a state of said FIFO arrangement, said special command being output either to said FIFO arrangement when said FIFO arrangement is S substantially full, or to said memory module when said FIFO arrangement has a predetermined number of available locations. S. .o 25 10. A system according to claim 6, further comprising a holding buffer interconnecting each of said processor modules to said memory module, each of said holding buffers facilitating burst mode memory transfers with said memory module. 11. A system according to claim 6, wherein said system is formed within a single integrated circuit. 12. A pipeline processor system substantially as described herein with reference to Figs. 2 and 3 of the drawings. 535232.doc -8- 13. A pipeline processing method substantially as described herein with reference to Figs. 2 and 3 of the drawings. Dated this SEVENTEENTH day of JANUARY 2001 CANON KABUSHIKI KAISHA Patent Attorneys for the Applicant SPRUSON&FERGUSOIN 0 000 *006 0 .0. G 00 535232.doc