WO2006044978A2 - Looping instructions for a single instruction, multiple data execution engine - Google Patents

Looping instructions for a single instruction, multiple data execution engine Download PDF

Info

Publication number
WO2006044978A2
WO2006044978A2 PCT/US2005/037625 US2005037625W WO2006044978A2 WO 2006044978 A2 WO2006044978 A2 WO 2006044978A2 US 2005037625 W US2005037625 W US 2005037625W WO 2006044978 A2 WO2006044978 A2 WO 2006044978A2
Authority
WO
WIPO (PCT)
Prior art keywords
loop
instruction
mask register
information
channel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2005/037625
Other languages
French (fr)
Other versions
WO2006044978A3 (en
Inventor
Michael Dwyer
Hong Jiang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intel Corp
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Priority to GB0705909A priority Critical patent/GB2433146B/en
Priority to CN2005800331592A priority patent/CN101048731B/en
Publication of WO2006044978A2 publication Critical patent/WO2006044978A2/en
Publication of WO2006044978A3 publication Critical patent/WO2006044978A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/32Address formation of the next instruction, e.g. by incrementing the instruction counter
    • G06F9/322Address formation of the next instruction, e.g. by incrementing the instruction counter for non-sequential address
    • G06F9/325Address formation of the next instruction, e.g. by incrementing the instruction counter for non-sequential address for loops, e.g. loop detection or loop counter
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/30003Arrangements for executing specific machine instructions
    • G06F9/3005Arrangements for executing specific machine instructions to perform operations for flow control
    • G06F9/30058Conditional branch instructions
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3885Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3885Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units
    • G06F9/3887Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units controlled by a single instruction for multiple data lanes [SIMD]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3885Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units
    • G06F9/3887Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units controlled by a single instruction for multiple data lanes [SIMD]
    • G06F9/38873Iterative single instructions for multiple data lanes [SIMD]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00Digital computers in general; Data processing equipment in general
    • G06F15/76Architectures of general purpose stored program computers
    • G06F15/80Architectures of general purpose stored program computers comprising an array of processing units with common control, e.g. single instruction multiple data processors

Definitions

  • an instruction may be simultaneously executed for multiple operands of data in a single instruction period.
  • Such an instruction may be referred to as a Single Instruction, Multiple Data (SIMD) instruction.
  • SIMD Single Instruction, Multiple Data
  • an eight-channel SIMD execution engine might simultaneously execute an instruction for eight 32-bit operands of data, each operand being mapped to a unique compute channel of the SIMD execution engine.
  • an instruction may be a "loop" instruction such that an associated set of instructions may need to be executed multiple times (e.g., a particular number of times or until a condition is satisfied).
  • FIGS. 1 and 2 illustrate processing systems.
  • FIG. 3 illustrates a SEVID execution engine according to some embodiments.
  • FIGS. 4-5 illustrate a SIMD execution engine executing a DO instruction according to some embodiments.
  • FIGS. 6-8 illustrate a SIMD execution engine executing a REPEAT instruction according to some embodiments.
  • FIG. 9 illustrates a SIMD execution engine executing a BREAK instruction according to some embodiments.
  • FIG. 10 is a flow chart of a method according to some embodiments.
  • FIGS. 11-14 illustrate a SIMD execution engine executing nested loop instructions according to some embodiments.
  • FIG. 15 illustrates a SIMD execution engine able to execute both loop and conditional instructions according to some embodiments.
  • FIG. 16 is a flow chart of a method according to some embodiments.
  • FIGS. 17-18 illustrate an example of a SIMD execution engine according to one embodiment.
  • FIG. 19 is a block diagram of a system according to some embodiments.
  • FIG. 20 illustrates a SIMD execution engine executing a CONTINUE instruction according to some embodiments.
  • FIG. 21 is a flow chart of a method of processing a CONTINUE instruction according to some embodiments.
  • processing system may refer to any device that processes data.
  • a processing system may, for example, be associated with a graphics engine that processes graphics data and/or other types of media information.
  • the performance of a processing system may be improved with the use of a SIMD execution engine.
  • SIMD execution engine For example, a SEVID execution engine might simultaneously execute a single floating point SBVID instruction for multiple channels of data (e.g., to accelerate the transformation and/or rendering three-dimensional geometric shapes).
  • Other examples of processing systems include a Central Processing Unit (CPU) and a Digital Signal Processor (DSP).
  • CPU Central Processing Unit
  • DSP Digital Signal Processor
  • FIG. 1 illustrates one type of processing system 100 that includes a SEVID execution engine 110.
  • the execution engine 110 receives an instruction (e.g., from an instruction memory unit) along with a four-component data vector (e.g., vector components X, Y, Z, and W, each having bits, laid out for processing on corresponding channels 0 through 3 of the SEvID execution engine 110).
  • the engine 110 may then simultaneously execute the instruction for all of the components in the vector.
  • Such an approach is called a "horizontal,” “channel-parallel,” or “array of structures" implementation.
  • FIG. 2 illustrates another type of processing system 200 that includes a SIMD execution engine 210.
  • the execution engine 210 receives an instruction along with four operands of data, where each operand is associated with a different vector ⁇ e.g., the four X components from vectors 0 through 3).
  • the engine 210 may then simultaneously execute the instruction for all of the operands in a single instruction period.
  • Such an approach is called a "vertical,” “channel-serial,” or "structure of arrays” implementation.
  • an SBvID instruction may be a "loop" instruction that indicates that a set of associated instructions should be executed, for example, a particular number of times or until a particular condition is satisfied.
  • the sequence of instruction will be executed as long as the "condition is true.”
  • the condition might be defined such that the sequence of instructions should be executed as long as Varl is not zero (and the sequence of instructions might manipulate Varl as appropriate).
  • Varl might be zero for one channel and non-zero for another channel.
  • FIG. 3 illustrates a four-channel SEvID execution engine 300 according to some embodiments.
  • the engine 300 includes a four-bit loop mask register 310 in which eacli bit is associated with a corresponding compute channel.
  • the loop mask register 310 might comprise, for example, a hardware register in the engine 300.
  • the engine 300 may also include a four-bit wide loop "stack" 320.
  • the term "stack” may refer to any mechanism to store and reconstruct previous mask values.
  • One example of a stack is would be a bit-per-channel stack mechanism.
  • the loop stack 320 might comprise, for example, series of hardware registers, memory locations, and/or a combination of hardware registers and memory locations.
  • the engine 30O, the conditional mask register 310, and the conditional stack 320 illustrated in FIG. 3 are four channels wide, note that implementations may be other numbers of channels wide (e.g., x channels wide), and each compute channel may be capable of processing a y-bit operand, so long as there is a 1 : 1 correspondence between the compute channel, mask channel, and loop stack channel.
  • the engine 300 may receive and simultaneously execute instructions for four different channels of data (e.g., associated, with four compute channels). Note that in some cases, fewer than four channels may be needed (e.g., when there are less than four valid operands). As a result, the loop mask register 310 may be initialized with an initialization vector indicating which channels have valid operands and which do not (e.g., operands io through i 3 , with a "1" indicating that the associated channel is currently enabled).
  • the loop mask vector 310 may then be used to avoid unnecessary processing (e.g., an instruction might be executed only for those operands in the loop mask register 310 that are set to " 1 ") ⁇
  • the loop mask register 310 is simply initialized to all ones (e.g., it is assumed that all channels are always enabled).
  • information in the loop mask register 310 might be combined with information in other registers (e.g., via a Boolean AND operation) and the result may be stored in an overall execution mask register (which may then used to avoid unnecessary or inappropriate processing).
  • FIGS. 4-5 illustrate a four-channel S IMD execution engine 400 executing a DO instruction according to some embodiments.
  • the engine 400 includes a loop mask register 410 and a loop stack 420.
  • the loop stack 420 is m- entries deep. Note that, for example, in the case of a ten-entry deep stack, the first four entries in the stack 420 might be hardware registers while the remaining six entries are stored in memory.
  • the engine 400 When the engine 400 receives a loop instruction (e.g., a DO instruction), as illustrated in FIG. 4, the data in the loop mask register 410 is copied to the top of the loop stack 420. Moreover, loop information is stored into the loop mask register 410. The loop information might initially indicate, for example, which of the four channels were active when the DO instruction was first encountered (e.g., operands do through d 3 , with a "1 " indicating that the associated channel is active).
  • a loop instruction e.g., a DO instruction
  • the data in the loop mask register 410 is copied to the top of the loop stack 420.
  • loop information is stored into the loop mask register 410.
  • the loop information might initially indicate, for example, which of the four channels were active when the DO instruction was first encountered (e.g., operands do through d 3 , with a "1 " indicating that the associated channel is active).
  • the set of instructions associated with the DO loop are then executed for each channel in accordance with the loop mask register 410. For example, if the loop mask: register 410 was "1110," the instructions in the loop would be executed for the data associated with the three most significant operands but not the least significant operand (e.g., because that channel is not currently enabled).
  • a condition is evaluated for the active channels and the results are stored back into the loop mask register 410 (e.g., by a Boolean AND operation). For example, if the loop mask register 410 was "1110" before the WHILE statement was encountered the condition might be evaluated for the data associated with the three most significant operands. The result is then stored in the loop mask register 410.
  • the set of loop instructions are executed again for all channels that have a loop mask register value of " 1."
  • " 1100” may be stored in the loop mask register 410.
  • the engine 400 will do so only for the data associated with the two most significant operands. In this case, unnecessary and/or inappropriate processing for the loop may be avoided. Note that no Boolean AND operation might be needed if the update is limited to only active channels.
  • the loop is complete.
  • the information from the top of the loop stack 420 e.g., the initialization vector
  • the loop mask register 410 is returned to the loop mask register 410, and subsequent instructions may be executed. That is, the data at the top of the loop stack 420 may be transferred back into the loop mask register 410 to restore the contents that indicate which channels contained valid data prior to entering the loop. Further instructions may then be executed for data associated with channels that are enabled.
  • the SEVID engine 400 may efficiently process a loop instruction.
  • FIGS. 6-8 illustrate a SEVID execution engine 600 executing a REPEAT instruction according to some embodiments.
  • the engine 600 includes a four-bit loop mask register 610 and a four-bit wide, m-entry deep loop stack 620.
  • the engine 600 further includes a set of counters 630 (e.g., a series of hardware registers, memory locations, and/or a combination of hardware registers and memory locations).
  • the loop mask register 610 may be initialized with, for example, an initialization vector io through i 6 , with a " 1 " indicating that the associated channel has valid operands.
  • the value ⁇ integer> may be stored in the counters 630.
  • the REPEAT instruction is then encountered, as illustrated in FIG. 7, the data in the loop mask register 610 is copied to the top of the loop stack 620.
  • loop information is stored into the loop mask register 610. The loop information might initially indicate, for example, which of the four channels were active when the REPEAT instruction was first encountered (e.g., operands ro through r 6 , with a "1" indicating that the associated channel is active).
  • the set of instructions associated with the REPEAT loop are then executed for each channel in accordance with the loop mask register 610. For example, if the loop mask register 610 was "1000," the instructions in the loop would be executed only for the data associated with the most significant operands.
  • each counter 630 associated with an active channel is decremented. According to some embodiments, if any counter 630 has reached zero, the associated bit in the loop mask register 610 is set to zero. If at least one of the bits in the loop mask register 610 and/or a counter 630 is still "1," the REPEAT block is executed again.
  • the REPEAT loop is complete. Such a condition is illustrated in FIG. 8.
  • the information from the loop stack 620 e.g., the initialization vector
  • the loop mask register 610 is returned to the loop mask register 610, and subsequent instructions may be executed.
  • FIG. 9 illustrates the SIMD execution engine 600 executing a BREAK instruction according to some embodiments.
  • the BREAK instruction is within a REPEAT loop and will be executed on if X is greater than Y. In this example. X is greater than Y for second most significant channel and not greater than Y for the other channels. In this case, the corresponding bit in the loop mask vector is set to "0.” If all of the bits in the loop mask vector 610 are "0," the REPEAT loop may be terminated (and the top of the loop stack 620 may be returned to the loop mask register 410). Note that more than one BREAK instruction might exist in a loop. Consider, for example, the following instructions:
  • the BREAK instruction might be executed if either condition 1 or 2 is satisfied.
  • FIG. 10 is a flow chart of a method according to some embodiments.
  • the flow charts described herein do not necessarily imply a fixed order to the actions, and embodiments may be performed in any order that is practicable.
  • any of the methods described herein may be performed by hardware, software (including microcode), firmware, or any combination of these approaches.
  • a storage medium may store thereon instructions that when executed by a machine result in performance according to any of the embodiments described herein.
  • a loop instruction is received. For example, a DO or REPEAT instruction might be encountered by a SIMD execution engine.
  • the data in a loop mask register is then transferred to the top of a loop stack at 1004 and loop information is stored in the loop mask register 1006. For example, an indication of which channels currently have valid operands might be stored in the loop mask register.
  • instructions associated with the loop instructions are executed in accordance with information in the loop mask register until the loop is complete. For example, a block of instructions associated with a DO loop or a REPEAT loop may be executed until all of the bits in the loop mask register are "0.” When the loop is finished executing, the information at the top of the loop stack may then be moved back to the loop mask register at 1010.
  • a loop stack might be one entry deep.
  • a SBVID engine might be able to handle nested loop instructions (e.g., when a second loop block is "nested" inside of a first loop block).
  • the first and third subsets of instructions should be executed for the appropriate channels while the first condition is true, and the second subset of instructions should only be executed while both the first and second conditions are true.
  • FIGS. 11-14 illustrate a SIMD execution engine 1100 that includes a loop mask register 1110 (e.g., initialized with an initialization vector) and a multi-entry deep loop stack 1120.
  • a loop mask register 1110 e.g., initialized with an initialization vector
  • a multi-entry deep loop stack 1120 the information in loop mask register 1110 is copied to the top of the stack 1120 (i 0 through i 3 ), and first loop information is stored into the loop mask register 1110 (dio through d 13 ) when the first DO instruction is encountered.
  • the engine 1100 may then execute the loop block associated with the first loop instruction for multiple operands of data as indicated by the information in the loop mask register 1110.
  • FIG. 13 illustrates the execution of another, nested loop instruction (e.g., a second DO statement) according to some embodiments.
  • the information currently in the loop mask register 1110 (d 10 through d 13 ) is copied to the top of the stack 1120.
  • the information that was previously at the top of the stack 1120 (e.g. , initialization vector io through i 3 ) has been pushed down by one entry.
  • the engine 11OO also stores second loop information into the loop mask register (d 20 through d 23 ).
  • the loop block associated with the second loop instruction may then be executed as indicated by the information in the loop mask register 1110 (e.g., and, each time the second block is executed the loop mask register 1110 may be updated based on the condition associated with the second loop's WHILE instruction).
  • the second loop's WHILE instruction eventually results in every bit of the loop mask register 1110 being "0," as illustrated in FIG. 14, the data at the top of the loop stack 1120 (e. g., dm through d 13 ) may be moved back into the loop mask register 1110. Further instructions may then be executed in accordance with the loop mask register 1120.
  • the first loop block completes (not illustrated in FIG.
  • the initialization vector would be transferred back into the loop mask register 1110 and further instructions may be executed, for data associated with enabled channels.
  • the depth of the loop stack 1120 may be associated with the number of levels of loop instruction nesting that are supported by the engine 1 100. According to some embodiments, the loop stack 1120 is only be a single entry deep (e.g., the stack might actually be an n-operand wide register). Also note that a "0" bit in the loop mask register 1110 might indicate a number of different things, such as: (i) the associated channel is not being used, (ii) an associated WHILE condition for the present loop is not satisfied, or (iii) an associated condition of a higher-higher level loop is not satisfied.
  • an SIMD engine may also support "conditional" instructions.
  • "conditional" instructions For example, the following set of instructions:
  • the subset of instructions will be executed when the condition is "true.” As with loop instructions, however, when a conditional instruction is simultaneously executed for multiple channels of data different channels may produce different results. That is, the subset of instructions may need to be executed for some channels but not others.
  • FIG. 15 illustrates a four-channel SIMD execution engine 1500 according to some embodiments.
  • the engine 1500 includes a loop mask register 1510 and a loop stack 1520 according to any of the embodiments described herein.
  • the engine 1500 includes a four-bit conditional mask register 1530 in which each bit is associated with a corresponding compute channel.
  • the conditional mask register 1530 might comprise, for example, a hardware register in the engine 1500.
  • the engine 1500 may also include a four-bit wide, m-entry deep conditional stack 1540.
  • the conditional stack 1540 might comprise, for example, series of hardware registers, memory locations, and/or a combination of hardware registers and memory locations (e.g., in the case of a ten entry deep stack, the first four entries in the stack 1540 might be hardware registers while the remaining six entries are stored in memory).
  • conditional instructions may be similar to those of loop instructions.
  • a conditional instruction e.g., an "IF" statement
  • the data in the conditional mask register 1530 may be copied to the top of the conditional stack 1540.
  • instructions may be executed for each of the four operands in accordance with the information in the conditional mask register 1530. For example, if the initialization vector was "1110," the condition associated with an IF statement would be evaluated for the data associated with the three most significant operands but not the least significant operand (e.g., because that channel is not currently enabled). The result may then stored in the conditional mask register 1530 and used to avoid unnecessary and/or inappropriate processing for the statements associated with the IF statement.
  • condition associated with the IF statement resulted in a " 110x” result (where x was not evaluated because the channel was not enabled)
  • "1100" may be stored in the conditional mask register 1530.
  • the engine 1500 will do so only for the data associated with the two most significant operand.
  • the engine 1500 When the engine 1500 receives an indication that the end of instructions associated with a conditional instruction has been reached [e.g., and "ENTD IF" statement), the data at the top of the conditional stack 1540 (e.g., the initialization vector) may be transferred back into the conditional mask register 1530 restoring the contents that indicate which channels contained valid data prior to entering the condition block. Further instructions may then be executed for data associated with channels that are enabled. As a result, the SIMD engine 1500 may efficiently process a conditional instruction.
  • the data at the top of the conditional stack 1540 e.g., the initialization vector
  • Further instructions may then be executed for data associated with channels that are enabled.
  • the SIMD engine 1500 may efficiently process a conditional instruction.
  • instructions are executed in accordance with both the loop mask register 1510 and the conditional mask register 1530.
  • FIG. 16 is an example of a method according to such an embodiment.
  • the engine 1500 retrieves the next SEVID instruction. If the bit in the loop mask register 1510 for a particular channel is "0" at 1604, the instruction is not executed for that channel at 1606. If the bit in the conditional mask register 1530 for the channel is "0" It 1608, the instruction is also not executed for that channel. Only if the bits in both the loop mask register 1510 and conditional mask register 1530 are "1" will the instruction be executed at 1610. In this way, the engine 1500 may efficiently execute both loop and conditional instructions.
  • conditional instructions may be nested, within loop instructions and/or loop instructions may be nested within conditional instructions.
  • a BREAK might occur from within n-levels of nested branches .
  • the conditional stack 1540 may be "unwound" by, for example, popping the conditional mask vector ⁇ count> times to restore it to the state prior to loop entry.
  • the ⁇ count> might be tracked, for example, by having a compiler track the relative nesting level of conditional instructions between the loop instruction and the BREAK instruction.
  • FIG. 17 illustrates an SIMD engine 1700 with a sixteen-bit loop mask register 1710 (each bit being associated to one of sixteen corresponding compute channels) and a sixteen-bit wide, m-entry deep loop stack 1720.
  • the engine 1700 may receive and simultaneously execute instructions for sixteen different channels of data (e.g., associated with sixteen compute channels). Because fewer than sixteen channels might be needed, however, the loop mask register is initialed with an initialization vector io through i ⁇ , with a " 1 " indicating that the associated channel is enabled.
  • the engine 1700 when the engine 1700 receives a DO instruction, the data in the loop mask register 1710 is copied to the top of the loop stack 1720. Moreover, DO information do through d 15 is stored into the loop mask register 1710. The DO information might indicate, for example, which of the sixteen channels were active when the DO instruction was encountered.
  • the second set of instructions is then executed for each channel in accordance with the loop mask register 1710.
  • the engine 1700 examines a ⁇ flag> for each of the active channel.
  • the ⁇ flag> might have been set, for example, by one of the second set of instructions (e.g., immediately prior to the WHILE instruction). If no ⁇ flag> is true for any channel, the DO loop is complete. In this case, the initialization vector io through i 15 may be returned to the loop mask register 1710 and the third set of instructions may be executed.
  • the loop mask register 1710 may be updated as appropriate, and the engine 1700 may jump to an ⁇ address> defined by the WHILE instruction (e.g., pointing to the beginning of the second set of instructions).
  • FIG. 19 is a block diagram of a system 1900 according to some embodiments.
  • the system 1900 might be associated with, for example, a media processor adapted to record and/or display digital television signals.
  • the system 1900 includes a graphics engine 1910 that has an n-operand SIMD execution engine 1920 in accordance with any of the embodiments described herein.
  • the SIMD execution engine 1920 might have an n-operand loop mask vector and an n-operand wide, m-entry deep loop stack in accordance with any of the embodiments described herein.
  • the system 1900 may also include an instruction memory unit 1930 to store SIMD instructions and a graphics memory unit 1940 to store graphics data (e.g., vectors associated with a three-dimensional image).
  • the instruction memory unit 1930 and the graphics memory unit 1940 may comprise, for example, Random Access Memory (RAM) units.
  • RAM Random Access Memory
  • any embodiment might be associated with only a single loop stack (e.g., and the current mask information might be associated with the top entry in the stack).
  • FIG. 20 illustrates a SEVID execution engine 2000 executing a CONTINUE instruction according to some embodiments.
  • the CONTINUE instruction is within a REPEAT loop that will be executed ⁇ integer> times. If, however, the ⁇ condition> is true during a particular pass through the loop, that pass will halt and the next pass will begin. For example, if the REPEAT loop was to be executed ten times, and the ⁇ condition> was true when the loop was executed for the fifth time, the instructions after the CONTINUE would not be executed and the loop would be begin execution of the sixth pass through the loop. Note that a BREAK ⁇ condition> instruction, on the other hand, would end the execution of the loop completely.
  • a "loop mask” as described herein two unique masks might be maintained: (i) a "loop mask” as described herein and (ii) a "continue mask.”
  • the continue mask might, for example, be similar to the loop mask but instead records which execution channels have failed the condition associated with the CONTINUE instruction within a loop. If a channel is "0" (that is, has failed a CONTINUE condition), the execution on that channel may be prevented for the remainder of the that pass through the loop.
  • FIG. 21 One method of executing such a CONTINUE instruction is illustrated in FIG. 21.
  • the execution mask is loaded into the loop mask (e.g., indicating which channels are enabled).
  • the continue mask is initialized with the value of the loop mask prior to execution of the first instruction of the loop.
  • a determination is made as to which channels are enabled when loop instructions are executed. For example, execution might only be enabled only when the associated bit in both the loop mask and the continue mask equal one.
  • a CONTINUE instruction is encountered.
  • a condition associated with the CONTINUE instruction might be evaluated and the continue mask updated as appropriate. Thus, further instructions will not be executed during this pass through the loop for channels that encountered a CONTINUE instruction.
  • the loop's WHILE instruction When the loop's WHILE instruction is encountered at 2110, the associated condition is evaluated. If the WHILE instruction's condition is satisfied for any channel (regardless of the channel's bit in the continue mask), the continue mask is again initialized with the loop mask and the process continues at 2104. If the WHILE instruction's condition is not satisfied for every channel, the loop is complete at 2112 and the loop mask is restored from the stack. If a loop is nested, the continue mask may be saved to a continue stack. When the interior loop completes execution, both the loop and continue masks may be restored. According to some embodiments, separate stacks are maintained for the loop mask and the continue mask. According to other embodiments, the loop mask and the continue mask may be are stored in a single stack.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Executing Machine-Instructions (AREA)
  • Advance Control (AREA)
  • Complex Calculations (AREA)

Abstract

According to some embodiments, looping instructions are provided for a Single Instruction. Multiple Data (SIMD) execution engine. For example, when a first loop instruction is received at an execution engine information in an n-bit loop mask register may be copied to an n-bit wide, m-entry deep loop stack.

Description

LOOPING INSTRUCTIONS FOR A SINGLE INSTRUCTION, MULTIPLE DATA
EXECUTION ENGINE
BACKGROUND
To improve the performance of a processing system, an instruction may be simultaneously executed for multiple operands of data in a single instruction period. Such an instruction may be referred to as a Single Instruction, Multiple Data (SIMD) instruction. For example, an eight-channel SIMD execution engine might simultaneously execute an instruction for eight 32-bit operands of data, each operand being mapped to a unique compute channel of the SIMD execution engine. In the case of a non-SIMD processor, an instruction may be a "loop" instruction such that an associated set of instructions may need to be executed multiple times (e.g., a particular number of times or until a condition is satisfied).
BRIEF DESCRPTION OF THE DRAWINGS
FIGS. 1 and 2 illustrate processing systems.
FIG. 3 illustrates a SEVID execution engine according to some embodiments.
FIGS. 4-5 illustrate a SIMD execution engine executing a DO instruction according to some embodiments.
FIGS. 6-8 illustrate a SIMD execution engine executing a REPEAT instruction according to some embodiments.
FIG. 9 illustrates a SIMD execution engine executing a BREAK instruction according to some embodiments.
FIG. 10 is a flow chart of a method according to some embodiments.
FIGS. 11-14 illustrate a SIMD execution engine executing nested loop instructions according to some embodiments.
FIG. 15 illustrates a SIMD execution engine able to execute both loop and conditional instructions according to some embodiments.
FIG. 16 is a flow chart of a method according to some embodiments. i FIGS. 17-18 illustrate an example of a SIMD execution engine according to one embodiment.
FIG. 19 is a block diagram of a system according to some embodiments.
FIG. 20 illustrates a SIMD execution engine executing a CONTINUE instruction according to some embodiments.
FIG. 21 is a flow chart of a method of processing a CONTINUE instruction according to some embodiments.
DETAILED DESCRIPTION
Some embodiments described herein are associated with a "processing system." As used herein, the phrase "processing system" may refer to any device that processes data. A processing system may, for example, be associated with a graphics engine that processes graphics data and/or other types of media information. In some cases, the performance of a processing system may be improved with the use of a SIMD execution engine. For example, a SEVID execution engine might simultaneously execute a single floating point SBVID instruction for multiple channels of data (e.g., to accelerate the transformation and/or rendering three-dimensional geometric shapes). Other examples of processing systems include a Central Processing Unit (CPU) and a Digital Signal Processor (DSP).
FIG. 1 illustrates one type of processing system 100 that includes a SEVID execution engine 110. In this case, the execution engine 110 receives an instruction (e.g., from an instruction memory unit) along with a four-component data vector (e.g., vector components X, Y, Z, and W, each having bits, laid out for processing on corresponding channels 0 through 3 of the SEvID execution engine 110). The engine 110 may then simultaneously execute the instruction for all of the components in the vector. Such an approach is called a "horizontal," "channel-parallel," or "array of structures" implementation. Although some embodiments described herein are associated with a four-channel SEVID execution engine 110, note that an SEVID execution engine could have any number of channels more than one (e.g., embodiments might be associated with a thirty-two channel execution engine). FIG. 2 illustrates another type of processing system 200 that includes a SIMD execution engine 210. In this case, the execution engine 210 receives an instruction along with four operands of data, where each operand is associated with a different vector {e.g., the four X components from vectors 0 through 3). The engine 210 may then simultaneously execute the instruction for all of the operands in a single instruction period. Such an approach is called a "vertical," "channel-serial," or "structure of arrays" implementation.
According to some embodiments, an SBvID instruction may be a "loop" instruction that indicates that a set of associated instructions should be executed, for example, a particular number of times or until a particular condition is satisfied. Consider, for example, the following instructions:
DO { sequence of instructions } WHILE <condition>
Here, the sequence of instruction will be executed as long as the "condition is true." When such an instruction is executed in a SEVID fashion, however, different channels may produce different results of the <condition> test. For example, the condition might be defined such that the sequence of instructions should be executed as long as Varl is not zero (and the sequence of instructions might manipulate Varl as appropriate). In this case, Varl might be zero for one channel and non-zero for another channel.
FIG. 3 illustrates a four-channel SEvID execution engine 300 according to some embodiments. The engine 300 includes a four-bit loop mask register 310 in which eacli bit is associated with a corresponding compute channel. The loop mask register 310 might comprise, for example, a hardware register in the engine 300. The engine 300 may also include a four-bit wide loop "stack" 320. As used herein, the term "stack" may refer to any mechanism to store and reconstruct previous mask values. One example of a stack: is would be a bit-per-channel stack mechanism.
The loop stack 320 might comprise, for example, series of hardware registers, memory locations, and/or a combination of hardware registers and memory locations. Although the engine 30O, the conditional mask register 310, and the conditional stack 320 illustrated in FIG. 3 are four channels wide, note that implementations may be other numbers of channels wide (e.g., x channels wide), and each compute channel may be capable of processing a y-bit operand, so long as there is a 1 : 1 correspondence between the compute channel, mask channel, and loop stack channel.
The engine 300 may receive and simultaneously execute instructions for four different channels of data (e.g., associated, with four compute channels). Note that in some cases, fewer than four channels may be needed (e.g., when there are less than four valid operands). As a result, the loop mask register 310 may be initialized with an initialization vector indicating which channels have valid operands and which do not (e.g., operands io through i3, with a "1" indicating that the associated channel is currently enabled). The loop mask vector 310 may then be used to avoid unnecessary processing (e.g., an instruction might be executed only for those operands in the loop mask register 310 that are set to " 1 ")■ According to another embodiment, the loop mask register 310 is simply initialized to all ones (e.g., it is assumed that all channels are always enabled). In some cases, information in the loop mask register 310 might be combined with information in other registers (e.g., via a Boolean AND operation) and the result may be stored in an overall execution mask register (which may then used to avoid unnecessary or inappropriate processing).
FIGS. 4-5 illustrate a four-channel S IMD execution engine 400 executing a DO instruction according to some embodiments. As before, the engine 400 includes a loop mask register 410 and a loop stack 420. In this case, however, the loop stack 420 is m- entries deep. Note that, for example, in the case of a ten-entry deep stack, the first four entries in the stack 420 might be hardware registers while the remaining six entries are stored in memory.
When the engine 400 receives a loop instruction (e.g., a DO instruction), as illustrated in FIG. 4, the data in the loop mask register 410 is copied to the top of the loop stack 420. Moreover, loop information is stored into the loop mask register 410. The loop information might initially indicate, for example, which of the four channels were active when the DO instruction was first encountered (e.g., operands do through d3, with a "1 " indicating that the associated channel is active).
The set of instructions associated with the DO loop are then executed for each channel in accordance with the loop mask register 410. For example, if the loop mask: register 410 was "1110," the instructions in the loop would be executed for the data associated with the three most significant operands but not the least significant operand (e.g., because that channel is not currently enabled).
When a WHILE statement associated with the DO instruction is encountered, a condition is evaluated for the active channels and the results are stored back into the loop mask register 410 (e.g., by a Boolean AND operation). For example, if the loop mask register 410 was "1110" before the WHILE statement was encountered the condition might be evaluated for the data associated with the three most significant operands. The result is then stored in the loop mask register 410. If at least one of the bits in the loop mask register 410 is still "1," the set of loop instructions are executed again for all channels that have a loop mask register value of " 1." By way of example, if the condition associated with the WHILE statement resulted in a "HOx" result (where x was not evaluated because that channel was not enabled), " 1100" may be stored in the loop mask register 410. When the instructions associated with the loop are then re-executed, the engine 400 will do so only for the data associated with the two most significant operands. In this case, unnecessary and/or inappropriate processing for the loop may be avoided. Note that no Boolean AND operation might be needed if the update is limited to only active channels.
When the WHILE statement is eventually encountered and the condition is evaluated such that all of the bits in the loop mask register 410 are now "0," the loop is complete. Such a condition is illustrated in FIG. 5. In this case, the information from the top of the loop stack 420 (e.g., the initialization vector), is returned to the loop mask register 410, and subsequent instructions may be executed. That is, the data at the top of the loop stack 420 may be transferred back into the loop mask register 410 to restore the contents that indicate which channels contained valid data prior to entering the loop. Further instructions may then be executed for data associated with channels that are enabled. As a result, the SEVID engine 400 may efficiently process a loop instruction.
In addition to a DO instruction, FIGS. 6-8 illustrate a SEVID execution engine 600 executing a REPEAT instruction according to some embodiments. As before, the engine 600 includes a four-bit loop mask register 610 and a four-bit wide, m-entry deep loop stack 620. In this case, the engine 600 further includes a set of counters 630 (e.g., a series of hardware registers, memory locations, and/or a combination of hardware registers and memory locations). The loop mask register 610 may be initialized with, for example, an initialization vector io through i6, with a " 1 " indicating that the associated channel has valid operands.
When the engine 600 encounters a INT COUNT = <integer> instruction associated with a REPEAT loop, as illustrated in FIG. 6, the value <integer> may be stored in the counters 630. When the REPEAT instruction is then encountered, as illustrated in FIG. 7, the data in the loop mask register 610 is copied to the top of the loop stack 620. Moreover, loop information is stored into the loop mask register 610. The loop information might initially indicate, for example, which of the four channels were active when the REPEAT instruction was first encountered (e.g., operands ro through r6, with a "1" indicating that the associated channel is active).
The set of instructions associated with the REPEAT loop are then executed for each channel in accordance with the loop mask register 610. For example, if the loop mask register 610 was "1000," the instructions in the loop would be executed only for the data associated with the most significant operands.
When the end of the REPEAT loop is reached (e.g., as indicated by a " } " or a NEXT instruction), each counter 630 associated with an active channel is decremented. According to some embodiments, if any counter 630 has reached zero, the associated bit in the loop mask register 610 is set to zero. If at least one of the bits in the loop mask register 610 and/or a counter 630 is still "1," the REPEAT block is executed again.
When all of the bits in the loop mask register 610 and/or a counter 630 are "0," the REPEAT loop is complete. Such a condition is illustrated in FIG. 8. In this case, the information from the loop stack 620 (e.g., the initialization vector), is returned to the loop mask register 610, and subsequent instructions may be executed.
FIG. 9 illustrates the SIMD execution engine 600 executing a BREAK instruction according to some embodiments. In particular, the BREAK instruction is within a REPEAT loop and will be executed on if X is greater than Y. In this example. X is greater than Y for second most significant channel and not greater than Y for the other channels. In this case, the corresponding bit in the loop mask vector is set to "0." If all of the bits in the loop mask vector 610 are "0," the REPEAT loop may be terminated (and the top of the loop stack 620 may be returned to the loop mask register 410). Note that more than one BREAK instruction might exist in a loop. Consider, for example, the following instructions:
DO {
Instructions BREAK <condition 1> Instructions BREAK <condition 2> Instructions } While <condition 3>
In this case, the BREAK instruction might be executed if either condition 1 or 2 is satisfied.
FIG. 10 is a flow chart of a method according to some embodiments. The flow charts described herein do not necessarily imply a fixed order to the actions, and embodiments may be performed in any order that is practicable. Note that any of the methods described herein may be performed by hardware, software (including microcode), firmware, or any combination of these approaches. For example, a storage medium may store thereon instructions that when executed by a machine result in performance according to any of the embodiments described herein.
At 1002, a loop instruction is received. For example, a DO or REPEAT instruction might be encountered by a SIMD execution engine. The data in a loop mask register is then transferred to the top of a loop stack at 1004 and loop information is stored in the loop mask register 1006. For example, an indication of which channels currently have valid operands might be stored in the loop mask register.
At 1008, instructions associated with the loop instructions are executed in accordance with information in the loop mask register until the loop is complete. For example, a block of instructions associated with a DO loop or a REPEAT loop may be executed until all of the bits in the loop mask register are "0." When the loop is finished executing, the information at the top of the loop stack may then be moved back to the loop mask register at 1010.
As described with respect to FIG. 3, a loop stack might be one entry deep. When the loop is more than one entry deep, however, a SBVID engine might be able to handle nested loop instructions (e.g., when a second loop block is "nested" inside of a first loop block). Consider, for example, the following set of instructions: DO { first subset of instructions DO { second subset of instructions } WHILE <second condition> third subset of instructions } WHILE <first condition>
In this case, the first and third subsets of instructions should be executed for the appropriate channels while the first condition is true, and the second subset of instructions should only be executed while both the first and second conditions are true.
FIGS. 11-14 illustrate a SIMD execution engine 1100 that includes a loop mask register 1110 (e.g., initialized with an initialization vector) and a multi-entry deep loop stack 1120. As illustrated in FIG. 12, the information in loop mask register 1110 is copied to the top of the stack 1120 (i0 through i3), and first loop information is stored into the loop mask register 1110 (dio through d13) when the first DO instruction is encountered. The engine 1100 may then execute the loop block associated with the first loop instruction for multiple operands of data as indicated by the information in the loop mask register 1110.
FIG. 13 illustrates the execution of another, nested loop instruction (e.g., a second DO statement) according to some embodiments. In this case, the information currently in the loop mask register 1110 (d10 through d13) is copied to the top of the stack 1120. As a result, the information that was previously at the top of the stack 1120 (e.g. , initialization vector io through i3) has been pushed down by one entry. The engine 11OO also stores second loop information into the loop mask register (d20 through d23).
The loop block associated with the second loop instruction may then be executed as indicated by the information in the loop mask register 1110 (e.g., and, each time the second block is executed the loop mask register 1110 may be updated based on the condition associated with the second loop's WHILE instruction). When the second loop's WHILE instruction eventually results in every bit of the loop mask register 1110 being "0," as illustrated in FIG. 14, the data at the top of the loop stack 1120 (e. g., dm through d13) may be moved back into the loop mask register 1110. Further instructions may then be executed in accordance with the loop mask register 1120. When the first loop block completes (not illustrated in FIG. 14), the initialization vector would be transferred back into the loop mask register 1110 and further instructions may be executed, for data associated with enabled channels. Note that the depth of the loop stack 1120 may be associated with the number of levels of loop instruction nesting that are supported by the engine 1 100. According to some embodiments, the loop stack 1120 is only be a single entry deep (e.g., the stack might actually be an n-operand wide register). Also note that a "0" bit in the loop mask register 1110 might indicate a number of different things, such as: (i) the associated channel is not being used, (ii) an associated WHILE condition for the present loop is not satisfied, or (iii) an associated condition of a higher-higher level loop is not satisfied.
According to some embodiments, an SIMD engine may also support "conditional" instructions. Consider, for example, the following set of instructions:
IF (condition) subset of instructions END IF
Here, the subset of instructions will be executed when the condition is "true." As with loop instructions, however, when a conditional instruction is simultaneously executed for multiple channels of data different channels may produce different results. That is, the subset of instructions may need to be executed for some channels but not others.
FIG. 15 illustrates a four-channel SIMD execution engine 1500 according to some embodiments. The engine 1500 includes a loop mask register 1510 and a loop stack 1520 according to any of the embodiments described herein.
Moreover, according to this embodiment the engine 1500 includes a four-bit conditional mask register 1530 in which each bit is associated with a corresponding compute channel. The conditional mask register 1530 might comprise, for example, a hardware register in the engine 1500. The engine 1500 may also include a four-bit wide, m-entry deep conditional stack 1540. The conditional stack 1540 might comprise, for example, series of hardware registers, memory locations, and/or a combination of hardware registers and memory locations (e.g., in the case of a ten entry deep stack, the first four entries in the stack 1540 might be hardware registers while the remaining six entries are stored in memory).
The execution of conditional instructions may be similar to those of loop instructions. For example, when the engine 1500 receives a conditional instruction (e.g., an "IF" statement), the data in the conditional mask register 1530 may be copied to the top of the conditional stack 1540. Moreover, instructions may be executed for each of the four operands in accordance with the information in the conditional mask register 1530. For example, if the initialization vector was "1110," the condition associated with an IF statement would be evaluated for the data associated with the three most significant operands but not the least significant operand (e.g., because that channel is not currently enabled). The result may then stored in the conditional mask register 1530 and used to avoid unnecessary and/or inappropriate processing for the statements associated with the IF statement. By way of example, if the condition associated with the IF statement resulted in a " 110x" result (where x was not evaluated because the channel was not enabled), "1100" may be stored in the conditional mask register 1530. When other instructions associated with the IF statement are then executed, the engine 1500 will do so only for the data associated with the two most significant operand.
When the engine 1500 receives an indication that the end of instructions associated with a conditional instruction has been reached [e.g., and "ENTD IF" statement), the data at the top of the conditional stack 1540 (e.g., the initialization vector) may be transferred back into the conditional mask register 1530 restoring the contents that indicate which channels contained valid data prior to entering the condition block. Further instructions may then be executed for data associated with channels that are enabled. As a result, the SIMD engine 1500 may efficiently process a conditional instruction.
According to some embodiments, instructions are executed in accordance with both the loop mask register 1510 and the conditional mask register 1530. For example, FIG. 16 is an example of a method according to such an embodiment. At 1602, the engine 1500 retrieves the next SEVID instruction. If the bit in the loop mask register 1510 for a particular channel is "0" at 1604, the instruction is not executed for that channel at 1606. If the bit in the conditional mask register 1530 for the channel is "0" It 1608, the instruction is also not executed for that channel. Only if the bits in both the loop mask register 1510 and conditional mask register 1530 are "1" will the instruction be executed at 1610. In this way, the engine 1500 may efficiently execute both loop and conditional instructions.
In some cases, conditional instructions may be nested, within loop instructions and/or loop instructions may be nested within conditional instructions. Note that a BREAK might occur from within n-levels of nested branches . As a result, the conditional stack 1540 may be "unwound" by, for example, popping the conditional mask vector <count> times to restore it to the state prior to loop entry. The <count> might be tracked, for example, by having a compiler track the relative nesting level of conditional instructions between the loop instruction and the BREAK instruction.
FIG. 17 illustrates an SIMD engine 1700 with a sixteen-bit loop mask register 1710 (each bit being associated to one of sixteen corresponding compute channels) and a sixteen-bit wide, m-entry deep loop stack 1720. The engine 1700 may receive and simultaneously execute instructions for sixteen different channels of data (e.g., associated with sixteen compute channels). Because fewer than sixteen channels might be needed, however, the loop mask register is initialed with an initialization vector io through i^, with a " 1 " indicating that the associated channel is enabled.
As illustrated in FIG. 18, when the engine 1700 receives a DO instruction, the data in the loop mask register 1710 is copied to the top of the loop stack 1720. Moreover, DO information do through d15 is stored into the loop mask register 1710. The DO information might indicate, for example, which of the sixteen channels were active when the DO instruction was encountered.
The second set of instructions is then executed for each channel in accordance with the loop mask register 1710. When the WHILE instruction is encountered, the engine 1700 examines a <flag> for each of the active channel. The <flag> might have been set, for example, by one of the second set of instructions (e.g., immediately prior to the WHILE instruction). If no <flag> is true for any channel, the DO loop is complete. In this case, the initialization vector io through i15 may be returned to the loop mask register 1710 and the third set of instructions may be executed.
If at least one <flag> is true, the loop mask register 1710 may be updated as appropriate, and the engine 1700 may jump to an <address> defined by the WHILE instruction (e.g., pointing to the beginning of the second set of instructions).
FIG. 19 is a block diagram of a system 1900 according to some embodiments. The system 1900 might be associated with, for example, a media processor adapted to record and/or display digital television signals. The system 1900 includes a graphics engine 1910 that has an n-operand SIMD execution engine 1920 in accordance with any of the embodiments described herein. For example, the SIMD execution engine 1920 might have an n-operand loop mask vector and an n-operand wide, m-entry deep loop stack in accordance with any of the embodiments described herein. The system 1900 may also include an instruction memory unit 1930 to store SIMD instructions and a graphics memory unit 1940 to store graphics data (e.g., vectors associated with a three-dimensional image). The instruction memory unit 1930 and the graphics memory unit 1940 may comprise, for example, Random Access Memory (RAM) units.
The following illustrates various additional embodiments. These do not constitute a definition of all possible embodiments, and those skilled in the art will understand that many other embodiments are possible. Further, although the following embodiments are briefly described for clarity, those skilled in the art will understand how to make any changes, if necessary, to the above description to accommodate these and other embodiments and applications.
Although some embodiments have been described with respect to a separate loop mask register and loop stack, any embodiment might be associated with only a single loop stack (e.g., and the current mask information might be associated with the top entry in the stack).
Moreover, although different embodiments have been described, note that any combination of embodiments may be implemented (e.g., a REPEAT or BREAK statement and. an ELSE statement might include an address). Moreover, although examples have used "0" to indicate a channel that is not enabled according to other embodiments a "1" might instead indicate that a channel is not currently enabled.
In addition, although particular instructions have been described herein as examples, embodiments may be implemented using other types of instructions. For example, FIG. 20 illustrates a SEVID execution engine 2000 executing a CONTINUE instruction according to some embodiments. In particular, the CONTINUE instruction is within a REPEAT loop that will be executed <integer> times. If, however, the <condition> is true during a particular pass through the loop, that pass will halt and the next pass will begin. For example, if the REPEAT loop was to be executed ten times, and the <condition> was true when the loop was executed for the fifth time, the instructions after the CONTINUE would not be executed and the loop would be begin execution of the sixth pass through the loop. Note that a BREAK<condition> instruction, on the other hand, would end the execution of the loop completely. Consider, for example, the following instructions:
DO {
Instructions
CONTINUE <condition 1> Instructions
CONTINUE <condition 2> Instructions } While <condition 3>
In this case, two unique masks might be maintained: (i) a "loop mask" as described herein and (ii) a "continue mask." The continue mask might, for example, be similar to the loop mask but instead records which execution channels have failed the condition associated with the CONTINUE instruction within a loop. If a channel is "0" (that is, has failed a CONTINUE condition), the execution on that channel may be prevented for the remainder of the that pass through the loop.
One method of executing such a CONTINUE instruction is illustrated in FIG. 21. According to this embodiment, just prior to loop entry at 2102 the execution mask is loaded into the loop mask (e.g., indicating which channels are enabled).
At 2104, the continue mask is initialized with the value of the loop mask prior to execution of the first instruction of the loop. At 2106, a determination is made as to which channels are enabled when loop instructions are executed. For example, execution might only be enabled only when the associated bit in both the loop mask and the continue mask equal one.
At 2108, a CONTINUE instruction is encountered. At this point, a condition associated with the CONTINUE instruction might be evaluated and the continue mask updated as appropriate. Thus, further instructions will not be executed during this pass through the loop for channels that encountered a CONTINUE instruction.
When the loop's WHILE instruction is encountered at 2110, the associated condition is evaluated. If the WHILE instruction's condition is satisfied for any channel (regardless of the channel's bit in the continue mask), the continue mask is again initialized with the loop mask and the process continues at 2104. If the WHILE instruction's condition is not satisfied for every channel, the loop is complete at 2112 and the loop mask is restored from the stack. If a loop is nested, the continue mask may be saved to a continue stack. When the interior loop completes execution, both the loop and continue masks may be restored. According to some embodiments, separate stacks are maintained for the loop mask and the continue mask. According to other embodiments, the loop mask and the continue mask may be are stored in a single stack.
The several embodiments described herein are solely for the purpose of illustration. Persons skilled in the art will recognize from this description other embodiments may be practiced with modifications and alterations limited only by the claims.

Claims

WHAT IS CLAIMED IS:
1. A method, comprising: receiving a first loop instruction at an n-channel single instruction, multiple-data execution engine; and copying information from an n-bit loop mask register to an n-bit wide, m-entry deep loop stack, where n and m are integers.
2. The method of claim 1, further comprising: storing first loop information in the loop mask register.
3. The method of claim 2, wherein the first loop instruction is a DO instruction associated with a WHILE condition, and the first loop information stored in the mask register is to be based at least in part on an evaluation of the WHILE condition for at least one operand associated with a channel.
4. The method of claim 3, further comprising: executing a set of instructions associated with the WHILE condition for at least one channel in accordance with the loop mask register; and updating the loop mask register in accordance with an evaluation of the WHILE condition.
5. The method of claim 4, further comprising: determining that the WHILE condition is still satisfied for at least one channel enabled by the loop mask register; and jumping to the beginning of the set of instructions associated with the WHILE instruction.
6. The method of claim 4, further comprising: determining that the WHILE condition is no longer satisfied for any channel enabled by the loop maslc register; and moving the information from the loop stack to the loop mask register.
7. The method of claim 2, wherein the second loop instruction is a REPEAT instruction.
8. The method of claim 7, wherein a REPEAT counter is maintained for at least one channel and further comprising: executing a set of instructions associated with the REPEAT instruction for at least one channel in accordance with the loop mask register; decrementing at least one REPEAT counter; and determining if the loop mask register should be updated based on at least one REPEAT counter.
9. The method claim 8, further comprising: determining that the REPEAT counter is not zero for at least one channel enabled by the loop mask register; and jumping to the beginning of the set of instructions associated with the REPEAT instruction.
10. The method of claim 8, further comprising: determining that the REPEAT counter is zero for all channels enabled by the loop mask register; and moving information from the loop stack to the loop mask register.
11. The method of claim 2, further comprising: receiving a second loop instruction at the execution engine; moving the first loop information from the loop mask register to the loop stack; and storing second loop information in the loop mask register.
12. The method of claim 1 , further comprising: receiving a BREAK instruction associated with the first loop instruction and a channel; and updating the loop mask register bit associated with the channel.
13. The method of claim 12, further comprising prior to receiving the BREAK instruction: receiving a first conditional instruction at the execution engine; evaluating the first conditional instruction based on multiple operands of associated data; storing the result of the evaluation in an n-bit conditional mask register; receiving a second conditional instruction at the execution engine; and copying the result from the conditional mask register to an n-bit wide, m-entry deep conditional stack.
14. The method of claim 13, further comprising after receiving the BREAK instruction: moving at least one entry in the conditional stack to the conditional mask register.
15. The method of claim 2, further comprising: receiving a CONTINUE instruction associated with the first loop instruction and a channel; and updating the loop mask register bit associated with the channel.
16. The method of claim 1, wherein instructions are executed in accordance with information in the loop mask register and further in accordance with information in a conditional mask register.
17. The method of claim 1 , further comprising prior to receiving the first loop instruction: initializing the loop mask register based on channels to be enabled for execution.
18. The method of claim 1, wherein the loop stack is one entry deep.
19. An apparatus, comprising: an n-bit loop mask vector, wherein the loop mask vector is to store first loop information, associated with a first loop instruction, for multiple channels; and an n-bit wide, m-entry deep loop stack to store information that existed in the loop mask vector prior to the first loop instruction.
20. The apparatus of claim 19, further comprising: an n-bit conditional mask vector, wherein the conditional mask vector is to store results of evaluations of: (i) an IF instruction condition and (ii) data associated with multiple channels; and an n-bit wide, m-entry deep conditional stack to store information that existed in the conditional mask vector prior to the results.
21. The apparatus of claim 19, wherein the first loop information is to be transferred from the loop stack to the loop mask vector when all appropriate instructions associated with a second loop instruction have been executed.
22. The apparatus of claim 19, wherein the first loop instruction is a DO instruction or a REPEAT instruction.
23. An article, comprising: a storage medium having stored thereon instructions that when executed by a machine result in the following: receiving a first DO instruction at an n-channel single instruction, multiple- data execution engine; storing first loop information in an n-bit loop mask register; receiving a second DO instruction at the execution engine; moving the first loop information to an n-bit wide, m-entry deep loop stack; and storing second loop information in the loop mask register.
24. The article of claim 23, wherein execution of the instructions further results in: moving the first loop information from the loop stack into the loop mask register when all appropriate instructions associated with the second DO instruction have been executed.
25. The method of claim 24, wherein execution of the instructions further results in: receiving a BREAK instruction associated with the second DO instruction and a channel; and updating the loop mask register bit associated with the channel.
26. A system, comprising: a processor, including: a bit loop mask vector, wherein the loop mask vector is to store first loop information, associated with a first loop instruction, for multiple channels, and an m-entry deep loop stack to store the first loop information when a second loop instruction is executed by the processor, wherein m is an integer greater than one; and a graphics memory unit.
27. The system of claim 26, wherein the first loop information is to be transferred from the loop stack to the conditional mask vector when all appropriate instructions associated with the second loop instruction have been executed.
28. The system of claim 26, further comprising: an instruction memory unit.
PCT/US2005/037625 2004-10-20 2005-10-13 Looping instructions for a single instruction, multiple data execution engine Ceased WO2006044978A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB0705909A GB2433146B (en) 2004-10-20 2005-10-13 Looping instructions for a single instruction, multiple data execution engine
CN2005800331592A CN101048731B (en) 2004-10-20 2005-10-13 Loop Instructions for Single Instruction, Multiple Data Execution Engine

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/969,731 US20060101256A1 (en) 2004-10-20 2004-10-20 Looping instructions for a single instruction, multiple data execution engine
US10/969,731 2004-10-20

Publications (2)

Publication Number Publication Date
WO2006044978A2 true WO2006044978A2 (en) 2006-04-27
WO2006044978A3 WO2006044978A3 (en) 2006-12-07

Family

ID=35755316

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/037625 Ceased WO2006044978A2 (en) 2004-10-20 2005-10-13 Looping instructions for a single instruction, multiple data execution engine

Country Status (5)

Country Link
US (1) US20060101256A1 (en)
CN (1) CN101048731B (en)
GB (1) GB2433146B (en)
TW (1) TWI295031B (en)
WO (1) WO2006044978A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2470782A (en) * 2009-06-05 2010-12-08 Advanced Risc Mach Ltd Conditional execution in a data processing apparatus handling vector instructions
WO2011080053A1 (en) * 2009-12-30 2011-07-07 International Business Machines Corporation Data parallel function call for determining if called routine is data parallel
US8683185B2 (en) 2010-07-26 2014-03-25 International Business Machines Corporation Ceasing parallel processing of first set of loops upon selectable number of monitored terminations and processing second set
US9501276B2 (en) 2012-12-31 2016-11-22 Intel Corporation Instructions and logic to vectorize conditional loops

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7543136B1 (en) 2005-07-13 2009-06-02 Nvidia Corporation System and method for managing divergent threads using synchronization tokens and program instructions that include set-synchronization bits
US7353369B1 (en) * 2005-07-13 2008-04-01 Nvidia Corporation System and method for managing divergent threads in a SIMD architecture
US9069547B2 (en) 2006-09-22 2015-06-30 Intel Corporation Instruction and logic for processing text strings
US7617384B1 (en) * 2006-11-06 2009-11-10 Nvidia Corporation Structured programming control flow using a disable mask in a SIMD architecture
US8312254B2 (en) * 2008-03-24 2012-11-13 Nvidia Corporation Indirect function call instructions in a synchronous parallel thread processor
US20140189296A1 (en) * 2011-12-14 2014-07-03 Elmoustapha Ould-Ahmed-Vall System, apparatus and method for loop remainder mask instruction
CN103946795B (en) 2011-12-14 2018-05-15 英特尔公司 For generating the systems, devices and methods for circulating alignment and counting or circulating alignment mask
CN104137054A (en) * 2011-12-23 2014-11-05 英特尔公司 Systems, apparatuses, and methods for performing conversion of a list of index values into a mask value
US10474463B2 (en) * 2011-12-23 2019-11-12 Intel Corporation Apparatus and method for down conversion of data types
WO2013095613A2 (en) * 2011-12-23 2013-06-27 Intel Corporation Apparatus and method of mask permute instructions
CN104169867B (en) * 2011-12-23 2018-04-13 英特尔公司 For performing the systems, devices and methods of conversion of the mask register to vector registor
US9619236B2 (en) 2011-12-23 2017-04-11 Intel Corporation Apparatus and method of improved insert instructions
US9946540B2 (en) 2011-12-23 2018-04-17 Intel Corporation Apparatus and method of improved permute instructions with multiple granularities
CN108519921B (en) * 2011-12-23 2022-07-12 英特尔公司 Apparatus and method for broadcasting from general purpose registers to vector registers
US9952876B2 (en) 2014-08-26 2018-04-24 International Business Machines Corporation Optimize control-flow convergence on SIMD engine using divergence depth
US9928076B2 (en) * 2014-09-26 2018-03-27 Intel Corporation Method and apparatus for unstructured control flow for SIMD execution engine
US9983884B2 (en) * 2014-09-26 2018-05-29 Intel Corporation Method and apparatus for SIMD structured branching
GB2540941B (en) * 2015-07-31 2017-11-15 Advanced Risc Mach Ltd Data processing
CN109032665B (en) * 2017-06-09 2021-01-26 龙芯中科技术股份有限公司 Method and device for processing instruction output in microprocessor
WO2019162738A1 (en) * 2018-02-23 2019-08-29 Untether Ai Corporation Computational memory

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6079008A (en) * 1998-04-03 2000-06-20 Patton Electronics Co. Multiple thread multiple data predictive coded parallel processing system and method
EP1117031B1 (en) * 2000-01-14 2007-07-11 Texas Instruments France Microprocessor with reduced power-consumption.
US6732253B1 (en) * 2000-11-13 2004-05-04 Chipwrights Design, Inc. Loop handling for single instruction multiple datapath processor architectures
US20040073773A1 (en) * 2002-02-06 2004-04-15 Victor Demjanenko Vector processor architecture and methods performed therein
US6986028B2 (en) * 2002-04-22 2006-01-10 Texas Instruments Incorporated Repeat block with zero cycle overhead nesting
JP3974063B2 (en) * 2003-03-24 2007-09-12 松下電器産業株式会社 Processor and compiler

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2470782A (en) * 2009-06-05 2010-12-08 Advanced Risc Mach Ltd Conditional execution in a data processing apparatus handling vector instructions
US8661225B2 (en) 2009-06-05 2014-02-25 Arm Limited Data processing apparatus and method for handling vector instructions
GB2470782B (en) * 2009-06-05 2014-10-22 Advanced Risc Mach Ltd A data processing apparatus and method for handling vector instructions
WO2011080053A1 (en) * 2009-12-30 2011-07-07 International Business Machines Corporation Data parallel function call for determining if called routine is data parallel
US8627043B2 (en) 2009-12-30 2014-01-07 International Business Machines Corporation Data parallel function call for determining if called routine is data parallel
US8627042B2 (en) 2009-12-30 2014-01-07 International Business Machines Corporation Data parallel function call for determining if called routine is data parallel
US8683185B2 (en) 2010-07-26 2014-03-25 International Business Machines Corporation Ceasing parallel processing of first set of loops upon selectable number of monitored terminations and processing second set
US9501276B2 (en) 2012-12-31 2016-11-22 Intel Corporation Instructions and logic to vectorize conditional loops
US9696993B2 (en) 2012-12-31 2017-07-04 Intel Corporation Instructions and logic to vectorize conditional loops

Also Published As

Publication number Publication date
GB2433146A (en) 2007-06-13
WO2006044978A3 (en) 2006-12-07
US20060101256A1 (en) 2006-05-11
TW200627269A (en) 2006-08-01
CN101048731B (en) 2011-11-16
CN101048731A (en) 2007-10-03
TWI295031B (en) 2008-03-21
GB2433146B (en) 2008-12-10
GB0705909D0 (en) 2007-05-09

Similar Documents

Publication Publication Date Title
WO2006044978A2 (en) Looping instructions for a single instruction, multiple data execution engine
US20230049454A1 (en) Processor with table lookup unit
CN100470465C (en) Conditional instructions for single instruction, multiple data execution engine
US20100042808A1 (en) Provision of extended addressing modes in a single instruction multiple data (simd) data processor
US20100318764A1 (en) System and method for managing processor-in-memory (pim) operations
CN1391668A (en) Selective writing of data elements from packed data based upon mask using predication
WO2002027475A2 (en) Array processing operations
US8572355B2 (en) Support for non-local returns in parallel thread SIMD engine
US12061910B2 (en) Dispatching multiply and accumulate operations based on accumulator register index number
US20150186190A1 (en) Lock-free barrier with dynamic updating of participant count
EP2025175B1 (en) Instruction for producing two independent sums of absolute differences
US7162607B2 (en) Apparatus and method for a data storage device with a plurality of randomly located data
EP2027533A2 (en) Method and system to combine corresponding half word units from multiple register units within a microprocessor
US6785743B1 (en) Template data transfer coprocessor
US8826252B2 (en) Using vector atomic memory operation to handle data of different lengths
US11803385B2 (en) Broadcast synchronization for dynamically adaptable arrays
US7434028B2 (en) Hardware stack having entries with a data portion and associated counter
US6928605B2 (en) Add-compare-select accelerator using pre-compare-select-add operation
US20040128475A1 (en) Widely accessible processor register file and method for use
US7281122B2 (en) Method and apparatus for nested control flow of instructions using context information and instructions having extra bits
US20130159667A1 (en) Vector Size Agnostic Single Instruction Multiple Data (SIMD) Processor Architecture

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
ENP Entry into the national phase

Ref document number: 0705909

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20051013

WWE Wipo information: entry into national phase

Ref document number: 0705909.0

Country of ref document: GB

WWE Wipo information: entry into national phase

Ref document number: 200580033159.2

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 05812674

Country of ref document: EP

Kind code of ref document: A2