WO2014152064A1 - Method and apparatus for forwarding literal generated data to dependent instructions more efficiently using a constant cache - Google Patents

Method and apparatus for forwarding literal generated data to dependent instructions more efficiently using a constant cache Download PDF

Info

Publication number
WO2014152064A1
WO2014152064A1 PCT/US2014/026907 US2014026907W WO2014152064A1 WO 2014152064 A1 WO2014152064 A1 WO 2014152064A1 US 2014026907 W US2014026907 W US 2014026907W WO 2014152064 A1 WO2014152064 A1 WO 2014152064A1
Authority
WO
WIPO (PCT)
Prior art keywords
instruction
pipeline
entry
register
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2014/026907
Other languages
English (en)
French (fr)
Inventor
James Norris Dieffenderfer
Michael William Morrow
Rodney Wayne Smith
Jeffery M. SCHOTTMILLER
Daniel S. Higdon
Michael Scott Mcilvaine
Brian Michael Stempel
Kulin Narendra Kothari
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority to CN201480010778.9A priority Critical patent/CN105009073B/zh
Priority to JP2016502276A priority patent/JP6352386B2/ja
Priority to EP14724200.2A priority patent/EP2972791B1/en
Priority to KR1020157028732A priority patent/KR102055228B1/ko
Publication of WO2014152064A1 publication Critical patent/WO2014152064A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3824Operand accessing
    • G06F9/383Operand prefetching
    • G06F9/3832Value prediction for operands; operand history buffers
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/30003Arrangements for executing specific machine instructions
    • G06F9/30007Arrangements for executing specific machine instructions to perform operations on data operands
    • G06F9/30032Movement instructions, e.g. MOVE, SHIFT, ROTATE, SHUFFLE
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3824Operand accessing
    • G06F9/3826Bypassing or forwarding of data results, e.g. locally between pipeline stages or within a pipeline stage
    • G06F9/3828Bypassing or forwarding of data results, e.g. locally between pipeline stages or within a pipeline stage with global bypass, e.g. between pipelines, between clusters

Definitions

  • the invention relates to microprocessors.
  • a data dependency stall is the most common stall involving instructions attempting to dispatch to their respective pipelines for execution, where a stalled instruction waits for the producer of an operand to complete. Delays in forwarding the needed operand from its producer to the stalled instruction results in degraded CPU performance.
  • Embodiments of the invention are directed to systems and methods for forwarding literal generated data to dependent instructions more efficiently using a cache for storing constants (literals or immediates).
  • a processor includes a register, a first pipeline, a cache, and a controller.
  • the controller stores a value in an entry in the cache in response to the first pipeline decoding an instruction, wherein the instruction writes the value to the register upon completing execution, and wherein the value is determined or available when the first pipeline decodes the instruction.
  • the controller sets a tag field in the entry to tag the entry with the register, and sets a flag field in the entry to indicate that the entry is valid.
  • the instruction may be a move immediate instruction.
  • a method in another embodiment, includes decoding a first instruction in a first pipeline, wherein the first instruction writes a value to a register upon completing execution, and wherein the value is determined or available when the first pipeline decodes the first instruction.
  • the method further includes storing the value in an entry in a cache; tagging the entry with the register; and setting the entry as valid.
  • a processor in another embodiment, includes a first pipeline to decode a first instruction, wherein the first instruction writes a value to a register upon completing execution, and wherein the value is determined or available when the first pipeline decodes the first instruction.
  • the processor further includes a means for storing, the means for storing to store the value in an entry in a cache; a means for tagging, the means for tagging to tag the entry with the register; and a means for setting, the means for setting to set the entry as valid.
  • a non-transitory computer readable medium has stored instructions to cause a processor to perform a process.
  • the process includes decoding a first instruction in a first pipeline, wherein the first instruction writes a value to a register upon completing execution, and wherein the value is determined or available when the first pipeline decodes the first instruction; storing the value in an entry in a cache; tagging the entry with the register; and setting the entry as valid.
  • Figure 1 illustrates a processor according to an embodiment.
  • Figure 2 illustrates a method according to an embodiment.
  • Figure 3 illustrates a wireless communication system in which embodiments may find application.
  • Figure 1 illustrates components of a processor 100, where for ease of illustration not all components are illustrated. Many processors are superscalar processor, employing more than one pipeline. Two pipelines are illustrated in Figure 1, labeled 102a and 102b, although in practice there may be more than two pipelines in a superscalar processor. For simplicity, three stages are shown in each pipeline, but in practice more than three stages are likely used. [0018] Illustrated in the pipelines of Figure 1 are instruction fetch stages 104a and 104b, decode stages 106a and 106b, and execution stages 108a and 108b.
  • a pipeline may include other stages such as register fetch, hazard checking, cache hit detection, data fetch, and write back for loads and register-to-register operations, to name a few examples.
  • a move instruction is a commonly used instruction for moving (copying or writing) data from one location to another.
  • a move instruction is often written as MOV, and that convention will be followed here.
  • a common use of a move instruction is to copy the value of a constant into an architected register.
  • the constant value to be copied may be referred to as an immediate or literal.
  • a move instruction for moving a constant to a register may be termed a move immediate instruction and written as MOV Rm ⁇ constant, where constant refers to the constant value and Rm refers to the architected register to which the constant value is written.
  • the register Rm is labeled 118 and is illustrated as a register within the register file 120.
  • an embodiment Upon decoding a move immediate instruction, an embodiment stores the constant as part of an entry in a cache, referred to as a constant cache and labeled 112 in Figure 1.
  • An entry in the constant cache 112 is labeled 114 in Figure 1, and comprises three fields: a tag field labeled 114a, a constant field labeled 114b, and a flag field labeled 114c.
  • the constant field 114b stores the constant value associated with the entry.
  • the tag field 114a identifies the register to which the constant value is to be written (or moved).
  • the flag field 114c comprises one or more bits to indicate the status of the entry 114. For some embodiment, the flag field 114c may be one bit in width, indicating whether the entry is valid or not.
  • the constant cache 112 may be realized in the processor 100 as a register file. In the illustration of Figure 1, the constant cache 112 is shown as a separate structure from the register file 120. However, the constant cache 112 need not necessarily be independent of the register file 120. For example, the constant cache 112 may be part of the register file 120, or both structures may be included in a larger register file structure.
  • a move immediate instruction requires no subsequent execution to calculate its result.
  • a constant is generated, it is consumed immediately by a subsequent (in program order) consuming instruction.
  • subsequent consuming instructions have access to the stored constant value before the constant value is written to the destination architected register.
  • the contents of the constant cache 112 may be viewed as being organized into a table, where the constant value stored in an entry is written by a move immediate instruction and tagged according to the destination register of the move immediate instruction.
  • execution of the consuming instruction need not wait for the result of the move immediate instruction to be forwarded, nor wait for the move immediate instruction to complete execution. Rather, the consuming instruction may use as its operand the constant value stored in the entry in the constant cache 112 associated with the move immediate instruction that it depends upon. As a result, no data forwarding is required and no data stall need occur regardless of whether the move immediate instruction has completed or is still in a pipeline.
  • the move immediate instruction and the data dependent consuming instruction may be at the same stage in different pipelines, and yet for some embodiments the data dependent consuming instruction may obtain its operand with zero pipeline cycle delay.
  • the flag field 114c associated with the entry is set to indicate that the contents of the entry are valid.
  • the validity of an entry is checked before the immediate stored in the entry is forwarded to the consuming instruction. If the flag field associated with an entry indicates that the immediate stored in the entry is not valid, then the stored immediate is not forwarded to the consuming instruction.
  • controller 110 may be configured so that for other types of instructions that write values to a destination register, an entry may be generated in the constant cache 112 as described with respect to the move immediate instruction, so that the stored value may be forwarded to a consuming instruction. Examples of such instructions are branch and link instructions, and program control relative branches, to name a few.
  • the described embodiments may be apply to instructions that write a result to the register file, where the result can be determined by either information contained in the decode of the instruction or available at the time of decode. Such instructions do not have any operands that must read the register file.
  • the embodiments disclosed herein are described for a move immediate instruction, where a move immediate instruction merely serves as example instruction for which embodiments may be of utility.
  • the controller 110 invalidates any entry in the constant cache 114 with a tag matching the architected register. In this case, the controller 110 sets the flag field of the matching entry to a value indicating that the constant value stored in the entry is not valid.
  • Controller 110 updates entries in the constant cache 114 according to the above- described embodiments. These actions are may be performed completely by hardware. For some embodiments, instructions stored in a memory, such as for example the memory 116, may carry out the above-described actions.
  • the memory 116 may in general be a non-transitory computer readable medium.
  • FIG. 2 illustrates the above-described actions.
  • an instruction is decoded.
  • the decoded instructions is a move immediate instruction, denoted as MOV R m #C to indicate that a constant value C is to be moved into architected register R m .
  • step 206 indicates that the constant value C is stored in an entry in the constant cache 112, where the entry is tagged with the register R m , and the flag field of the entry is set to indicate that the entry is valid.
  • the decoded instruction is a consumer of the architected register R m , as indicated in step 208, then provided there is a valid entry in the constant cache 112 associated (tagged) with the architected register R m , the constant value C stored in the constant field of that entry is forwarded to the consumer, as indicated in step 210. If the decoded instruction is an instruction that completes execution and writes (or copies) a constant value to the architected register R m , as indicated in step 212, then the controller 110 invalidates the entry (provided there is one) in the constant cache 112 associated (tagged) with the architected register R m , as indicated in step 214.
  • Figure 3 illustrates a wireless communication system in which embodiments may find application.
  • Figure 3 illustrates a communication network 302 comprising base stations 304A, 304B, and 304C.
  • Figure 3 shows a communication device, labeled 306, which may be a mobile cellular communication device such as a cellular phone (e.g., a smart phone), a tablet, or other kind of communication device suitable for a cellular phone network, such as a computer system.
  • the communication device 306 need not be mobile.
  • the communication device 306 is located within the cell associated with the base station 304C.
  • Arrows 308 and 310 pictorially represent the uplink channel and the downlink channel, respectively, by which the communication device 306 communicates with the base station 304C.
  • Embodiments may be used in data processing systems associated with the communication device 306, or with the base station 304C, or both, for example.
  • Figure 3 illustrates only one application among many in which the embodiments described herein may be employed.
  • a software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor.
  • an embodiment of the invention can include a computer readable media embodying a method for forwarding literal generated data to dependent instructions more efficiently using a constant cache.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Advance Control (AREA)
  • Executing Machine-Instructions (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
PCT/US2014/026907 2013-03-14 2014-03-14 Method and apparatus for forwarding literal generated data to dependent instructions more efficiently using a constant cache Ceased WO2014152064A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201480010778.9A CN105009073B (zh) 2013-03-14 2014-03-14 用于将数据更高效地转发到依赖指令的方法和设备
JP2016502276A JP6352386B2 (ja) 2013-03-14 2014-03-14 定数キャッシュを使用してより効率的にリテラル生成データを従属命令に転送するための方法および装置
EP14724200.2A EP2972791B1 (en) 2013-03-14 2014-03-14 Method and apparatus for forwarding literal generated data to dependent instructions more efficiently using a constant cache
KR1020157028732A KR102055228B1 (ko) 2013-03-14 2014-03-14 상수 캐시를 이용하여 리터럴 생성 데이터를 의존 명령들로 보다 효율적으로 포워딩하기 위한 방법 및 장치

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/827,867 2013-03-14
US13/827,867 US20140281391A1 (en) 2013-03-14 2013-03-14 Method and apparatus for forwarding literal generated data to dependent instructions more efficiently using a constant cache

Publications (1)

Publication Number Publication Date
WO2014152064A1 true WO2014152064A1 (en) 2014-09-25

Family

ID=50729776

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/026907 Ceased WO2014152064A1 (en) 2013-03-14 2014-03-14 Method and apparatus for forwarding literal generated data to dependent instructions more efficiently using a constant cache

Country Status (6)

Country Link
US (1) US20140281391A1 (enExample)
EP (1) EP2972791B1 (enExample)
JP (1) JP6352386B2 (enExample)
KR (1) KR102055228B1 (enExample)
CN (1) CN105009073B (enExample)
WO (1) WO2014152064A1 (enExample)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150019845A1 (en) * 2013-07-09 2015-01-15 Texas Instruments Incorporated Method to Extend the Number of Constant Bits Embedded in an Instruction Set
US10324723B2 (en) * 2014-07-02 2019-06-18 Nxp Usa, Inc. Systems and methods for processing both instructions and constant values from a memory of a digital processor accessed by separate pointers
US20160092219A1 (en) * 2014-09-29 2016-03-31 Qualcomm Incorporated Accelerating constant value generation using a computed constants table, and related circuits, methods, and computer-readable media
US20160170770A1 (en) * 2014-12-12 2016-06-16 Qualcomm Incorporated Providing early instruction execution in an out-of-order (ooo) processor, and related apparatuses, methods, and computer-readable media
US10671398B2 (en) * 2017-08-02 2020-06-02 International Business Machines Corporation Low-overhead, low-latency operand dependency tracking for instructions operating on register pairs in a processor core

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6505293B1 (en) * 1999-07-07 2003-01-07 Intel Corporation Register renaming to optimize identical register values
WO2007027671A2 (en) * 2005-08-29 2007-03-08 Searete Llc Scheduling mechanism of a hierarchical processor including multiple parallel clusters
US20100106944A1 (en) * 2004-07-13 2010-04-29 Arm Limited Data processing apparatus and method for performing rearrangement operations

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4197580A (en) * 1978-06-08 1980-04-08 Bell Telephone Laboratories, Incorporated Data processing system including a cache memory
US5123097A (en) * 1989-01-05 1992-06-16 Bull Hn Information Systems Inc. Apparatus and method for simultaneous execution of a write instruction and a succeeding read instruction in a data processing system with a store through cache strategy
JPH04130942A (ja) * 1990-09-21 1992-05-01 Hitachi Ltd ディジタル信号処理装置
JP2539974B2 (ja) * 1991-11-20 1996-10-02 富士通株式会社 情報処理装置におけるレジスタの読出制御方式
US6112019A (en) * 1995-06-12 2000-08-29 Georgia Tech Research Corp. Distributed instruction queue
US6742112B1 (en) * 1999-12-29 2004-05-25 Intel Corporation Lookahead register value tracking
US6728870B1 (en) * 2000-10-06 2004-04-27 Intel Corporation Register move operations
US7105576B2 (en) * 2002-04-24 2006-09-12 Research Development Foundation Synergistic effects of nuclear transcription factor NF-κB inhibitors and anti-neoplastic agents
EP1387254B1 (en) * 2002-07-31 2012-12-12 Texas Instruments Incorporated Skip instruction carrying out a test with immediate value
SE527350C8 (sv) * 2003-08-18 2006-03-21 Gallaher Snus Ab Lock till snusdosa
US7343482B2 (en) * 2004-10-20 2008-03-11 Arm Limited Program subgraph identification
US8176265B2 (en) * 2006-10-30 2012-05-08 Nvidia Corporation Shared single-access memory with management of multiple parallel requests
US7900027B2 (en) * 2008-01-31 2011-03-01 International Business Machines Corporation Scalable link stack control method with full support for speculative operations
US20100004994A1 (en) * 2008-07-02 2010-01-07 Global Launch Incorporated Methods for facilitating communications between businesses and consumers
US20110047357A1 (en) * 2009-08-19 2011-02-24 Qualcomm Incorporated Methods and Apparatus to Predict Non-Execution of Conditional Non-branching Instructions

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6505293B1 (en) * 1999-07-07 2003-01-07 Intel Corporation Register renaming to optimize identical register values
US20100106944A1 (en) * 2004-07-13 2010-04-29 Arm Limited Data processing apparatus and method for performing rearrangement operations
WO2007027671A2 (en) * 2005-08-29 2007-03-08 Searete Llc Scheduling mechanism of a hierarchical processor including multiple parallel clusters

Also Published As

Publication number Publication date
CN105009073B (zh) 2019-01-15
US20140281391A1 (en) 2014-09-18
KR102055228B1 (ko) 2019-12-12
KR20150129822A (ko) 2015-11-20
EP2972791A1 (en) 2016-01-20
CN105009073A (zh) 2015-10-28
EP2972791B1 (en) 2019-08-07
JP6352386B2 (ja) 2018-07-04
JP2016512366A (ja) 2016-04-25

Similar Documents

Publication Publication Date Title
US9678758B2 (en) Coprocessor for out-of-order loads
US8645669B2 (en) Cracking destructively overlapping operands in variable length instructions
US9823929B2 (en) Optimizing performance for context-dependent instructions
US20180267798A1 (en) Move prefix instruction
US20140006752A1 (en) Qualifying Software Branch-Target Hints with Hardware-Based Predictions
JP2003523573A (ja) プロセッサにおける書き込みトラヒックを減少するシステム及び方法
US9652234B2 (en) Instruction and logic to control transfer in a partial binary translation system
EP2972791B1 (en) Method and apparatus for forwarding literal generated data to dependent instructions more efficiently using a constant cache
CN110515656B (zh) 一种casp指令的执行方法、微处理器及计算机设备
US9411590B2 (en) Method to improve speed of executing return branch instructions in a processor
US20150234687A1 (en) Thread migration across cores of a multi-core processor
WO2012106716A1 (en) Processor with a hybrid instruction queue with instruction elaboration between sections
CN110825437B (zh) 用于处理数据的方法和装置
CN114008587A (zh) 在处理器中的推测性错误预测恢复中限制基于负载的控制无关(ci)指令的重放
CN101371223B (zh) 运算数的提早有条件选择
WO2020065250A1 (en) An apparatus and method for predicting source operand values and optimized processing of instructions
KR101847889B1 (ko) 프로세서 모드들을 스위칭하기 위해 호출된 함수의 어드레스의 최하위 비트들의 이용
US20170046160A1 (en) Efficient handling of register files
US20190087184A1 (en) Select in-order instruction pick using an out of order instruction picker
US10324723B2 (en) Systems and methods for processing both instructions and constant values from a memory of a digital processor accessed by separate pointers

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14724200

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase

Ref document number: 2016502276

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20157028732

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2014724200

Country of ref document: EP