CN111258636A - Data processing method, processor, data processing device and storage medium - Google Patents

Data processing method, processor, data processing device and storage medium Download PDF

Info

Publication number
CN111258636A
CN111258636A CN201811454790.5A CN201811454790A CN111258636A CN 111258636 A CN111258636 A CN 111258636A CN 201811454790 A CN201811454790 A CN 201811454790A CN 111258636 A CN111258636 A CN 111258636A
Authority
CN
China
Prior art keywords
subdata
storage device
data
source operand
read
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811454790.5A
Other languages
Chinese (zh)
Other versions
CN111258636B (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Cambricon Information Technology Co Ltd
Original Assignee
Shanghai Cambricon Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Cambricon Information Technology Co Ltd filed Critical Shanghai Cambricon Information Technology Co Ltd
Priority to CN201811454790.5A priority Critical patent/CN111258636B/en
Priority to PCT/CN2019/121064 priority patent/WO2020108496A1/en
Publication of CN111258636A publication Critical patent/CN111258636A/en
Application granted granted Critical
Publication of CN111258636B publication Critical patent/CN111258636B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/30003Arrangements for executing specific machine instructions
    • G06F9/30007Arrangements for executing specific machine instructions to perform operations on data operands
    • G06F9/3001Arithmetic instructions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/30003Arrangements for executing specific machine instructions
    • G06F9/3004Arrangements for executing specific machine instructions to perform operations on memory

Abstract

The present application relates to a data processing method, a processor, a data processing apparatus, and a storage medium. The method comprises the following steps: the method comprises the steps of obtaining an operation instruction, reading first subdata from a first storage device according to the operation instruction, storing the currently read first subdata into a second storage device, obtaining second subdata according to the operation instruction, judging whether the currently read first subdata is larger than or equal to the second subdata, obtaining a current comparison result, storing the current comparison result into the first storage device, returning and continuing to read the first subdata from the first storage device until operation corresponding to the operation instruction is completed. The data are read circularly and compared, the comparison result of each circulation is continuously stored in the first storage device, exclusive access to the first storage device is realized, other processor cores are prevented from accessing the first storage device, and atomicity of atomic operation is guaranteed.

Description

Data processing method, processor, data processing device and storage medium
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data processing method, a processor, a data processing apparatus, and a storage medium.
Background
Atomic operation refers to an operation that is not interrupted by a thread scheduling mechanism, and once the operation is started, the operation is run to the end, and no thread switching is performed in the middle (for example, the shared variable i performs accumulation, and the result of simultaneous accumulation of multiple cores in the case of non-atomic operation is wrong). In a multi-core processor system, a plurality of processor cores share the same off-chip memory unit, and a common data transmission technology may not guarantee atomicity, that is, a plurality of processor cores may access the same address at the same time.
In an actual program, an operation result is stored in a memory space, the memory space has a certain address range, and since the memory space may be accessed by other processor cores before the operation is completed, the conventional method is to read data in the memory space to a memory unit, then store the operation result in the memory unit, and write the result of the memory unit back to the memory space after the instruction operation is completed. However, if other processor cores access the memory space during operation, an erroneous result is obtained, destroying the atomicity of the accumulation.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a data processing method, a processor, a data processing apparatus, and a storage medium, which are capable of achieving independent access to an off-chip storage space during an atomic operation.
A method of data processing, the method comprising:
the method comprises the steps of obtaining an operation instruction, wherein the operation instruction is used for realizing comparison operation of a first source operand and a second source operand, the first source operand comprises first subdata, and the second source operand comprises second subdata;
reading the first subdata from a first storage device according to data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata into a second storage device, wherein the first storage device is an off-chip storage device, and the second storage device is an on-chip storage device;
acquiring the second subdata according to the operation instruction, judging whether the currently read first subdata is larger than or equal to the second subdata, and storing the obtained current comparison result into the second storage device and the first storage device;
and returning to the step of reading the first subdata from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode until the operation corresponding to the operation instruction is completed.
In one embodiment, the currently read first sub-data and the second sub-data are compared in a bit manner, and whether the currently read first sub-data is greater than or equal to the second sub-data is judged;
when the first subdata is larger than or equal to the second subdata, taking the first subdata as the current comparison result;
and when the first subdata is judged to be smaller than the second subdata, taking the second subdata as the current comparison result.
In one embodiment, if the second source operand is an immediate, the immediate is copied, and a plurality of obtained immediate are copied as the second sub-data, where the number of the second sub-data is equal to the number of the currently read first sub-data;
and if the second source operand is data stored in the second storage device, reading the second subdata from a preset storage address of the second storage device, wherein the number of the currently read second subdata is equal to that of the first subdata.
In one embodiment, the source operand A and/or the source operand B are used as the second source operand according to the operation instruction.
In one embodiment, each time after the current comparison result is stored in the first storage device, the next address of the last read end address of the first sub data is used as the start address of the currently read first sub data.
In one embodiment, when the current comparison result is stored in the first storage device, the storage address of the current comparison result is consistent with the storage address of the currently read first sub-data.
In one embodiment, the counter is controlled to increment or decrement once, and then the step of reading the first sub-data from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode is returned until the counter is incremented from an initial value to a target cycle number or the counter is decremented from the target cycle number to the initial value, so as to complete the operation corresponding to the operation instruction.
In one embodiment, the data size of the first source operand is obtained according to the operation instruction;
and obtaining the target cycle number according to the data size of the first source operand and a preset splitting granularity.
In one embodiment, the instruction format of the operation instruction comprises an instruction type, a first source operand, a second source operand, a target operand, and an opcode;
the instruction type is used for determining whether the operation instruction is an atomic operation instruction;
the instruction type is used for determining the operation type of the operation instruction;
the operation code is used for configuring the number of source operands;
the first source operand and the second source operand are respectively used for representing data participating in operation;
the target operand is used to represent the current comparison result.
A processor comprises an arithmetic circuit, a read-write circuit and a second storage device arranged adjacent to the arithmetic circuit, wherein the second storage device can be connected with a first storage device outside the processor through the read-write circuit;
the arithmetic circuit is used for acquiring an arithmetic instruction and sending a read-write request to the first storage device according to the arithmetic instruction;
the operation instruction is used for realizing comparison operation of a first source operand and a second source operand, wherein the first source operand comprises first sub-data, and the second source operand comprises second sub-data;
the read-write circuit is used for reading first subdata from the first storage device according to the read-write request and a preset data reading mode, and storing the first subdata to the second storage device;
the arithmetic circuit is used for acquiring the second subdata, judging whether the currently read first subdata is larger than or equal to the second subdata according to the arithmetic instruction, and storing the obtained current comparison result into the second storage device and the first storage device; and then, sending a read-write request to the first storage device again until the operation corresponding to the operation instruction is completed.
In one embodiment, the processor further comprises a data selector, the arithmetic circuit comprises a two-purpose maximum arithmetic module, the data selector is connected between the arithmetic circuit and the read-write circuit, and the data selector is used for gating a connection path of the two-purpose maximum arithmetic module and the read-write circuit;
the two-view maximum operation module is used for acquiring the second subdata, judging whether the currently read first subdata is larger than or equal to the second subdata according to the operation instruction, and storing the obtained current comparison result into the second storage device and the first storage device.
In one embodiment, the binocular maximum operation module comprises an operation unit and a result output unit connected with the operation unit;
the arithmetic unit is used for comparing the currently read first subdata with the second subdata in a contraposition mode and judging whether the currently read first subdata is larger than or equal to the second subdata or not;
the result output unit is used for taking the first subdata as the current comparison result when the first subdata is larger than or equal to the second subdata;
and the result output unit is used for taking the second subdata as the current comparison result when the first subdata is judged to be smaller than the second subdata.
In one embodiment, the two-purpose maximum operation module is further configured to determine, according to the operation instruction, that the second source operand is an immediate or data stored in the second storage device,
if the second source operand is determined to be an immediate, the two-mesh maximum operation module copies the immediate, a plurality of obtained immediate are copied to serve as second subdata, and the number of the second subdata is equal to the number of the currently read first subdata;
if the second source operand is determined to be the data stored in the second storage device, the read-write circuit reads the second subdata from a preset storage address of the second storage device, and the number of the currently read second subdata is equal to the number of the first subdata.
In one embodiment, the arithmetic circuitry comprises a master processing circuit and at least one slave processing circuit, at least one of the slave processing circuits each being connected to the master processing circuit;
the binocular maximum value operation module is arranged in the main processing circuit.
A data processing apparatus, the apparatus comprising:
the system comprises an obtaining module, a comparing module and a comparing module, wherein the obtaining module is used for obtaining an operation instruction, the operation instruction is used for realizing comparison operation of a first source operand and a second source operand, the first source operand comprises first subdata, and the second source operand comprises second subdata;
the reading module is used for reading the first subdata from a first storage device according to data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata into a second storage device, wherein the first storage device is an off-chip storage device, and the second storage device is an on-chip storage device;
and the operation module is used for acquiring the second subdata according to the operation instruction, judging whether the currently read first subdata is larger than or equal to the second subdata, storing the obtained current comparison result into the second storage device and the first storage device, and then circularly calling the reading module and the operation module until the operation corresponding to the operation instruction is completed.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
the method comprises the steps of obtaining an operation instruction, wherein the operation instruction is used for realizing comparison operation of a first source operand and a second source operand, the first source operand comprises first subdata, and the second source operand comprises second subdata;
reading the first subdata from a first storage device according to data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata into a second storage device, wherein the first storage device is an off-chip storage device, and the second storage device is an on-chip storage device;
acquiring the second subdata according to the operation instruction, judging whether the currently read first subdata is larger than or equal to the second subdata, and storing the obtained current comparison result into the second storage device and the first storage device;
and then, returning to the step of reading the first subdata from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode until the operation corresponding to the operation instruction is completed.
According to the data processing method, the processor, the data processing device and the storage medium, according to an operation instruction, according to a preset data reading mode, first subdata is read from a first storage device, the currently read first subdata is stored into a second storage device, then the second subdata is obtained according to the operation instruction, whether the currently read first subdata is larger than or equal to the second subdata is judged, a current comparison result is obtained, the current comparison result is stored in the first storage device, and then the step of returning and continuously reading the first subdata from the first storage device is carried out until the operation corresponding to the operation instruction is completed. The processor continuously stores the comparison result of each circulation into the first storage device by circularly reading the data for comparison, realizes exclusive access to the first storage device, avoids other processor cores from accessing the first storage device, and ensures the atomicity of atomic operation. The arithmetic operation function of the processor is further expanded, and the operation efficiency during the atomic operation is improved by realizing exclusive access to the first storage device.
Drawings
FIG. 1 is a block diagram of a processor in one embodiment;
FIG. 2 is a block diagram of an embodiment of an operational module;
FIG. 3 is a schematic diagram of a processor according to another embodiment;
FIG. 4 is a schematic diagram of a processor according to another embodiment;
FIG. 5 is a schematic diagram of a processor according to another embodiment;
FIG. 6 is a flow diagram illustrating a data processing method according to one embodiment;
FIG. 7 is a flow chart illustrating a data processing method according to another embodiment;
FIG. 8 is a flow chart illustrating an exemplary Atomic MAX _ VEC method;
FIG. 9 is a flowchart illustrating step S106 according to an embodiment;
FIG. 10 is a flowchart illustrating a method for instruction disassembly in accordance with another embodiment;
FIG. 11 is a block diagram showing the structure of a data processing apparatus according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The terms "first," "second," and "third," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. Off-chip refers to the outside of the processor, i.e., off-chip memory means a memory device disposed outside the processor; on-chip refers to the inside of the processor, i.e. on-chip memory means refers to memory means arranged inside the processor.
The data processing method provided by the present application can be applied to the processor 1000 shown in fig. 1. The processor 1000 includes an arithmetic circuit 12, a read/write circuit 203, and a second storage device 201. The second storage means 201 may be a buffer and/or a register arranged inside the processor 1000. The second storage device 201 may be connected to the first storage device 13 provided outside the processor 1000 through the read-write circuit 203. The first storage device 13 and the second storage device 201 may be a non-volatile memory or a volatile memory, and are not limited herein. The read and write circuits 203 may be I/O circuits.
The operation circuit 12 and the read/write circuit 203 can be connected to the second storage device 201, respectively, and the read/write circuit 203 can be connected to the first storage device 13. The second storage device 201 can be connected to the first storage device 13 outside the processor 1000 via the read/write circuit 203. The second storage device 201 can read the first source operand from the first storage device 13 through the read-write circuit 203 and transmit the first source operand to the operation circuit 12 for operation. The arithmetic circuit 12 may store the obtained arithmetic result and the intermediate arithmetic result in the second storage device 201, and the second storage device 201 may write the arithmetic result back to the first storage device 13 through the read/write circuit 203. In the embodiment of the present application, the intermediate operation result is continuously written back from the second storage device 201 to the first storage device 13 outside the processor 1000, so that the operation circuit 12 can exclusively use the first storage device 13, and the atomicity of the operation and the accuracy of the operation result can be ensured.
The arithmetic circuit 12 is configured to receive an arithmetic instruction, analyze the arithmetic instruction, and implement a corresponding arithmetic operation according to the arithmetic instruction. Optionally, the operation instruction may have a specific instruction format, and the operation circuit may analyze the instruction format according to the operation instruction to obtain instruction information such as an instruction type, a source operand, and an operation code of the operation instruction, so as to implement a corresponding operation according to the operation instruction.
Alternatively, the operation instruction in the embodiment of the present application may be an atomic operation instruction, and as shown in table 1 below, the instruction format of the operation instruction may include an instruction type Name, an instruction type Op, a first source operand, a second source operand, a destination operand Dst, an opcode Src Op, and the like.
The instruction type Name is used for determining the type of the instruction (the type of the instruction includes an atomic operation instruction and other common operation instructions), that is, the instruction type is used for determining whether the operation instruction is an atomic operation instruction. The instruction type Op is used to determine the operation type of the operation instruction, and the operation type is used to indicate what kind of operation the operation instruction implements, so as to distinguish the specific function of the operation, for example, the operation type may be an accumulation operation, a decrement operation, a maximum value operation, a minimum value operation, a logical and operation, a logical or operation, a logical xor operation, an alternative operation, a swap operation, and the like. The operation code Src Op is used to configure the number of source operands involved in the operation instruction. The target operand dstaddr is used to indicate a current operation result obtained after at least one source operand is operated, specifically, the target operand dstaddr may refer to a storage address of the current comparison result, and an operation result corresponding to the operation instruction may be stored in a storage space indicated by the storage address corresponding to the dstaddr. The first and second source operands may represent data participating in an operation, the first source operand may be data stored on the off-chip first storage means 13, i.e. the first source operand may represent data stored in the address Src0 addr. The second source operand may represent data stored in an immediate or address in an instruction.
Further, the instruction format of the operation instruction may further include an identification bit Src1vec for identifying whether the source operand a is an immediate or an address, and an identification bit Src2vec for identifying whether the source operand B is an immediate or an address.
Specifically, when Src1vec is 0, it indicates that the source operand a is an immediate number, and when Src1vec is 1, it indicates that the source operand a is data stored in an address; when Src2vec is 0, it indicates that the source operand B is an immediate number, and when Src2vec is 1, it indicates that the source operand B is data stored in an address.
Furthermore, the instruction format of the arithmetic instruction further includes a Data size Data for indicating the first source operand and a Data stream IO config for requesting the splitting and identifying the target loop times.
The instruction format of the operation instruction may be as follows, as shown in table 1:
Figure BDA0001887481180000061
Figure BDA0001887481180000071
where Src0addr represents the address of the first source operand and dstaddr represents the storage address of the target operand.
In one embodiment, the source operand A or the source operand B is used as the second source operand according to the operation instruction.
Optionally, the second source operand includes source operand A (Src1), source operand B (Src2), source operand A selected identification bits, and source operand B selected identification bits. Specifically, when the selected identification bit of the source operand A is valid, the source operand A is taken as a second source operand; and when the selected identification bit of the source operand B is valid, using the source operand B as a second source operand. When the selected identification bit of the source operand A is valid and the selected identification bit of the source operand B is valid, the source operand A and the source operand B can be simultaneously used as second source operands, and the number of the second source operands is two. Further, the bit width of the operation code Scr Op may include 3 bits, where 2 bits are used to distinguish the number of source operands participating in the operation, and 1 bit is used to select the source operand a (Src1) and/or the source operand B (Src2) as the second source operand to participate in the operation. Reference may be made to table 2:
source operand Src Op
Src0 000
Src0、Src1 010
Src0、Src2 011
Src0、Src1、Src2 100
When the operation code Scr Op is "000", it indicates that the source operand of the operation instruction is 1, which is the first source operand Src 0. When the opcode Scr Op is "010", it indicates that the source operands of the operation instruction are 2, including the first source operand Src0 and the second source operand, and the selected identification bit of the source operand a is valid, and the second source operand is the source operand a (Src 1). When the opcode Scr Op is "011", it indicates that the source operands of the operation instruction are 2, including the first source operand Src0 and the second source operand, and the selected identification bit of the source operand B is valid, and the second source operand is the source operand B (Src 2). When the opcode Scr Op is "100", it indicates that the source operands of the operation instruction are 3, including the first source operand Src0, the source operand a (Src1), and the source operand B (Src 2).
In the embodiment of the present application, it may be default that the first source operand Src0 is always valid.
Optionally, the Data Type represents a Data Type, and the instruction supports, but is not limited to, the following Data types:
data type Data Type
Int16 000
Uint16 001
Int32 010
Uint32 011
Optionally, the operation instruction may include an arithmetic operation instruction, and may also include a logic operation instruction: the arithmetic operation instruction may include: the system comprises a monocular maximum value operation instruction Atomic MAX _ SCALAR, a monocular minimum value operation instruction Atomic MIN _ SCALAR, a binocular maximum value operation instruction Atomic MAX _ VEC, a binocular minimum value operation instruction AtomicMIN _ VEC, a replacement operation instruction Atomic CAS, an exchange operation instruction Atomic EXCH, an addition operation instruction AtomicADD, an accumulation operation instruction Atomic INC and a subtraction operation instruction Atomic DEC. The logical operation instruction may include: the logical AND operation instruction Atomic AND, the logical OR operation instruction Atomic OR, the logical XOR operation instruction Atomic XOR, AND the logical NOT operation instruction Atomic NOT.
The monocular maximum value operation instruction Atomic MAX _ SCALAR is used for solving the maximum value of the plurality of first subdata in the first source operand.
And the monocular minimum value operation instruction Atomic MIN _ SCALAR is used for solving the minimum value of the plurality of first subdata in the first source operand.
The binary maximum value operation instruction Atomic MAX _ VEC is used for calculating the maximum value of the first source operand and the second source operand.
The binary minimum value operation instruction Atomic MIN _ VEC is used for calculating the minimum value of the first source operand and the second source operand.
The ADD operation instruction Atomic ADD is used for adding a first source operand and a second source operand.
And the accumulation operation instruction Atomic INC is used for performing accumulation operation between the first source operand and the second source operand.
A subtraction instruction Atomic DEC for performing a subtraction operation between a first source operand and a second source operand.
AND the logic AND operation instruction Atomic AND is used for carrying out AND logic operation between the first source operand AND the second source operand.
The logical OR instruction Atomic OR is used for carrying out logical OR operation between the first source operand and the second source operand.
And the logic exclusive-OR operation instruction Atomic XOR is used for performing logic exclusive-OR operation between the first source operand and the second source operand.
And the logic NOT instruction Atomic NOT is used for carrying out NOT operation between the first source operand and the second source operand.
The replacement operation instruction Atomic CAS is used for replacing among the first source operand, the second source operand and the third source operand.
The system comprises an exchange operation instruction Atomic EXCH and an operation instruction used for exchanging between a first source operand and a second source operand.
In the embodiment of the present application, to ensure atomicity of operation, the operation instruction may be implemented by dividing the same operation into multiple sub-operations, and the exclusive ownership of the first storage device is implemented by continuously writing back the intermediate calculation result to the first storage device.
Specifically, the first source operand includes at least one first subdata, the arithmetic circuit 12 receives an arithmetic instruction, sends a read-write request to the first storage device 13 according to the arithmetic instruction, the read-write circuit 203 reads the first subdata from the first storage device 13 according to the read-write request and stores the first subdata into the second storage device 201 according to a data reading mode, the arithmetic circuit 12 obtains the second source operand according to the arithmetic instruction, executes an arithmetic operation to obtain a current arithmetic result, stores the obtained current arithmetic result into the second storage device 201, and stores the current arithmetic result of the second storage device 201 into the first storage device 13 through the read-write circuit 203. After that, the arithmetic circuit 12 may send a read/write request to the first storage device 13 again to read the first sub-data from the first storage device 13 again, and execute the arithmetic operation for multiple times in a loop until the arithmetic operation corresponding to the arithmetic instruction is completed.
Optionally, the processor may further comprise a counter, which may be connected to the arithmetic circuitry 12, for recording a target number of cycles of the arithmetic instruction. Specifically, each time the read/write circuit 203 stores the current operation result of the second storage device 201 in the first storage device 13, the operation circuit 12 may control the counter to increment once, and send the read/write request to the first storage device 13 again until the counter is incremented from the initial value to the target cycle number. In this embodiment, the initial value of the counter may be 0, that is, when the counter is incremented from 0 to the target cycle number, the corresponding operation of the operation instruction is completed. Alternatively, the arithmetic circuit 12 may control the counter to decrement once, and send the read/write request to the first storage device 13 again until the counter is decremented from the target number of cycles to the initial value. In this embodiment, the initial value of the counter may be 0, that is, when the counter is decremented from the target cycle number to 0, the corresponding operation of the operation instruction is completed.
Further, the arithmetic circuit 12 may be provided with an arithmetic module corresponding to each arithmetic instruction. Specifically, referring to fig. 2, the arithmetic circuit 12 may include a binoculus maximum value operation module 121, a binoculus minimum value operation module 122, a logical and operation module 123, a logical or operation module 124, a logical exclusive-or operation module 125, an exchange operation module 126, a replacement operation module 127, a monocular maximum value operation module 128, a monocular minimum value operation module 129, an addition operation module 130, an accumulation operation module 131, a subtraction operation module 132, a logical not operation module 133, and the like.
The two-purpose maximum value operation module 121 is configured to implement the operation of the two-purpose maximum value operation instruction Atomic MAX _ VEC, that is, to implement the maximum value operation of the first source operand and the second source operand.
The binary minimum operation module 122 is configured to implement the operation of the binary minimum operation instruction Atomic MIN _ VEC, that is, to implement the minimum operation of the first source operand and the second source operand.
The AND logic module 123 is configured to implement the operation of the AND logic instruction Atomic AND, that is, to implement the AND logic operation between the first source operand AND the second source operand.
The OR logic module 124 is configured to implement the operation of the above-mentioned OR logic instruction Atomic OR, that is, to implement a logical OR operation between the first source operand and the second source operand.
The XOR operation module 125 is configured to implement the operation of the above XOR operation instruction Atomic XOR, that is, to implement a XOR operation between the first source operand and the second source operand.
The swap operation module 126 is used to implement the operation of the swap operation instruction Atomic EXCH, i.e. the swap operation between the first source operand and the second source operand.
The replacement operation module 127 is configured to implement the operation of the replacement operation instruction Atomic CAS, that is, to implement the replacement operation among the first source operand, the second source operand, and the third source operand.
The monocular maximum value operation module 128 is configured to implement the operation of the above-mentioned monocular maximum value operation instruction Atomic MAX _ SCALAR, that is, to implement the maximum value operation of the plurality of first sub-data in the first source operand.
The monocular minimum value operation module 129 is configured to implement the operation of the above-mentioned monocular minimum value operation instruction Atomic MIN _ SCALAR, that is, to implement the minimum value operation of the plurality of first sub-data in the first source operand.
The addition operation module 130 is configured to implement the operation of the above-mentioned addition operation instruction Atomic ADD, that is, to implement the operation of adding the first source operand and the second source operand.
The accumulation operation module 131 is configured to implement the operation of the accumulation operation instruction Atomic INC, that is, to implement the operation of accumulating between the first source operand and the second source operand.
The subtraction module 132 is configured to implement the operation of the subtraction instruction Atomic DEC, that is, to implement the subtraction operation between the first source operand and the second source operand.
The logical NOT operation module 133 is configured to implement the operation of the above-mentioned logical NOT operation instruction Atomic NOT, that is, to implement a logical NOT operation between the first source operand and the second source operand.
Alternatively, each operation module may include an operation unit and a result output unit connected to the operation unit. The operation unit is used for executing specific operation steps, and the result output unit is used for taking the result obtained in the operation steps as the current operation result.
Further, as shown in fig. 1 and 2, the processor may further include a data selector 14, and the data selector 14 is connected between the arithmetic circuit 12 and the read-write circuit 203. The data selector 14 is configured to gate the connection paths between the operation blocks in the operation circuit 12 and the read/write circuit 203. For example, if the operation instruction is the maximum two-way operation instruction AtomicMAX _ VEC, the data selector 14 is used to gate the connection path between the maximum two-way operation module 121 and the read/write circuit 203. At this time, the maximum two-entry operation module 121 is configured to obtain the second subdata, determine whether the currently read first subdata is greater than or equal to the second subdata according to the operation instruction, store the obtained current comparison result in the second storage device 201, and store the current comparison result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation command is an Atomic MIN _ VEC, the data selector 14 is configured to gate a connection path between the minimum two-way operation module 122 and the read/write circuit 203. At this time, the two-entry minimum value operation module 122 is configured to obtain the second sub data, determine whether the currently read first sub data is smaller than the second sub data according to the operation instruction, store the obtained current comparison result in the second storage device 201, and store the current comparison result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation instruction is an AND operation instruction Atomic AND, the data selector 14 is configured to gate a connection path between the AND operation block 123 AND the read/write circuit 203. At this time, the and logic module 123 is configured to obtain the second sub-data, perform and logic operation on the currently read first sub-data and second sub-data according to the operation instruction, store the obtained current operation result in the second storage device 201, and store the current operation result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation instruction is an and operation instruction Atomic OR, the data selector 14 is configured to gate the connection path between the OR operation module 124 and the read/write circuit 203. At this time, the or logic module 124 is configured to obtain the second sub data, perform a or logic operation on the currently read first sub data and second sub data according to the operation instruction, store the obtained current operation result in the second storage device 201, and store the current operation result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation instruction is the logical and operation instruction Atomic XOR, the data selector 14 is configured to gate the connection path between the logical exclusive-or operation module 125 and the read/write circuit 203. At this time, the xor operation module 125 is configured to obtain the second sub data, perform xor operation on the currently read first sub data and second sub data according to the operation instruction, store the obtained current operation result in the second storage device 201, and store the current operation result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation instruction is the replacement operation instruction Atomic CAS, the data selector 14 is used for gating the connection path between the replacement operation module 127 and the read/write circuit 203. At this time, the replacement operation module 127 is configured to obtain the second sub-data and the third sub-data, perform replacement operation on the currently read first sub-data, second sub-data, and third sub-data according to the operation instruction, store the obtained current operation result in the second storage device 201, and store the current operation result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation instruction is an exchange operation instruction Atomic EXCH, the data selector 14 is used for gating the connection path between the exchange operation module 126 and the read/write circuit 203. At this time, the exchange operation module 126 is configured to obtain the second sub data, perform an exchange operation on the currently read first sub data and second sub data according to the operation instruction, store the obtained current operation result in the second storage device 201, and store the current operation result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation command is the monocular maximum value operation command Atomic MAX _ SCALAR, the data selector 14 is configured to gate the connection path between the monocular maximum value operation module 128 and the read/write circuit 203. At this time, the monocular maximum value operation module 128 is configured to compare N pieces of sub data in the sub data segments of the source operand one by one to obtain a maximum value of the N pieces of sub data, store the maximum value as a current comparison result in the second storage device 201, and store the current comparison result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation command is the monocular minimum value operation command Atomic MIN _ SCALAR, the data selector 14 is configured to gate the connection path between the monocular minimum value operation module 129 and the read/write circuit 203. At this time, the monocular minimum value operation module 129 is configured to compare the N pieces of sub data in the sub data segments of the source operand one by one to obtain a minimum value of the N pieces of sub data, store the minimum value as a current comparison result in the second storage device 201, and store the current comparison result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation instruction is an addition operation instruction Atomic ADD, the data selector 14 is configured to gate a connection path between the addition operation module 130 and the read/write circuit 203. At this time, the addition operation module 130 is configured to obtain the second sub data, add the currently read first sub data and the second sub data according to the operation instruction to obtain a current operation result, store the current operation result in the second storage device 201, and store the current operation result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
If the operation instruction is an accumulation operation instruction Atomic INC, the data selector 14 is configured to gate a connection path between the accumulation operation module 131 and the read/write circuit 203. At this time, the accumulation operation module 131 is configured to obtain the second sub-data, determine whether the currently read first sub-data is greater than or equal to the second sub-data according to the operation instruction, reset the first sub-data when the first sub-data is greater than or equal to the second sub-data, store the reset first sub-data as a current comparison result in the second storage device 201, and store the current comparison result of the second storage device 201 in the first storage device 13 through the read-write circuit 203 and the data selector 14.
If the operation instruction is the subtraction instruction Atomic DEC, the data selector 14 is configured to gate a connection path between the subtraction module 132 and the read/write circuit 203. At this time, the subtraction module 132 is configured to obtain second sub-data, determine whether the currently read first sub-data is larger than the second sub-data according to the operation instruction, and store the second sub-data as a current comparison result in the second storage device 201 when the first sub-data is larger than the second sub-data; when the first subdata is smaller than or equal to the second subdata, subtracting the first subdata from the first preset value, storing the subtracted first subdata into the second storage device 201 as a current comparison result, and storing the current comparison result of the second storage device 201 into the first storage device 13 through the read-write circuit 203 and the data selector 14.
If the operation instruction is an Atomic NOT instruction, the data selector 14 is configured to gate a connection path between the logical NOT operation module 133 and the read/write circuit 203. At this time, the logical negation operation module 133 is configured to obtain the second sub data, perform a logical negation operation on the currently read first sub data and second sub data according to the operation instruction, store the obtained current operation result in the second storage device 201, and store the current operation result of the second storage device 201 in the first storage device 13 through the read/write circuit 203 and the data selector 14.
In one embodiment, with continued reference to fig. 3-5, the second memory device 201 and the read/write circuit 203 may be packaged as a memory circuit 10. The arithmetic circuit 12 includes a master processing circuit 101 and at least one slave processing circuit 102, the at least one slave processing circuit 102 each being connected to the master processing circuit 101, the master processing circuit 101 being connected to a branch processing circuit(s) 103, the branch processing circuit 103 being connected to the one or more slave processing circuits 102; the branch processing circuit 103 is configured to execute forwarding of data or instructions between the master processing circuit 101 and the slave processing circuit 102. The main processing circuit 101 is used for performing preamble processing on a source operand and transmitting data and an operation instruction with a plurality of slave processing circuits; the plurality of slave processing circuits 102 are configured to perform an intermediate operation in parallel according to the data and the operation instruction transmitted from the master processing circuit to obtain a plurality of intermediate results, and transmit the plurality of intermediate results to the master processing circuit; the main processing circuit 101 is configured to perform subsequent processing on the plurality of intermediate results to obtain a calculation result of the calculation instruction.
The main processing circuit 101 may include the aforementioned two-purpose maximum operation module 121, two-purpose minimum operation module 122, logical and operation module 123, logical or operation module 124, logical exclusive or operation module 125, replacement operation module 126, swap operation module 127, one-purpose maximum operation module 128, one-purpose minimum operation module 129, addition operation module 130, accumulation operation module 131, subtraction operation module 132, and logical not operation module 133. The data selector 14 described above may be connected between the main processing circuit 101 and the read/write circuit 203.
In one embodiment, the processor may further include a controller circuit 11, the controller circuit 11 including: instruction cache circuitry 110, instruction processing circuitry 111 and store queue circuitry 113.
The instruction cache circuit 110 is configured to store a calculation instruction associated with an artificial neural network operation.
The instruction processing circuit 111 is configured to analyze the calculation instruction to obtain a plurality of operation instructions.
A store queue circuit 113 for storing an instruction queue, the instruction queue comprising: and a plurality of operation instructions or calculation instructions to be executed according to the front and back sequence of the queue.
Further, the controller circuit 11 may include a split granularity circuit 114, a cycle number processing circuit 115, and a data read capacity calculation circuit 116.
The split granularity circuit 114 is connected to the cycle number processing circuit 115, the cycle number processing circuit 115 is connected to the instruction processing circuit 111 and the data reading capacity calculation circuit 116, the data reading capacity calculation circuit 116 is connected to the operation circuit 12, and the second storage device 201 can be connected to the first storage device 13 outside the processor through the read/write circuit 203.
The instruction processing circuit 111 is configured to obtain an operation instruction, parse the data size of the first source operand according to the operation instruction, and transmit the data size of the first source operand to the loop number processing circuit 115.
The split granularity circuit 114 is used to store a preset split granularity. In this embodiment, the split-granularity circuit 114 may be a buffer or a segment of a storage space in the second storage device, for example, the split-granularity circuit 114 may be a storage space corresponding to a specified address interval in the second storage device.
The cycle number processing circuit 115 is configured to obtain a target cycle number according to the size of the first operand and a preset splitting granularity, and transmit the target cycle number to the operation circuit 12. In this embodiment, the loop number processing circuit 115 may be a counter.
The data reading capacity calculation circuit 116 is configured to obtain a data reading capacity according to the size of the first operand and a preset splitting granularity, and transmit the data reading capacity to the operation circuit 12. The arithmetic circuit 12 is configured to send a read/write request to the first storage device 13 according to an arithmetic instruction to read first sub-data from the first storage device 13, where the size of the first sub-data is equal to the data reading capacity. After that, the operation circuit 12 may perform an operation according to the read first sub data and second sub data, and after the current operation is completed, the cycle number processing circuit 115 increments the target cycle number once from the initial value, and sends the read/write request to the first storage device 13 again until the counter increments from the initial value to the target cycle number. In this embodiment, the initial value may be 0, that is, until the current cycle number is accumulated from 0 to the target cycle number, the corresponding operation of the operation instruction is completed. Alternatively, the loop count processing circuit 115 decrements the target loop count once, and transmits the read/write request to the first storage device 13 again until the target loop count is decremented to 0. Namely, when the current cycle number is decreased to 0, the corresponding operation of the operation instruction is completed.
In the embodiment, the data is split by adding the split granularity circuit 114, the cycle number processing circuit 115 and the data reading capacity calculation circuit 116, so that the size of the processed data is larger than the memory access bandwidth which can be accommodated in a single clock cycle.
Referring to fig. 6 or fig. 7, after receiving the operation instruction, the processor may perform the following steps:
s100, an operation instruction is obtained.
The operation instruction is used for realizing operation among source operands, and the first source operand comprises at least one first subdata.
And S200, reading the first subdata from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata into the second storage device.
The data reading capacity represents the number of data read at a time, and can be calculated. The first storage device 13 is an off-chip storage device and the second storage device 201 is an on-chip storage device. Specifically, after the arithmetic circuit 12 obtains the arithmetic instruction, it sends a read-write request to the first storage device 13 according to the arithmetic instruction, and then the read-write circuit 203 reads the first sub-data from the first storage device 13 according to the preset data reading mode and according to the read-write request, and stores the currently read first sub-data in the second storage device 201.
S300, executing operation according to the operation instruction, and storing the obtained current operation result into the second storage device and the first storage device.
Specifically, the arithmetic circuit 12 performs a corresponding arithmetic operation according to the obtained arithmetic instruction, so as to obtain a current arithmetic result, and then stores the obtained current arithmetic result in the second storage device 201, and then stores the current arithmetic result of the second storage device 201 in the first storage device 13 through the read/write circuit 203.
And S400, returning to the step of reading the first subdata from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode until the operation corresponding to the operation instruction is completed.
Specifically, step S400 may include: and controlling the counter to accumulate once or decrement once, then returning to the step S200, and reading the first subdata from the first storage device according to the operation instruction and the data reading capacity and a preset data reading mode until the counter is accumulated to the target cycle number from the initial value or the counter is decremented to the initial value from the target cycle number. In the embodiment of the present application, the initial value of the counter may be 0.
Further, the target number of cycles is calculated according to the data size of the first source operand. After the current operation result of the second storage device 201 is stored in the first storage device 13 through the read-write circuit 203, the counter is controlled to accumulate once, and then the first subdata is continuously read from the first storage device 13 according to the operation instruction and the data reading capacity until the counter is accumulated from 0 to the target cycle number. Or controls the counter to decrement once until the counter decrements the target number of cycles to 0, and stops reading the first sub data from the first storage device 13.
Specifically, when the above operation instruction is Atomic MAX _ VEC, in an embodiment, as the operation method shown in fig. 8, the method may include the following steps:
s102, an operation instruction is obtained.
The operation instruction is used for realizing comparison operation between a first source operand and a second source operand, wherein the first source operand comprises at least one first subdata, and the second source operand comprises at least one second subdata.
Specifically, the arithmetic circuit 12 obtains an arithmetic instruction for implementing a comparison operation between a first source operand and a second source operand.
And S104, reading the first subdata from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata to the second storage device.
The first storage device 13 is an off-chip storage device, and the second storage device 201 is an on-chip storage device.
Specifically, after the arithmetic circuit 12 obtains the arithmetic instruction, it sends a read-write request to the first storage device 13 according to the arithmetic instruction and the data reading capacity, and then the read-write circuit 203 reads the first sub-data from the first storage device 13 according to the read-write request in a preset data reading manner, and stores the currently read first sub-data in the second storage device 201.
S106, acquiring second subdata according to the operation instruction, judging whether the currently read first subdata is larger than or equal to the second subdata, and storing the obtained current comparison result into a second storage device and a first storage device.
And the number of the obtained second sub-data is equal to that of the currently read first sub-data.
Specifically, the arithmetic circuit 12 obtains second sub-data required for comparison operation according to the obtained arithmetic instruction, compares the currently read first sub-data with the second sub-data after obtaining the second sub-data, determines whether the currently read first sub-data is greater than or equal to the second sub-data, and further obtains a current comparison result, and then stores the obtained current comparison result in the second storage device 201, and stores the current comparison result in the first storage device 13 through the read-write circuit 203.
And S108, returning to the step of reading the first subdata from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode until the operation corresponding to the operation instruction is completed.
Specifically, step S108 may include: and controlling the counter to accumulate once or decrement once, then returning to the step S104, and reading the first subdata from the first storage device according to the operation instruction and the data reading capacity and a preset data reading mode until the counter is accumulated to the target cycle number from the initial value or the counter is decremented to the initial value from the target cycle number. In the embodiment of the present application, the initial value of the counter may be 0.
Further, the target number of cycles is calculated according to the data size of the first source operand. After the current operation result of the second storage device 201 is stored in the first storage device 13 through the read-write circuit 203, the counter is controlled to accumulate once, and then the first subdata is continuously read from the first storage device 13 according to the operation instruction and the data reading capacity until the counter is accumulated from 0 to the target cycle number. Or controls the counter to decrement once until the counter decrements the target number of cycles to 0, and stops reading the first sub data from the first storage device 13.
In the above operation method, the comparison result of each cycle is continuously stored in the first storage device by comparing the cycle read data, so that exclusive access to the first storage device is realized, access to the first storage device by other processor 1000 cores is avoided, and atomicity of atomic operation is ensured.
In one embodiment, referring to fig. 9, the step S106 may further include:
s1062, comparing the currently read first sub data with the second sub data, and determining whether the currently read first sub data is greater than or equal to the second sub data.
Specifically, after acquiring the first sub-data and the second sub-data, the arithmetic circuit 12 obtains a first sub-data set and a second sub-data set, where a plurality of first sub-data in the first sub-data set are sequentially arranged; the plurality of second sub-data in the second sub-data set are sequentially arranged. And comparing the currently read first subdata with the second subdata, namely comparing the first subdata in the first subdata set with the second subdata with corresponding sequence numbers in the second subdata set according to the sequence numbers of the arrangement sequence, and judging whether the currently read first subdata is larger than or equal to the second subdata.
And when the first sub-data is larger than or equal to the second sub-data, executing S1064 to take the first sub-data as a current comparison result, and when the first sub-data is smaller than the second sub-data, executing S1066 to take the second sub-data as a current comparison result.
For example, the currently read first sub-data and second sub-data are multiple, the first sub-data set a is {1, 2, 3, 4, 5, 6, 7, 8}, the second sub-data set b is {0, 3, 4, 5, 2, 1, 7, 2}, each bit of first sub-data in a is correspondingly compared with each bit of second sub-data in b, that is, the first bit of first sub-data 1 in a is compared with the first bit of second sub-data 0 in b, obviously, 1 is greater than 0, which indicates that the first sub-data is greater than the second sub-data, and at this time, 1 is taken as a comparison result; comparing the second bit 2 in a with the second bit 3 in b, obviously 2 being less than 3, which means that the first subdata is less than the second subdata, at this time, 3 is taken as a comparison result, and so on, and after the comparison between the first subdata in a and the second subdata in b is completed, the current comparison result is {1, 3, 4, 5, 5, 6, 7, 8 }.
In this embodiment, the first sub-data and the second sub-data are compared in a bit-aligned manner, and the largest data of the first sub-data and the second sub-data is stored in the first storage device 13 according to the position as a comparison result, so that the maximum value is found.
In another embodiment, referring to fig. 10, the operation method may further include the following steps:
s500, an operation instruction is obtained, and the data size of the first source operand is analyzed according to the operation instruction.
Specifically, the instruction processing circuit 111 obtains the operation instruction, parses the data size of the first source operand according to the operation instruction, and sends the data size of the first source operand to the loop number processing circuit 115.
S600, obtaining target cycle times and data reading capacity according to the data size of the first source operand and preset splitting granularity.
Specifically, the preset split granularity is stored in the split granularity circuit 114, which may be a certain storage space in the static memory on the chip. The cycle number processing circuit 115 receives the data size of the first source operand, and calculates the target cycle number according to the data size of the first source operand and the preset splitting granularity. The data read capacity calculation circuit 116 calculates the data read capacity according to the cycle count sent by the cycle count processing circuit 115, the data size of the first source operand sent by the instruction processing circuit 111, and the preset split granularity, and sends the data read capacity and the target cycle count to the operation circuit 12.
Alternatively, the loop number processing circuit 115 may calculate the target loop number according to the following formula:
Figure BDA0001887481180000171
wherein, Count is expressed as a target cycle number, data size is expressed as a data size of the first source operand, and the splitting granularity is a preset splitting granularity. In the embodiment of the application, the quotient obtained by dividing the data size by the preset splitting granularity is rounded up to obtain the target cycle number Count.
The data read capacity calculation circuit 116 may calculate the data read capacity according to the following formula:
data real size ═ min { unprocessed data size, split granularity }
The data real size represents data reading capacity, the splitting granularity is preset splitting granularity, and the unprocessed data size represents the data size of the first source operand minus the data reading capacity.
For example, the controller circuit 11 analyzes that the data size of the first source operand is 1000 bytes, the preset splitting granularity is 512 bytes, the number of cycles is 2, and the data reading capacities of the two times are 512 bytes and 488 bytes, respectively, according to the operation instruction.
In one embodiment, the source operand A or the source operand B is used as the second source operand according to the instruction format of the operation instruction.
Specifically, referring to the format of Src Op in table 2, when Src Op in the received operation instruction is 010, which indicates that source operand a is valid, source operand a is used as the second source operand; when the SrcOp in the received operation instruction is 011, the source operand B is effective, and the source operand B is used as a second source operand; when Src Op in the received operation instruction corresponds to 100, which indicates that source operand a is valid and source operand B is valid, source operand a is used as the second source operand and source operand B is used as the third source operand.
In this embodiment, the source operand a or the source operand B is selected as the second source operand for selection according to the format of the operation code Src Op in the instruction format.
In one embodiment, the preset data reading mode may include: after the first sub-data is read from the first storage device 13 for the first time, the current operation result is stored in the first storage device 13, and then after the current operation result is stored in the first storage device 13 each time, the next address of the end address of the first sub-data read last time is used as the start address of the first sub-data read currently. In this embodiment of the application, after the current operation result is stored in the first storage device 13 each time, an address offset is performed on the storage address corresponding to the first subdata, and the address offset is equal to the storage address occupied by the first subdata read last time. According to the method, after the first sub-data is read from the first storage device 13 according to the operation instruction, the currently read first sub-data is stored in the second storage device 201.
For example, the data size of the first source operand is 1000 bytes, and the storage address occupied by the 1000 bytes is 0-256; the first sub data read for the first time is 512 bytes, and the storage address of the first sub data can be 0-128; the start address of the first sub-data is 0, and the end address is 128. When reading data for the second time, taking the next bit of the end address of the first sub-data read last time as the start address of the first sub-data read currently, that is, the storage address corresponding to the first sub-data read for the second time may be 129-256.
In this embodiment, the first source operand is read cyclically and segmentally, and the next address of the last read end address of the first sub-data is used as the start address of the currently read first sub-data, so that the first storage device 13 is continuously read, and an exclusive function is realized.
In one embodiment, when the current operation result is stored in the first storage device 13, the storage address of the current operation result is consistent with the storage address of the currently read first sub-data. In this embodiment, the current operation result is stored in the position of the read first subdata, so that the accuracy of the data read in a segmented manner is ensured.
In one embodiment, after receiving the operation instruction, the operation circuit 12 can determine that the second source operand is an immediate or data stored in the second storage device 201 according to the operation instruction.
Specifically, when it is determined that the second source operand is an immediate according to the operation instruction, the operation circuit 12 sends a read-write request to the second storage device 201, the read-write circuit 203 sends the immediate to the operation circuit 12, the operation circuit 12 copies the immediate, and a plurality of immediate obtained after copying serve as second sub-data, where the number of the second sub-data is equal to the number of the currently read first sub-data.
For example, the number of the currently read first sub-data is 3 bytes, and when it is determined that the second source operand is an immediate, the second source operand may be a scalar, and assuming that the second source operand is 2, at this time, the immediate 2 is copied, and the immediate 2 of the 3 bytes is copied, that is, the second sub-data is {2,2,2 }.
When it is determined that the second source operand is data stored in the second storage device 201, the arithmetic circuit 12 sends a read-write request to the second storage device 201, and the read-write circuit 203 reads the second sub-data from the preset storage address of the second storage device 201, where the number of the currently read second sub-data is equal to the number of the first sub-data. See in particular the description above.
It should be understood that although the various steps in the flowcharts of fig. 6-10 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Also, at least some of the steps in fig. 6-10 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 11, there is provided an arithmetic device including: an obtaining module 100, a reading module 200, an operation module 300 and a counting module 400, wherein:
the obtaining module 100 is configured to obtain an operation instruction.
The reading module 200 is configured to read first subdata from a first storage device according to a data reading capacity and an operation instruction in a preset data reading manner, and store the currently read first subdata in a second storage device.
The operation module 300 is configured to execute an operation according to the operation instruction, obtain a current operation result, store the current operation result in the second storage device and the first storage device, and then circularly call the reading module 200 and the operation module 300 until the operation corresponding to the operation instruction is completed.
Further, the operation device may include a counting module 400 for controlling the counter to increment or decrement once after the current operation result in the second storage device is stored in the first storage device, and then, the reading module 200, the operation module 300, and the counting module 400 are called in a loop until the counter is incremented from the initial value to the target number of loops or the counter is decremented from the target number of loops to the initial value. In the embodiment of the present application, the initial value may be 0.
For the specific limitation of the operation device, reference may be made to the above limitation on the operation method, which is not described herein again. The modules in the computing device can be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
When the operation instruction is Atomic MAX _ VEC, the operation module 300 may include a two-purpose maximum operation module, wherein the obtaining module 100 is configured to obtain the operation instruction, where the operation instruction is used to implement a comparison operation between a first source operand and a second source operand, the first data includes first sub-data, and the second source operand includes second sub-data. The reading module 200 is configured to read first subdata from a first storage device according to a data reading capacity and an operation instruction in a preset data reading manner, and store the currently read first subdata into a second storage device, where the first storage device is an off-chip storage device and the second storage device is an on-chip storage device. The two-mesh maximum value operation module 301 is configured to obtain second sub data according to the operation instruction, determine whether the currently read first sub data is greater than or equal to the second sub data, store the obtained current comparison result in the second storage device and the first storage device, and then circularly call the reading module 200 and the two-mesh maximum value operation module 301 until the operation corresponding to the operation instruction is completed. Further, the operation device may include a counting module 400 for controlling the counter to increment or decrement once after the current operation result in the second storage device is stored in the first storage device, and then, the reading module 200, the two-mesh maximum value operation module 301 and the counting module 400 are called in a loop until the counter is incremented from the initial value to the target number of loops or the counter is decremented from the target number of loops to the initial value. In the embodiment of the present application, the initial value may be 0.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
and acquiring an operation instruction, wherein the operation instruction is used for realizing operation among source operands, and the first source operand comprises first subdata.
Reading first subdata from a first storage device according to the data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata into a second storage device; the first storage device 13 is an off-chip storage device, and the second storage device 201 is an on-chip storage device.
And executing the operation according to the operation instruction, and storing the obtained current operation result into the second storage device and the first storage device.
And then, returning to the step of reading the first subdata from the first storage device according to the data reading capacity and the operation instruction and a preset data reading mode until the operation corresponding to the operation instruction is completed.
It should be clear that, the steps implemented when the computer program in the embodiment of the present application is executed by the processor are consistent with the execution process of each step of the method in the above embodiments, and specific reference may be made to the above description, and no further description is given here.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (16)

1. A method of data processing, the method comprising:
the method comprises the steps of obtaining an operation instruction, wherein the operation instruction is used for realizing comparison operation of a first source operand and a second source operand, the first source operand comprises first subdata, and the second source operand comprises second subdata;
reading the first subdata from a first storage device according to data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata into a second storage device, wherein the first storage device is an off-chip storage device, and the second storage device is an on-chip storage device;
acquiring the second subdata according to the operation instruction, judging whether the currently read first subdata is larger than or equal to the second subdata, and storing the acquired current operation result into the second storage device and the first storage device;
and returning to the step of reading the first subdata from the first storage device according to the operation instruction and the data reading capacity and a preset data reading mode until the operation corresponding to the operation instruction is completed.
2. The data processing method according to claim 1, wherein the step of determining whether the currently read first sub-data is greater than or equal to the second sub-data according to the operation instruction to obtain a current comparison result comprises:
comparing the currently read first subdata with the second subdata in a contraposition mode, and judging whether the currently read first subdata is larger than or equal to the second subdata or not;
when the first subdata is larger than or equal to the second subdata, taking the first subdata as the current comparison result;
and when the first subdata is judged to be smaller than the second subdata, taking the second subdata as the current comparison result.
3. The method of claim 1 or 2, wherein the second source operand is an immediate or data stored in the second storage device, the method further comprising:
if the second source operand is an immediate, copying the immediate, copying a plurality of obtained immediate as second subdata, wherein the number of the second subdata is equal to that of the currently read first subdata;
and if the second source operand is data stored in the second storage device, reading the second subdata from a preset storage address of the second storage device, wherein the number of the currently read second subdata is equal to that of the first subdata.
4. A data processing method according to claim 3, characterized in that the method further comprises the steps of:
and taking the source operand A or the source operand B as the second source operand according to the operation instruction.
5. The data processing method according to claim 1, wherein the step of reading the first sub-data from the first storage device according to a preset data reading manner comprises:
and after the current comparison result is stored in the first storage device, taking the next address of the last read end address of the first sub-data as the start address of the currently read first sub-data.
6. The data processing method of claim 1, wherein the method further comprises:
and when the current comparison result is stored in the first storage device, the storage address of the current comparison result is consistent with the storage address of the currently read first subdata.
7. The data processing method of claim 1, wherein each time the current comparison result is stored in the first storage device, the method further comprises the steps of:
and controlling the counter to accumulate once or decrement once, and then returning to the step of reading the first subdata from the first storage device according to the operation instruction and the data reading capacity and a preset data reading mode until the counter accumulates to a target cycle number from an initial value or the counter decrements to the initial value from the target cycle number, so as to finish the operation corresponding to the operation instruction.
8. The data processing method of claim 7, wherein the method further comprises:
obtaining the data size of the first source operand according to the operation instruction;
and obtaining the target cycle number according to the data size of the first source operand and a preset splitting granularity.
9. The data processing method of claim 1,
the instruction format of the operation instruction comprises an instruction type, a first source operand, a second source operand, a target operand and an operation code;
the instruction type is used for determining whether the operation instruction is an atomic operation instruction;
the instruction type is used for determining the operation type of the operation instruction;
the operation code is used for configuring the number of source operands;
the first source operand and the second source operand are respectively used for representing data participating in operation;
the target operand is used to represent the current comparison result.
10. A processor is characterized by comprising an arithmetic circuit, a read-write circuit and a second storage device arranged adjacent to the arithmetic circuit, wherein the second storage device can be connected with a first storage device outside the processor through the read-write circuit;
the arithmetic circuit is used for acquiring an arithmetic instruction and sending a read-write request to the first storage device according to the arithmetic instruction;
the operation instruction is used for realizing comparison operation of a first source operand and a second source operand, wherein the first source operand comprises first sub-data, and the second source operand comprises second sub-data;
the read-write circuit is used for reading first subdata from the first storage device according to the read-write request and a preset data reading mode, and storing the first subdata to the second storage device;
the arithmetic circuit is used for acquiring the second subdata, judging whether the currently read first subdata is larger than or equal to the second subdata according to the arithmetic instruction, and storing the obtained current comparison result into the second storage device and the first storage device; and then, sending a read-write request to the first storage device again until the operation corresponding to the operation instruction is completed.
11. The processor of claim 10, further comprising a data selector, wherein the arithmetic circuit comprises a two-purpose maximum arithmetic module, the data selector is connected between the arithmetic circuit and the read/write circuit, and the data selector is configured to gate a connection path between the two-purpose maximum arithmetic module and the read/write circuit;
the two-view maximum operation module is used for acquiring the second subdata, judging whether the currently read first subdata is larger than or equal to the second subdata according to the operation instruction, and storing the obtained current comparison result into the second storage device and the first storage device.
12. The processor according to claim 11, wherein the binocular maximum operation module comprises an operation unit and a result output unit connected to the operation unit;
the arithmetic unit is used for comparing the currently read first subdata with the second subdata in a contraposition mode and judging whether the currently read first subdata is larger than or equal to the second subdata or not;
the result output unit is used for taking the first subdata as the current comparison result when the first subdata is larger than or equal to the second subdata;
and the result output unit is used for taking the second subdata as the current comparison result when the first subdata is judged to be smaller than the second subdata.
13. The processor of claim 11,
the maximum value operation module is further configured to determine, according to the operation instruction, that the second source operand is an immediate or data stored in the second storage device,
if the second source operand is determined to be an immediate, the two-mesh maximum operation module copies the immediate, a plurality of obtained immediate are copied to serve as second subdata, and the number of the second subdata is equal to the number of the currently read first subdata;
if the second source operand is determined to be the data stored in the second storage device, the read-write circuit reads the second subdata from a preset storage address of the second storage device, and the number of the currently read second subdata is equal to the number of the first subdata.
14. A processor according to any one of claims 10 to 13, wherein the arithmetic circuitry comprises a master processing circuit and at least one slave processing circuit, at least one of the slave processing circuits being connected to the master processing circuit;
the binocular maximum value operation module is arranged in the main processing circuit.
15. A data processing apparatus, characterized in that the apparatus comprises:
the system comprises an obtaining module, a comparing module and a comparing module, wherein the obtaining module is used for obtaining an operation instruction, the operation instruction is used for realizing comparison operation of a first source operand and a second source operand, the first source operand comprises first subdata, and the second source operand comprises second subdata;
the reading module is used for reading the first subdata from a first storage device according to data reading capacity and the operation instruction and a preset data reading mode, and storing the currently read first subdata into a second storage device, wherein the first storage device is an off-chip storage device, and the second storage device is an on-chip storage device;
the operation module is used for acquiring the second subdata according to the operation instruction, judging whether the currently read first subdata is larger than or equal to the second subdata, storing the obtained current comparison result into the second storage device and the first storage device, and then circularly calling the reading module, the operation module and the counting module until the operation corresponding to the operation instruction is completed.
16. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 9.
CN201811454790.5A 2018-11-30 2018-11-30 Data processing method, processor, data processing device and storage medium Active CN111258636B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811454790.5A CN111258636B (en) 2018-11-30 2018-11-30 Data processing method, processor, data processing device and storage medium
PCT/CN2019/121064 WO2020108496A1 (en) 2018-11-30 2019-11-26 Method and device for processing data in atomic operation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811454790.5A CN111258636B (en) 2018-11-30 2018-11-30 Data processing method, processor, data processing device and storage medium

Publications (2)

Publication Number Publication Date
CN111258636A true CN111258636A (en) 2020-06-09
CN111258636B CN111258636B (en) 2022-10-04

Family

ID=70953679

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811454790.5A Active CN111258636B (en) 2018-11-30 2018-11-30 Data processing method, processor, data processing device and storage medium

Country Status (1)

Country Link
CN (1) CN111258636B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06324900A (en) * 1993-05-10 1994-11-25 Mitsubishi Electric Corp Computer
JPH06348672A (en) * 1993-06-03 1994-12-22 Fuji Electric Co Ltd Monitoring method for shared memory
US5758195A (en) * 1989-11-17 1998-05-26 Texas Instruments Incorporated Register to memory data transfers with field extraction and zero/sign extension based upon size and mode data corresponding to employed address register
JP2003067010A (en) * 2001-08-22 2003-03-07 Toshiba Corp Bit arithmetic controller and programmable logic controller equipped with same
CN101213558A (en) * 2005-07-01 2008-07-02 Nxp股份有限公司 Integrated circuit and method of securing access to an on-chip memory
CN101685388A (en) * 2008-09-28 2010-03-31 北京大学深圳研究生院 Method and module for executing comparison operation
CN104536913A (en) * 2014-12-10 2015-04-22 山东华芯半导体有限公司 Big integer operational circuit based on a plurality of RAMs and data transfer method
US20170357512A1 (en) * 2016-06-14 2017-12-14 Imagination Technologies Limited Executing Memory Requests Out of Order
US20180011707A1 (en) * 2016-07-07 2018-01-11 Texas Instruments Incorporated Data processing apparatus having streaming engine with read and read/advance operand coding
CN107688853A (en) * 2016-08-05 2018-02-13 北京中科寒武纪科技有限公司 A kind of device and method for being used to perform neural network computing
CN108256643A (en) * 2016-12-29 2018-07-06 上海寒武纪信息科技有限公司 A kind of neural network computing device and method based on HMC
CN108268939A (en) * 2016-12-30 2018-07-10 上海寒武纪信息科技有限公司 For performing the device of LSTM neural network computings and operation method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5758195A (en) * 1989-11-17 1998-05-26 Texas Instruments Incorporated Register to memory data transfers with field extraction and zero/sign extension based upon size and mode data corresponding to employed address register
JPH06324900A (en) * 1993-05-10 1994-11-25 Mitsubishi Electric Corp Computer
JPH06348672A (en) * 1993-06-03 1994-12-22 Fuji Electric Co Ltd Monitoring method for shared memory
JP2003067010A (en) * 2001-08-22 2003-03-07 Toshiba Corp Bit arithmetic controller and programmable logic controller equipped with same
CN101213558A (en) * 2005-07-01 2008-07-02 Nxp股份有限公司 Integrated circuit and method of securing access to an on-chip memory
CN101685388A (en) * 2008-09-28 2010-03-31 北京大学深圳研究生院 Method and module for executing comparison operation
CN104536913A (en) * 2014-12-10 2015-04-22 山东华芯半导体有限公司 Big integer operational circuit based on a plurality of RAMs and data transfer method
US20170357512A1 (en) * 2016-06-14 2017-12-14 Imagination Technologies Limited Executing Memory Requests Out of Order
US20180011707A1 (en) * 2016-07-07 2018-01-11 Texas Instruments Incorporated Data processing apparatus having streaming engine with read and read/advance operand coding
CN107688853A (en) * 2016-08-05 2018-02-13 北京中科寒武纪科技有限公司 A kind of device and method for being used to perform neural network computing
CN108256643A (en) * 2016-12-29 2018-07-06 上海寒武纪信息科技有限公司 A kind of neural network computing device and method based on HMC
CN108268939A (en) * 2016-12-30 2018-07-10 上海寒武纪信息科技有限公司 For performing the device of LSTM neural network computings and operation method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SHAOLI LIU 等: "Cambricon: An Instruction Set Architecture for Neural Networks", 《2016 ACM/IEEE 43RD ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA)》 *

Also Published As

Publication number Publication date
CN111258636B (en) 2022-10-04

Similar Documents

Publication Publication Date Title
US7546393B2 (en) System for asynchronous DMA command completion notification wherein the DMA command comprising a tag belongs to a plurality of tag groups
US20190354500A1 (en) Multicore bus architecture with non-blocking high performance transaction credit system
CN107688854B (en) Arithmetic unit, method and device capable of supporting different bit width arithmetic data
CN105393240A (en) Method and apparatus for asynchronous processor with auxiliary asynchronous vector processor
KR20210106404A (en) System and method for generating and executing instructions for concurrent execution of instruction tasks
US5577256A (en) Data driven type information processor including a combined program memory and memory for queuing operand data
KR20180137521A (en) Apparatus and method for address conflict management in performing vector operations
CN111258646B (en) Instruction disassembly method, processor, instruction disassembly device and storage medium
CN111258644B (en) Data processing method, processor, data processing device and storage medium
CN111258636B (en) Data processing method, processor, data processing device and storage medium
CN111258637B (en) Data processing method, processor, data processing device and storage medium
WO1995028676A1 (en) Local semiautonomous dedicated-storage access for parallel processors
CN111258638B (en) Data processing method, processor, data processing device and storage medium
CN111258639B (en) Data processing method, processor, data processing device and storage medium
CN111258652B (en) Data processing method, processor, data processing device and storage medium
CN111258640B (en) Data processing method, processor, data processing device and storage medium
CN111258647B (en) Data processing method, processor, data processing device and storage medium
CN111258642B (en) Data processing method, processor, data processing device and storage medium
CN111258643B (en) Data processing method, processor, data processing device and storage medium
CN111258645B (en) Data processing method, processor, data processing device and storage medium
CN111258635B (en) Data processing method, processor, data processing device and storage medium
CN111258770B (en) Data processing method, processor, data processing device and storage medium
KR102145457B1 (en) Direction indicator
US8631173B2 (en) Semiconductor device
CN101484875A (en) Microprocessor and method for register addressing therein

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant