CN114217849B - Interpretation methods, devices and computer equipment for artificial intelligence model algorithms - Google Patents

Interpretation methods, devices and computer equipment for artificial intelligence model algorithms Download PDF

Info

Publication number
CN114217849B
CN114217849B CN202111313919.2A CN202111313919A CN114217849B CN 114217849 B CN114217849 B CN 114217849B CN 202111313919 A CN202111313919 A CN 202111313919A CN 114217849 B CN114217849 B CN 114217849B
Authority
CN
China
Prior art keywords
model algorithm
artificial intelligence
intelligence model
diagram
electromagnetic field
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111313919.2A
Other languages
Chinese (zh)
Other versions
CN114217849A (en
Inventor
刘滨
邓克俭
黄创绵
夏姗姗
张鹏南
李乃鑫
李丹扬
赖岸
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Electronic Product Reliability and Environmental Testing Research Institute
Original Assignee
China Electronic Product Reliability and Environmental Testing Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Electronic Product Reliability and Environmental Testing Research Institute filed Critical China Electronic Product Reliability and Environmental Testing Research Institute
Priority to CN202111313919.2A priority Critical patent/CN114217849B/en
Publication of CN114217849A publication Critical patent/CN114217849A/en
Application granted granted Critical
Publication of CN114217849B publication Critical patent/CN114217849B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/74Reverse engineering; Extracting design information from source code
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R29/00Arrangements for measuring or indicating electric quantities not covered by groups G01R19/00 - G01R27/00
    • G01R29/08Measuring electromagnetic field characteristics
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R29/00Arrangements for measuring or indicating electric quantities not covered by groups G01R19/00 - G01R27/00
    • G01R29/08Measuring electromagnetic field characteristics
    • G01R29/0864Measuring electromagnetic field characteristics characterised by constructional or functional features
    • G01R29/0871Complete apparatus or systems; circuits, e.g. receivers or amplifiers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3058Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Quality & Reliability (AREA)
  • Electromagnetism (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present application relates to a method, apparatus, computer device, storage medium and computer program product for interpretation of artificial intelligence model algorithms. The method comprises the following steps: the method comprises the steps of obtaining electromagnetic signals of a to-be-detected group and electromagnetic signals of a comparison group of a chip, obtaining an electromagnetic field evolution diagram corresponding to an artificial intelligent model algorithm in operation according to the electromagnetic signals of the to-be-detected group and the electromagnetic signals of the comparison group, obtaining a current signal change diagram corresponding to the artificial intelligent model algorithm in operation according to the electromagnetic field evolution diagram through a Maxwell equation set, and obtaining an operation logic diagram of the artificial intelligent model algorithm according to the current signal change diagram and by combining physical logic of the chip. Based on the obtained operation logic diagram of the artificial intelligence model algorithm, the operation logic of the artificial intelligence model algorithm can be clearly explained.

Description

人工智能模型算法的解释方法、装置和计算机设备Interpretation methods, devices and computer equipment for artificial intelligence model algorithms

技术领域Technical field

本申请涉及人工智能技术领域,特别是涉及一种人工智能模型算法的解释方法、装置、计算机设备、存储介质和计算机程序产品。This application relates to the field of artificial intelligence technology, and in particular to an interpretation method, device, computer equipment, storage medium and computer program product for an artificial intelligence model algorithm.

背景技术Background technique

随着人工智能技术的发展,人工智能模型算法日趋复杂,人工智能可解释性成为了帮助人类理解人工智能工作原理的有效手段,可解释性是人工智能系统决策机制能够被人类理解的程度,也是人工智能模型算法最难、最关键以及最热点的研究之一。With the development of artificial intelligence technology, artificial intelligence model algorithms are becoming increasingly complex. Artificial intelligence explainability has become an effective means to help humans understand the working principles of artificial intelligence. Explainability is the degree to which the decision-making mechanism of an artificial intelligence system can be understood by humans. It is also Artificial intelligence model algorithm is one of the most difficult, most critical and hottest research topics.

目前,对人工智能模型算法的可解释性的研究主要是从软件模型算法本身的角度出发构建等效模型或者进行局部解释的方法,然而,这种构建等效模型或者进行局部解释的方法,存在人工智能模型算法可解释性差的问题。At present, the research on the interpretability of artificial intelligence model algorithms is mainly based on the method of constructing equivalent models or performing local explanations from the perspective of the software model algorithm itself. However, this method of constructing equivalent models or performing local explanations has The problem of poor interpretability of artificial intelligence model algorithms.

发明内容Contents of the invention

基于此,有必要针对传统人工智能模型算法可解释性差的技术问题,提供一种人工智能模型算法的解释方法、装置、计算机设备、计算机可读存储介质和计算机程序产品,以清楚解释人工智能模型算法的运行逻辑。Based on this, it is necessary to provide an explanation method, device, computer equipment, computer readable storage medium and computer program product for the artificial intelligence model algorithm to clearly explain the artificial intelligence model in order to solve the technical problem of poor interpretability of the traditional artificial intelligence model algorithm. The operating logic of the algorithm.

第一方面,本申请提供了一种人工智能模型算法的解释方法。所述方法包括:In the first aspect, this application provides an explanation method for artificial intelligence model algorithms. The methods include:

获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号;Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group, where the electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm;

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图;According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained;

根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图;According to the electromagnetic field evolution diagram and through Maxwell's equations, the corresponding current signal change diagram when the artificial intelligence model algorithm is running is obtained;

根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Based on the current signal change diagram and combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

在其中一个实施例中,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图包括:In one embodiment, obtaining the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running based on the electromagnetic signals of the test group and the comparison group of electromagnetic signals includes:

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度;According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running is obtained;

根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图。According to the electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained.

在其中一个实施例中,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度包括:In one embodiment, based on the electromagnetic signals of the group to be measured and the electromagnetic signals of the comparison group, obtaining the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running includes:

根据待测组电磁信号,获得待测组随时间变化的电磁场强度;According to the electromagnetic signal of the group to be measured, the electromagnetic field intensity of the group to be measured changes with time;

根据对比组电磁信号,获得对比组随时间变化的电磁场强度;According to the electromagnetic signal of the comparison group, the electromagnetic field intensity of the comparison group changing with time is obtained;

将待测组随时间变化的电磁场强度与对比组随时间变化的电磁场强度相减,获得人工智能模型算法运行时对应的随时间变化的电磁场强度。Subtract the time-varying electromagnetic field intensity of the test group from the time-varying electromagnetic field intensity of the comparison group to obtain the corresponding time-varying electromagnetic field intensity when the artificial intelligence model algorithm is running.

在其中一个实施例中,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图包括:In one embodiment, according to the electromagnetic field evolution diagram and through Maxwell's equations, obtaining the corresponding current signal change diagram when the artificial intelligence model algorithm is running includes:

根据电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度;According to the electromagnetic field evolution diagram and through Maxwell's equations, the electric field intensity changing with time is obtained;

根据随时间变化的电场强度,获得随时间变化的电流;According to the electric field intensity that changes with time, the time-varying current is obtained;

根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图。According to the current changing with time, the corresponding current signal change diagram when the artificial intelligence model algorithm is running is obtained.

在其中一个实施例中,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图包括:In one embodiment, based on the current signal change diagram and combined with the physical logic of the chip, obtaining the operation logic diagram of the artificial intelligence model algorithm includes:

根据电流信号变化图,获得人工智能模型算法的初始运行逻辑;According to the current signal change diagram, the initial operating logic of the artificial intelligence model algorithm is obtained;

根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。Based on the initial operating logic and combined with the physical logic of the chip, the operating logic diagram of the artificial intelligence model algorithm is obtained.

在其中一个实施例中,人工智能模型算法的解释方法还包括:In one embodiment, the explanation method of the artificial intelligence model algorithm further includes:

分析运行逻辑图,获得人工智能模型算法的运行逻辑;Analyze the operation logic diagram to obtain the operation logic of the artificial intelligence model algorithm;

根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果。According to the operating logic of the artificial intelligence model algorithm, the interpretability results of the artificial intelligence model algorithm are obtained.

第二方面,本申请还提供了一种人工智能模型算法的解释装置。所述装置包括:In a second aspect, this application also provides an explanation device for artificial intelligence model algorithms. The device includes:

信号获取模块,用于获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号;The signal acquisition module is used to obtain the electromagnetic signal of the test group and the comparison group of the chip. The electromagnetic signal of the test group is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the comparison group electromagnetic signal is when the chip is not running the artificial intelligence model. Electromagnetic signals during algorithm;

电磁场演变图获取模块,用于根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图;The electromagnetic field evolution diagram acquisition module is used to obtain the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running based on the electromagnetic signals of the test group and the comparison group electromagnetic signals;

电流信号变化图获取模块,用于根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图;The current signal change diagram acquisition module is used to obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running based on the electromagnetic field evolution diagram and Maxwell's equations;

运行逻辑图获取模块,用于根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。The operation logic diagram acquisition module is used to obtain the operation logic diagram of the artificial intelligence model algorithm based on the current signal change diagram and the physical logic of the chip. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

第三方面,本申请还提供了一种计算机设备。所述计算机设备包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现以下步骤:In a third aspect, this application also provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group. The electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm. According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained. According to the electromagnetic field evolution diagram, Maxwell's equations are used to obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running. According to The current signal change diagram, combined with the physical logic of the chip, obtains the operation logic diagram of the artificial intelligence model algorithm. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

第四方面,本申请还提供了一种计算机可读存储介质。所述计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现以下步骤:In a fourth aspect, this application also provides a computer-readable storage medium. The computer-readable storage medium has a computer program stored thereon, and when the computer program is executed by the processor, the following steps are implemented:

获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group. The electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm. According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained. According to the electromagnetic field evolution diagram, Maxwell's equations are used to obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running. According to The current signal change diagram, combined with the physical logic of the chip, obtains the operation logic diagram of the artificial intelligence model algorithm. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

第五方面,本申请还提供了一种计算机程序产品。所述计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现以下步骤:In a fifth aspect, this application also provides a computer program product. The computer program product includes a computer program that implements the following steps when executed by a processor:

获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group. The electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm. According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained. According to the electromagnetic field evolution diagram, Maxwell's equations are used to obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running. According to The current signal change diagram, combined with the physical logic of the chip, obtains the operation logic diagram of the artificial intelligence model algorithm. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

上述人工智能模型算法的解释方法、装置、计算机设备、存储介质和计算机程序产品,通过获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。上述方案,通过获取芯片的电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,通过麦克斯韦方程组,获得电流信号变化图,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图,能够清楚解释人工智能模型算法的运行逻辑。The interpretation method, device, computer equipment, storage medium and computer program product of the above-mentioned artificial intelligence model algorithm obtains the electromagnetic signal of the group to be tested and the electromagnetic signal of the comparison group of the chip, where the electromagnetic signal of the group to be tested is the chip running the artificial intelligence model algorithm. The electromagnetic signal at the time, the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm. According to the electromagnetic signal of the group to be tested and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained. According to the electromagnetic field evolution Figure, through Maxwell's equations, obtains the corresponding current signal change diagram when the artificial intelligence model algorithm is running. According to the current signal change diagram, combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained. The operation logic diagram is used to explain artificial intelligence. The operating logic of the intelligent model algorithm. The above scheme obtains the electromagnetic field evolution diagram corresponding to the operation of the artificial intelligence model algorithm by obtaining the electromagnetic signal of the chip. Through Maxwell's equations, the current signal change diagram is obtained. Combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained. Ability to clearly explain the operating logic of artificial intelligence model algorithms.

附图说明Description of the drawings

图1为一个实施例中人工智能模型算法的解释方法的应用环境图;Figure 1 is an application environment diagram of the interpretation method of the artificial intelligence model algorithm in one embodiment;

图2为一个实施例中人工智能模型算法的解释方法的流程示意图;Figure 2 is a schematic flow chart of an explanation method of an artificial intelligence model algorithm in one embodiment;

图3为一个实施例中人工智能模型算法的解释步骤的流程示意图;Figure 3 is a schematic flow chart of the interpretation steps of the artificial intelligence model algorithm in one embodiment;

图4为另一个实施例中人工智能模型算法的解释方法的流程示意图;Figure 4 is a schematic flow chart of an interpretation method of an artificial intelligence model algorithm in another embodiment;

图5为一个实施例中人工智能模型算法的解释装置的结构框图;Figure 5 is a structural block diagram of an interpretation device for an artificial intelligence model algorithm in one embodiment;

图6为一个实施例中计算机设备的内部结构图。Figure 6 is an internal structure diagram of a computer device in one embodiment.

具体实施方式Detailed ways

为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application and are not used to limit the present application.

本申请实施例提供的人工智能模型算法的解释方法,可以应用于如图1所示的应用环境中。其中,终端102通过网络与芯片104进行通信。数据存储系统可以存储终端102需要处理的数据。数据存储系统可以集成在终端102上,也可以放在云上或其他网络服务器上。终端102通过获取芯片104的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片104运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片104不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片104的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。其中,终端102可以但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑、物联网设备和便携式可穿戴设备,物联网设备可为智能音箱、智能电视、智能空调、智能车载设备等。便携式可穿戴设备可为智能手表、智能手环、头戴设备等。The explanation method of the artificial intelligence model algorithm provided by the embodiment of the present application can be applied in the application environment as shown in Figure 1. Among them, the terminal 102 communicates with the chip 104 through the network. The data storage system may store data that terminal 102 needs to process. The data storage system can be integrated on the terminal 102, or placed on the cloud or other network servers. The terminal 102 obtains the electromagnetic signal of the test group and the comparison group electromagnetic signal of the chip 104. The electromagnetic signal of the group to be tested is the electromagnetic signal when the chip 104 is running the artificial intelligence model algorithm, and the comparison group electromagnetic signal is when the chip 104 is not running the artificial intelligence model. For the electromagnetic signal during the algorithm, based on the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the electromagnetic field evolution diagram corresponding to the operation of the artificial intelligence model algorithm is obtained. Based on the electromagnetic field evolution diagram, Maxwell's equations are used to obtain the electromagnetic field evolution diagram corresponding to the operation of the artificial intelligence model algorithm. The current signal change diagram is based on the current signal change diagram and combined with the physical logic of the chip 104 to obtain the operation logic diagram of the artificial intelligence model algorithm. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm. Among them, the terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablets, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart vehicle-mounted devices, etc. . Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc.

在一个实施例中,如图2所示,提供了一种人工智能模型算法的解释方法,以该方法应用于图1中的终端102为例进行说明,包括以下步骤:In one embodiment, as shown in Figure 2, a method for explaining an artificial intelligence model algorithm is provided. The method is explained by taking the method applied to the terminal 102 in Figure 1 as an example, and includes the following steps:

S200:获取芯片的待测组电磁信号和对比组电磁信号。S200: Obtain the electromagnetic signal of the test group and the comparison group electromagnetic signal of the chip.

其中,人工智能是能够模拟、延伸和扩展人类智能的理论、方法、技术及系统。人工智能模型算法如神经网络模型的发展受启发于脑神经科学的进步,因此,对于人工智能模型算法的可解释性问题,也可以参考脑功能机理的研究方法。脑功能机理的研究一般使用功能性核磁共振(fMRI)、脑电图(EEG)、脑磁图(MEG)等可以记录脑活动时的血流变化、或者脑电活跃的仪器,在被试执行一项实验任务的同时,将大脑活动的情况记录下来,并且通过图像呈现等开展研究。比如,在研究“人脸识别过程是否受到情绪影响”这一问题时,会设计一个包含识别不同表情人脸任务的实验。研究人员在请被试判断自己所看到的人脸图片是否属于某种情绪时,同时使用脑电图记录他们的大脑活跃情况,最后通过对比被试判断的正确率、时间以及脑电活跃的高低范围,来确定大脑中负责在人脸识别情绪判断的功能区及反应速度。参考人脑研究方法,人工智能模型算法相当于人脑的虚拟逻辑网络,承担人工智能模型算法运转计算的芯片相当于人脑的物理实体,获取芯片的电磁信号相当于记录人脑的活动情况。Among them, artificial intelligence is the theory, method, technology and system that can simulate, extend and expand human intelligence. The development of artificial intelligence model algorithms such as neural network models is inspired by the progress of brain neuroscience. Therefore, for the issue of interpretability of artificial intelligence model algorithms, we can also refer to the research methods of brain function mechanisms. Research on the mechanism of brain function generally uses functional magnetic resonance imaging (fMRI), electroencephalography (EEG), magnetoencephalography (MEG) and other instruments that can record blood flow changes during brain activity or brain electrical activity. While performing an experimental task, the brain activity is recorded and studied through image presentation. For example, when studying the question "whether the face recognition process is affected by emotion", an experiment will be designed that includes the task of identifying faces with different expressions. When the researchers asked subjects to judge whether the face pictures they saw belonged to a certain emotion, they also used electroencephalography to record their brain activity. Finally, they compared the accuracy, time and brain activity of the subjects' judgments. The high and low ranges are used to determine the functional area and reaction speed of the brain responsible for facial recognition and emotional judgment. Referring to human brain research methods, the artificial intelligence model algorithm is equivalent to the virtual logic network of the human brain. The chip responsible for the operation and calculation of the artificial intelligence model algorithm is equivalent to the physical entity of the human brain. Obtaining the electromagnetic signal of the chip is equivalent to recording the activities of the human brain.

具体地,获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,对比组实验条件除了不运行人工智能模型算法以外,其他条件与待测组完全相同。可选地,本方案中的芯片包含但不限于普通芯片或者人工智能芯片,为尽可能精准地获得电磁信号,芯片测试区域可设置电磁屏蔽装置,屏蔽测试区域的电磁场信号干扰。Specifically, the electromagnetic signals of the test group and the comparison group of the chip are obtained, where the electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the comparison group electromagnetic signal is when the chip is not running the artificial intelligence model algorithm. For electromagnetic signals, the experimental conditions of the comparison group are exactly the same as those of the test group except that the artificial intelligence model algorithm is not run. Optionally, the chips in this solution include but are not limited to ordinary chips or artificial intelligence chips. In order to obtain electromagnetic signals as accurately as possible, an electromagnetic shielding device can be set up in the chip test area to shield the electromagnetic field signal interference in the test area.

S400:根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图。S400: Based on the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, obtain the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running.

其中,人工智能模型算法按照模型训练方式不同分为监督学习、无监督学习、半监督学习和强化学习,举例而言,监督学习模型可以包括线性分类器模型(Linearclassifier)、支持向量机模型((Support Vector Machine)、朴素贝叶斯模型分类器(Naive Bayes Classifier)、K近邻模型(k-nearest neighbor)、决策树模型(DecisionTree)、线性回归模型(Linear Regression)、回归树模型(Regression Tree);而无监督学习模型主要包括:数据聚类模型(K-means)、数据降维模型(Principal ComponentAnalysis)。根据麦克斯韦方程电磁场理论,变化的磁场产生电场,变化的电场产生磁场,电荷周围空间存在电场,电荷运动使电场产生运动,所以运动电荷产生磁场,电流是电荷的流动,所以电流会产生磁场,恒定电流周围就会产生恒定不变的磁场,振荡电场产生振荡电场。根据获取的芯片运行人工智能模型算法时产生的电磁信号和芯片不运行人工智能算法时产生的电磁信号,进而得到人工智能模型算法运行时对应的电磁场演变图,用于反应人工智能模型算法运行规律,观察其变化的活跃程度,判断人工智能模型算法所调用的芯片资源的使用情况。Among them, artificial intelligence model algorithms are divided into supervised learning, unsupervised learning, semi-supervised learning and reinforcement learning according to different model training methods. For example, supervised learning models can include linear classifier models (Linear classifier), support vector machine models (( Support Vector Machine), Naive Bayes Classifier, K-nearest neighbor, DecisionTree, Linear Regression, Regression Tree ; The unsupervised learning model mainly includes: data clustering model (K-means), data dimensionality reduction model (Principal ComponentAnalysis). According to the electromagnetic field theory of Maxwell's equation, a changing magnetic field produces an electric field, a changing electric field produces a magnetic field, and the space around the charge exists Electric field, the movement of electric charges causes the electric field to move, so the moving charges produce a magnetic field. Current is the flow of charges, so the current will produce a magnetic field. A constant magnetic field will be produced around a constant current, and an oscillating electric field will produce an oscillating electric field. According to the obtained chip operation The electromagnetic signal generated when the artificial intelligence model algorithm is used and the electromagnetic signal generated when the chip is not running the artificial intelligence algorithm, and then the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained, which is used to reflect the operating rules of the artificial intelligence model algorithm and observe its changes. The activity level determines the usage of chip resources called by the artificial intelligence model algorithm.

具体地,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图。Specifically, based on the electromagnetic signals of the group to be measured and the electromagnetic signals of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained.

S600:根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图。S600: Based on the electromagnetic field evolution diagram and Maxwell's equations, obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running.

其中,当电场和磁场都随时间变化,由变化的电场激发的磁场和由变化的磁场激发的电场的总称为时变电磁场,时变电磁场之间相互激励而具有波动特性,时变电磁场遵守麦克斯韦方程。麦克斯韦方程组包括描述静电的高斯电场定律、描述静磁的高斯磁场定律、描述磁生电的法拉第定律和描述电生磁的安培-麦克斯韦定律,由麦克斯韦方程组可知,变化的磁场可以激发涡旋电场,变化的电场可以激发涡旋磁场,电场和磁场相互联系、相互激发组成一个统一的电磁场,通过磁场变化可以计算得出电场的变化,进而得到电流信号的变化图。Among them, when both the electric field and the magnetic field change with time, the magnetic field excited by the changing electric field and the electric field excited by the changing magnetic field are collectively called the time-varying electromagnetic field. The time-varying electromagnetic fields excite each other and have wave characteristics. The time-varying electromagnetic field obeys Maxwell's equation. Maxwell's equations include Gauss's electric field law that describes electrostatics, Gauss's magnetic field law that describes magnetostatics, Faraday's law that describes magnetism and electricity, and Ampere-Maxwell's law that describes electricity and magnetism. It can be seen from Maxwell's equations that changing magnetic fields can excite vortices. Electric field, the changing electric field can excite the vortex magnetic field. The electric field and the magnetic field are interconnected and excite each other to form a unified electromagnetic field. Through the change of the magnetic field, the change of the electric field can be calculated, and then the change diagram of the current signal can be obtained.

具体地,根据人工智能模型算法运行时对应的电磁场演变图,通过麦克斯韦方程组,可以获得人工智能模型算法运行时对应的电流信号变化图。Specifically, according to the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running, through Maxwell's equations, the corresponding current signal change diagram when the artificial intelligence model algorithm is running can be obtained.

S800:根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图。S800: Based on the current signal change diagram and combined with the physical logic of the chip, obtain the operation logic diagram of the artificial intelligence model algorithm.

其中,芯片是集成电路的载体,集成电路是由多个逻辑运算单元组成的大规模、高性能的计算模块,芯片的物理逻辑是指芯片中集成电路的各个物理逻辑单元。根据电流信号不同,芯片表现出0或1的运行逻辑,结合芯片的物理逻辑,可以获得人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Among them, the chip is the carrier of the integrated circuit, and the integrated circuit is a large-scale, high-performance computing module composed of multiple logical operation units. The physical logic of the chip refers to each physical logical unit of the integrated circuit in the chip. Depending on the current signal, the chip shows an operating logic of 0 or 1. Combined with the physical logic of the chip, the operating logic diagram of the artificial intelligence model algorithm can be obtained. The operating logic diagram is used to explain the operating logic of the artificial intelligence model algorithm.

具体地,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图。Specifically, based on the current signal change diagram and combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained.

上述人工智能模型算法的解释方法中,通过获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,能够清楚解释人工智能模型算法的运行逻辑。In the explanation method of the above artificial intelligence model algorithm, the electromagnetic signal of the test group and the comparison group electromagnetic signal of the chip are obtained. Among them, the electromagnetic signal of the group to be tested is the electromagnetic signal when the chip runs the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the chip. The electromagnetic signal when the artificial intelligence model algorithm is not running. According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained. According to the electromagnetic field evolution diagram, the artificial intelligence model is obtained through Maxwell's equations. The corresponding current signal change diagram when the algorithm is running. Based on the current signal change diagram and the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm can be obtained, which can clearly explain the operation logic of the artificial intelligence model algorithm.

在一个实施例中,如图3所示,S400根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图包括:In one embodiment, as shown in Figure 3, S400 obtains the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running based on the electromagnetic signals of the group to be measured and the electromagnetic signals of the comparison group, including:

S420:根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度。S420: According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, obtain the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running.

S440:根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图。S440: According to the electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running, obtain the electromagnetic field evolution diagram corresponding to when the artificial intelligence model algorithm is running.

本实施例中,根据获取的待测组芯片电磁信号和对比组芯片电磁信号,将电磁信号转化为电磁场强度随时间的变化函数,根据待测组电磁信号和对比组电磁信号,得到只反映人工智能模型算法运行时对应的随时间变化的电磁场强度。根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图,能够反映出人工智能模型算法的运行规律。In this embodiment, according to the acquired electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group chip, the electromagnetic signal is converted into a function of the change of the electromagnetic field intensity with time. The corresponding electromagnetic field intensity that changes with time when the intelligent model algorithm is running. According to the electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained, which can reflect the operating rules of the artificial intelligence model algorithm.

上述实施例的方案,通过待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度,根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图,能够为支持解释人工智能模型算法运行逻辑提供前提。According to the solution of the above embodiment, the electromagnetic field intensity corresponding to the time-changing electromagnetic field intensity when the artificial intelligence model algorithm is running is obtained through the electromagnetic signal of the test group and the comparison group electromagnetic signal. According to the electromagnetic field intensity corresponding to the time-varying electromagnetic field intensity when the artificial intelligence model algorithm is running, Obtaining the electromagnetic field evolution diagram corresponding to the operation of the artificial intelligence model algorithm can provide a prerequisite for supporting the explanation of the operation logic of the artificial intelligence model algorithm.

在另一个实施例中,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度包括:根据待测组电磁信号,获得待测组随时间变化的电磁场强度;根据对比组电磁信号,获得对比组随时间变化的电磁场强度;将待测组随时间变化的电磁场强度与对比组随时间变化的电磁场强度相减,获得人工智能模型算法运行时对应的随时间变化的电磁场强度。In another embodiment, according to the electromagnetic signal of the group to be measured and the electromagnetic signal of the comparison group, obtaining the electromagnetic field intensity corresponding to the time change when the artificial intelligence model algorithm is running includes: according to the electromagnetic signal of the group to be measured, obtaining the change of the group to be measured over time. The electromagnetic field intensity of the comparison group; according to the electromagnetic signal of the comparison group, obtain the electromagnetic field intensity of the comparison group that changes with time; subtract the electromagnetic field intensity that changes with time of the test group and the electromagnetic field intensity that changes with time of the comparison group to obtain the running time correspondence of the artificial intelligence model algorithm The intensity of the electromagnetic field that changes with time.

本实施例中,根据待测组电磁信号,获得待测组随时间变化的电磁场强度;根据对比组电磁信号,获得对比组随时间变化的电磁场强度,具体地,将待测组电磁信号转换为电磁场强度随时间的变化函数,获得待测组随时间变化的电磁场强度,将对比组电磁信号转换为电磁场强度随时间的变化函数,获得对比组随时间变化的电磁场强度,将芯片运行人工智能模型算法时的随时间变化的电磁场强度与芯片不运行人工智能模型算法时的随时间变化的电磁场强度相减,从而消除芯片本身运行时产生的电磁信号影响,获得只反映人工智能模型算法运行时对应的随时间变化的电磁场强度。In this embodiment, the electromagnetic field intensity of the group to be measured changes with time according to the electromagnetic signal of the group to be measured; the electromagnetic field intensity of the group to be measured changes with time is obtained based on the electromagnetic signal of the comparison group. Specifically, the electromagnetic signal of the group to be measured is converted into The electromagnetic field intensity changes with time as a function to obtain the electromagnetic field intensity of the group to be tested as the electromagnetic field intensity changes with time. Convert the electromagnetic signal of the comparison group into the electromagnetic field intensity with time changes as a function to obtain the electromagnetic field intensity of the comparison group with time. Run the artificial intelligence model on the chip. The time-varying electromagnetic field intensity during the algorithm is subtracted from the time-varying electromagnetic field intensity when the chip is not running the artificial intelligence model algorithm, thereby eliminating the influence of the electromagnetic signal generated when the chip itself is running, and obtaining a corresponding response that only reflects the running time of the artificial intelligence model algorithm. The intensity of the electromagnetic field that changes with time.

上述实施例的方案,通过将电磁信号转化为电磁场强度随时间的变化函数,根据待测组电磁信号和对比组电磁信号,得到只反映人工智能模型算法运行时对应的随时间变化的电磁场强度,能够为支持解释人工智能模型算法运行逻辑提供前提。According to the solution of the above embodiment, by converting the electromagnetic signal into a function of the change of the electromagnetic field intensity with time, based on the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the electromagnetic field intensity that only reflects the change with time corresponding to the running of the artificial intelligence model algorithm is obtained. It can provide a premise to support the explanation of the operating logic of artificial intelligence model algorithms.

在另一个实施例中,如图4所示,S600根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图包括:In another embodiment, as shown in Figure 4, S600 uses Maxwell's equations based on the electromagnetic field evolution diagram to obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running, including:

S620:根据电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度。S620: According to the electromagnetic field evolution diagram, obtain the electric field intensity changing with time through Maxwell's equations.

S640:根据随时间变化的电场强度,获得随时间变化的电流。S640: Obtain the time-varying current based on the time-varying electric field intensity.

S660:根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图。S660: According to the current changing with time, obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running.

本实施例中,根据麦克斯韦电磁场理论,由变化的磁场激发感应电场,感应电场时涡旋场,根据人工智能模型算法运行时对应的电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度,根据随时间变化的电场强度,正电荷朝电场线方向移动,负电荷朝电场相反的方向移动,电荷的定向移动形成电流,根据随时间变化的电场强度,获得随时间变化的电流,进一步地,根据随时间变化的电流,获得电流信号变化图,该电流信号变化图即为人工智能模型算法运行时对应的电流信号变化图。In this embodiment, according to Maxwell's electromagnetic field theory, the changing magnetic field excites the induced electric field. The induced electric field is the vortex field. According to the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running, the electric field intensity changing with time is obtained through Maxwell's equations. , according to the electric field intensity that changes with time, the positive charges move in the direction of the electric field line, and the negative charges move in the opposite direction of the electric field. The directional movement of the charges forms a current. According to the electric field intensity that changes with time, a time-varying current is obtained, and further , based on the current changing with time, a current signal change diagram is obtained, which is the corresponding current signal change diagram when the artificial intelligence model algorithm is running.

上述实施例的方案,通过麦克斯韦方程组,根据电磁场演变图,获得随时间变化的电场强度,根据随时间变化的电场强度,获得随时间变化的电流,根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图,能够为支持解释人工智能模型算法运行逻辑提供前提。According to the solution of the above embodiment, Maxwell's equations are used to obtain the electric field intensity that changes with time according to the electromagnetic field evolution diagram. According to the electric field intensity that changes with time, the current that changes with time is obtained. According to the current that changes with time, the artificial intelligence model is obtained. The corresponding current signal change diagram when the algorithm is running can provide a prerequisite for supporting the explanation of the operation logic of the artificial intelligence model algorithm.

在另一个实施例中,S800根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图包括:根据电流信号变化图,获得人工智能模型算法的初始运行逻辑;根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。In another embodiment, S800 obtains the operation logic diagram of the artificial intelligence model algorithm based on the current signal change diagram and the physical logic of the chip, including: obtaining the initial operation logic of the artificial intelligence model algorithm according to the current signal change diagram; Logic, combined with the physical logic of the chip, obtains the operating logic diagram of the artificial intelligence model algorithm.

本实施例中,根据人工智能模型算法运行时对应的电流信号变化图,得出人工智能模型算法的初始运行逻辑,例如,电流信号为0,表示芯片中某个PN结不导通,人工智能模型算法在该处未执行,电流信号为1,表示该PN结导通,人工智能模型算法该处被执行。根据人工智能模型算法的初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。In this embodiment, the initial operation logic of the artificial intelligence model algorithm is obtained based on the corresponding current signal change diagram when the artificial intelligence model algorithm is running. For example, if the current signal is 0, it means that a certain PN junction in the chip is not conducting, and the artificial intelligence model algorithm The model algorithm is not executed here, and the current signal is 1, indicating that the PN junction is conductive, and the artificial intelligence model algorithm is executed here. According to the initial operation logic of the artificial intelligence model algorithm and the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained.

上述实施例的方案,根据电流信号变化图,获得人工智能模型算法的初始运行逻辑,根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图,能够支持解释人工智能模型算法运行逻辑。According to the solution of the above embodiment, the initial operation logic of the artificial intelligence model algorithm is obtained based on the current signal change diagram. Based on the initial operation logic and combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained, which can support the interpretation of the artificial intelligence model algorithm. Run logic.

在另一个实施例中,人工智能模型算法的解释还包括:分析运行逻辑图,获得人工智能模型算法的运行逻辑,根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果。In another embodiment, the explanation of the artificial intelligence model algorithm also includes: analyzing the operation logic diagram to obtain the operation logic of the artificial intelligence model algorithm, and obtaining the interpretability result of the artificial intelligence model algorithm based on the operation logic of the artificial intelligence model algorithm.

本实施例中,根据获得的人工智能模型算法的运行逻辑图,分析人工智能模型算法的输出结果和运行逻辑,评估该算法的学习推理决策过程,形成人工智能模型算法的可解释性结果。In this embodiment, based on the obtained operating logic diagram of the artificial intelligence model algorithm, the output results and operating logic of the artificial intelligence model algorithm are analyzed, the learning reasoning and decision-making process of the algorithm is evaluated, and the interpretable results of the artificial intelligence model algorithm are formed.

上述实施例的方案,通过分析运行逻辑图,获得人工智能模型算法的运行逻辑,根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果,能够达到支持解释人工智能模型算法的运行逻辑的效果。According to the solution of the above embodiment, the operation logic of the artificial intelligence model algorithm is obtained by analyzing the operation logic diagram. According to the operation logic of the artificial intelligence model algorithm, the interpretability result of the artificial intelligence model algorithm is obtained, which can support the explanation of the operation of the artificial intelligence model algorithm. logical effect.

为详细说明本方案中人工智能模型算法的解释方法及效果,下面以一个最详细实施例进行说明:In order to explain in detail the explanation method and effect of the artificial intelligence model algorithm in this solution, the following is a most detailed example:

采用50微米*50微米的正方形电磁探头采集芯片的电磁信号,将探头阵列平行覆盖于正在运行的芯片上,探头阵列距离芯片表面的高度保持不变,电磁探头所对应的芯片区域设置电磁屏蔽装置,分别设置待测组和对比组,其中,待测组测试芯片运行人工智能模型算法时的电磁信号,对比组测试芯片不运行人工智能模型算法时的电磁信号,对比组除了不运行人工智能模型算法外,其他条件与待测组一致。获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。根据待测组电磁信号,获得待测组随时间变化的电磁场强度,根据对比组电磁信号,获得对比组随时间变化的电磁场强度,将待测组随时间变化的电磁场强度与对比组随时间变化的电磁场强度相减,获得人工智能模型算法运行时对应的随时间变化的电磁场强度,根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图。根据电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度,根据随时间变化的电场强度,获得随时间变化的电流,根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,获得人工智能模型算法的初始运行逻辑,根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。分析运行逻辑图,获得人工智能模型算法的运行逻辑,根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果。Use a 50 micron * 50 micron square electromagnetic probe to collect the electromagnetic signal of the chip. The probe array is covered in parallel on the running chip. The height of the probe array from the chip surface remains unchanged. An electromagnetic shielding device is installed in the chip area corresponding to the electromagnetic probe. , set up the test group and the comparison group respectively. Among them, the test group tests the electromagnetic signal when the chip runs the artificial intelligence model algorithm, and the comparison group tests the electromagnetic signal when the chip does not run the artificial intelligence model algorithm. The comparison group does not run the artificial intelligence model. Except for the algorithm, other conditions are consistent with the test group. Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group. The electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm. According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained. According to the electromagnetic field evolution diagram, Maxwell's equations are used to obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running. According to The current signal change diagram, combined with the physical logic of the chip, obtains the operation logic diagram of the artificial intelligence model algorithm. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm. According to the electromagnetic signal of the group to be tested, the electromagnetic field intensity of the group to be tested is obtained as time changes. According to the electromagnetic signal of the comparison group, the electromagnetic field intensity of the comparison group is obtained as time changes. Subtract the electromagnetic field intensity to obtain the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running. According to the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running, obtain the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running. . According to the electromagnetic field evolution diagram and through Maxwell's equations, the electric field intensity that changes with time is obtained. According to the electric field intensity that changes with time, the current that changes with time is obtained. According to the current that changes with time, the corresponding current when the artificial intelligence model algorithm is running is obtained. Signal change diagram: According to the current signal change diagram, the initial operation logic of the artificial intelligence model algorithm is obtained. Based on the initial operation logic, combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained. Analyze the operation logic diagram to obtain the operation logic of the artificial intelligence model algorithm. According to the operation logic of the artificial intelligence model algorithm, obtain the interpretability results of the artificial intelligence model algorithm.

上述实施例的方案,通过获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,能够清楚解释人工智能模型算法的运行逻辑。The solution of the above embodiment is to obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group. The electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running artificial intelligence. For the electromagnetic signal during model algorithm, based on the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the electromagnetic field evolution diagram corresponding to the running time of the artificial intelligence model algorithm is obtained. According to the electromagnetic field evolution diagram, Maxwell's equations are used to obtain the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running. According to the current signal change diagram, combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm can be obtained, which can clearly explain the operation logic of the artificial intelligence model algorithm.

应该理解的是,虽然如上所述的各实施例所涉及的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,如上所述的各实施例所涉及的流程图中的至少一部分步骤可以包括多个步骤或者多个阶段,这些步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the steps in the flowcharts involved in the above-mentioned embodiments are shown in sequence as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated in this article, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flowcharts involved in the above embodiments may include multiple steps or stages. These steps or stages are not necessarily executed at the same time, but may be completed at different times. The execution order of these steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

基于同样的发明构思,本申请实施例还提供了一种用于实现上述所涉及的人工智能模型算法的解释方法的人工智能模型算法的解释装置。该装置所提供的解决问题的实现方案与上述方法中所记载的实现方案相似,故下面所提供的一个或多个人工智能模型算法的解释装置实施例中的具体限定可以参见上文中对于人工智能模型算法的解释方法的限定,在此不再赘述。Based on the same inventive concept, embodiments of the present application also provide an artificial intelligence model algorithm interpretation device for implementing the above-mentioned artificial intelligence model algorithm interpretation method. The implementation scheme for solving the problem provided by this device is similar to the implementation scheme recorded in the above method. Therefore, the specific limitations in the device embodiments for explaining one or more artificial intelligence model algorithms provided below can be found in the above article on artificial intelligence. The limitations of the interpretation method of the model algorithm will not be repeated here.

在一个实施例中,如图5所示,提供了一种人工智能模型算法的解释装置500,包括:信号获取模块520、电磁场演变图获取模块540、电流信号变化图获取模块560和运行逻辑图获取模块580,其中:In one embodiment, as shown in Figure 5, an artificial intelligence model algorithm interpretation device 500 is provided, including: a signal acquisition module 520, an electromagnetic field evolution diagram acquisition module 540, a current signal change diagram acquisition module 560 and an operation logic diagram. Get module 580, which:

信号获取模块520,用于获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号;The signal acquisition module 520 is used to obtain the electromagnetic signals of the test group and the comparison group of electromagnetic signals of the chip. The electromagnetic signals of the group to be tested are the electromagnetic signals when the chip is running the artificial intelligence model algorithm, and the comparison group electromagnetic signals are when the chip is not running artificial intelligence. Electromagnetic signals during model algorithm;

电磁场演变图获取模块540,用于根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图;The electromagnetic field evolution diagram acquisition module 540 is used to obtain the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running based on the electromagnetic signals of the group to be measured and the electromagnetic signals of the comparison group;

电流信号变化图获取模块560,用于根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图;The current signal change diagram acquisition module 560 is used to obtain the corresponding current signal change diagram when the artificial intelligence model algorithm is running based on the electromagnetic field evolution diagram and Maxwell's equations;

运行逻辑图获取模块580,用于根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。The operation logic diagram acquisition module 580 is used to obtain the operation logic diagram of the artificial intelligence model algorithm based on the current signal change diagram and the physical logic of the chip. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

上述人工智能模型算法的解释装置中,通过获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号,根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图,根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图,根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,能够清楚解释人工智能模型算法的运行逻辑。In the device for interpreting the above-mentioned artificial intelligence model algorithm, the electromagnetic signal of the group to be tested and the electromagnetic signal of the comparison group are obtained by The electromagnetic signal when the artificial intelligence model algorithm is not running. According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained. According to the electromagnetic field evolution diagram, the artificial intelligence model is obtained through Maxwell's equations. The corresponding current signal change diagram when the algorithm is running. Based on the current signal change diagram and the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm can be obtained, which can clearly explain the operation logic of the artificial intelligence model algorithm.

在一个实施例中,电磁场演变图获取模块540还用于根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度;根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图。In one embodiment, the electromagnetic field evolution diagram acquisition module 540 is also used to obtain the electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running based on the electromagnetic signal of the group to be measured and the electromagnetic signal of the comparison group; according to the running time of the artificial intelligence model algorithm The corresponding electromagnetic field intensity changes with time, and the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained.

在一个实施例中,电磁场演变图获取模块540还用于根据待测组电磁信号,获得待测组随时间变化的电磁场强度;根据对比组电磁信号,获得对比组随时间变化的电磁场强度;将待测组随时间变化的电磁场强度与对比组随时间变化的电磁场强度相减,获得人工智能模型算法运行时对应的随时间变化的电磁场强度。In one embodiment, the electromagnetic field evolution diagram acquisition module 540 is also used to obtain the electromagnetic field intensity of the group to be measured that changes with time based on the electromagnetic signal of the group to be measured; and based on the electromagnetic signal of the comparison group, obtain the electromagnetic field intensity that changes with time of the comparison group; The time-varying electromagnetic field intensity of the test group is subtracted from the time-varying electromagnetic field intensity of the comparison group to obtain the corresponding time-varying electromagnetic field intensity when the artificial intelligence model algorithm is running.

在一个实施例中,电流信号变化图获取模块560还用于根据电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度;根据随时间变化的电场强度,获得随时间变化的电流;根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图。In one embodiment, the current signal change diagram acquisition module 560 is also used to obtain the electric field intensity changing with time according to the electromagnetic field evolution diagram through Maxwell's equations; according to the electric field intensity changing with time, obtain the current changing with time; according to The current changes with time, and the corresponding current signal change diagram is obtained when the artificial intelligence model algorithm is running.

在一个实施例中,运行逻辑图获取模块580还用于根据电流信号变化图,获得人工智能模型算法的初始运行逻辑;根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。In one embodiment, the operation logic diagram acquisition module 580 is also used to obtain the initial operation logic of the artificial intelligence model algorithm based on the current signal change diagram; and obtain the operation logic of the artificial intelligence model algorithm based on the initial operation logic, combined with the physical logic of the chip. picture.

在一个实施例中,人工智能模型算法的解释装置500还用于分析运行逻辑图,获得人工智能模型算法的运行逻辑;根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果。In one embodiment, the artificial intelligence model algorithm interpretation device 500 is also used to analyze the operation logic diagram to obtain the operation logic of the artificial intelligence model algorithm; and obtain the interpretability results of the artificial intelligence model algorithm based on the operation logic of the artificial intelligence model algorithm.

上述人工智能模型算法的解释装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。Each module in the interpretation device of the above-mentioned artificial intelligence model algorithm can be implemented in whole or in part by software, hardware, and combinations thereof. Each of the above modules may be embedded in or independent of the processor of the computer device in the form of hardware, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

在一个实施例中,提供了一种计算机设备,该计算机设备可以是服务器,其内部结构图可以如图6所示。该计算机设备包括通过系统总线连接的处理器、存储器和网络接口。其中,该计算机设备的处理器用于提供计算和控制能力。In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. 6 . The computer device includes a processor, memory, and network interfaces connected through a system bus. Wherein, the processor of the computer device is used to provide computing and control capabilities.

该计算机设备的存储器包括非易失性存储介质和内存储器。该非易失性存储介质存储有操作系统、计算机程序和数据库。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的数据库用于存储人工智能模型算法运行时对应的电磁场演变图、电流信号变化图以及运行逻辑图。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时以实现一种人工智能模型算法的解释方法。The memory of the computer device includes non-volatile storage media and internal memory. The non-volatile storage medium stores operating systems, computer programs and databases. This internal memory provides an environment for the execution of operating systems and computer programs in non-volatile storage media. The database of the computer equipment is used to store the corresponding electromagnetic field evolution diagram, current signal change diagram and operation logic diagram when the artificial intelligence model algorithm is running. The network interface of the computer device is used to communicate with external terminals through a network connection. The computer program, when executed by the processor, implements an interpretation method of an artificial intelligence model algorithm.

本领域技术人员可以理解,图6中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定,具体的计算机设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in Figure 6 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied. Specific computer equipment can May include more or fewer parts than shown, or combine certain parts, or have a different arrangement of parts.

在一个实施例中,提供了一种计算机设备,包括存储器和处理器,存储器中存储有计算机程序,该处理器执行计算机程序时实现以下步骤:In one embodiment, a computer device is provided, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, it implements the following steps:

获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号;Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group, where the electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm;

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图;According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained;

根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图;According to the electromagnetic field evolution diagram and through Maxwell's equations, the corresponding current signal change diagram when the artificial intelligence model algorithm is running is obtained;

根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Based on the current signal change diagram and combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

在一个实施例中,处理器执行计算机程序时还实现以下步骤:In one embodiment, the processor also implements the following steps when executing the computer program:

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度,根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图。According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running is obtained. According to the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running, the artificial intelligence model algorithm operation is obtained. The electromagnetic field evolution diagram corresponding to time.

在一个实施例中,处理器执行计算机程序时还实现以下步骤:In one embodiment, the processor also implements the following steps when executing the computer program:

根据待测组电磁信号,获得待测组随时间变化的电磁场强度,根据对比组电磁信号,获得对比组随时间变化的电磁场强度,将待测组随时间变化的电磁场强度与对比组随时间变化的电磁场强度相减,获得人工智能模型算法运行时对应的随时间变化的电磁场强度。According to the electromagnetic signal of the group to be tested, the electromagnetic field intensity of the group to be tested is obtained as time changes. According to the electromagnetic signal of the comparison group, the electromagnetic field intensity of the comparison group is obtained as time changes. The electromagnetic field intensity is subtracted to obtain the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running.

在一个实施例中,处理器执行计算机程序时还实现以下步骤:In one embodiment, the processor also implements the following steps when executing the computer program:

根据电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度,根据随时间变化的电场强度,获得随时间变化的电流,根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图。According to the electromagnetic field evolution diagram and through Maxwell's equations, the electric field intensity that changes with time is obtained. According to the electric field intensity that changes with time, the current that changes with time is obtained. According to the current that changes with time, the corresponding current when the artificial intelligence model algorithm is running is obtained. Signal change graph.

在一个实施例中,处理器执行计算机程序时还实现以下步骤:In one embodiment, the processor also implements the following steps when executing the computer program:

根据电流信号变化图,获得人工智能模型算法的初始运行逻辑,根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。According to the current signal change diagram, the initial operating logic of the artificial intelligence model algorithm is obtained. Based on the initial operating logic and combined with the physical logic of the chip, the operating logic diagram of the artificial intelligence model algorithm is obtained.

在一个实施例中,处理器执行计算机程序时还实现以下步骤:In one embodiment, the processor also implements the following steps when executing the computer program:

分析运行逻辑图,获得人工智能模型算法的运行逻辑,根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果。Analyze the operation logic diagram to obtain the operation logic of the artificial intelligence model algorithm. According to the operation logic of the artificial intelligence model algorithm, obtain the interpretability results of the artificial intelligence model algorithm.

在一个实施例中,提供了一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现以下步骤:In one embodiment, a computer-readable storage medium is provided with a computer program stored thereon. When the computer program is executed by a processor, the following steps are implemented:

获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号;Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group, where the electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm;

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图;According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained;

根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图;According to the electromagnetic field evolution diagram and through Maxwell's equations, the corresponding current signal change diagram when the artificial intelligence model algorithm is running is obtained;

根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Based on the current signal change diagram and combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度,根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图。According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running is obtained. According to the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running, the artificial intelligence model algorithm operation is obtained. The electromagnetic field evolution diagram corresponding to time.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据待测组电磁信号,获得待测组随时间变化的电磁场强度,根据对比组电磁信号,获得对比组随时间变化的电磁场强度,将待测组随时间变化的电磁场强度与对比组随时间变化的电磁场强度相减,获得人工智能模型算法运行时对应的随时间变化的电磁场强度。According to the electromagnetic signal of the group to be tested, the electromagnetic field intensity of the group to be tested is obtained as time changes. According to the electromagnetic signal of the comparison group, the electromagnetic field intensity of the comparison group is obtained as time changes. The electromagnetic field intensity is subtracted to obtain the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度,根据随时间变化的电场强度,获得随时间变化的电流,根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图。According to the electromagnetic field evolution diagram and through Maxwell's equations, the electric field intensity that changes with time is obtained. According to the electric field intensity that changes with time, the current that changes with time is obtained. According to the current that changes with time, the corresponding current when the artificial intelligence model algorithm is running is obtained. Signal change graph.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据电流信号变化图,获得人工智能模型算法的初始运行逻辑,根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。According to the current signal change diagram, the initial operating logic of the artificial intelligence model algorithm is obtained. Based on the initial operating logic and combined with the physical logic of the chip, the operating logic diagram of the artificial intelligence model algorithm is obtained.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

分析运行逻辑图,获得人工智能模型算法的运行逻辑,根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果。Analyze the operation logic diagram to obtain the operation logic of the artificial intelligence model algorithm. According to the operation logic of the artificial intelligence model algorithm, obtain the interpretability results of the artificial intelligence model algorithm.

在一个实施例中,提供了一种计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现以下步骤:In one embodiment, a computer program product is provided, comprising a computer program that when executed by a processor implements the following steps:

获取芯片的待测组电磁信号和对比组电磁信号,其中,待测组电磁信号为芯片运行人工智能模型算法时的电磁信号,对比组电磁信号为芯片不运行人工智能模型算法时的电磁信号;Obtain the electromagnetic signal of the chip to be tested and the electromagnetic signal of the comparison group, where the electromagnetic signal of the group to be tested is the electromagnetic signal when the chip is running the artificial intelligence model algorithm, and the electromagnetic signal of the comparison group is the electromagnetic signal when the chip is not running the artificial intelligence model algorithm;

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的电磁场演变图;According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field evolution diagram when the artificial intelligence model algorithm is running is obtained;

根据电磁场演变图,通过麦克斯韦方程组,获得人工智能模型算法运行时对应的电流信号变化图;According to the electromagnetic field evolution diagram and through Maxwell's equations, the corresponding current signal change diagram when the artificial intelligence model algorithm is running is obtained;

根据电流信号变化图,结合芯片的物理逻辑,获取人工智能模型算法的运行逻辑图,运行逻辑图用于解释人工智能模型算法的运行逻辑。Based on the current signal change diagram and combined with the physical logic of the chip, the operation logic diagram of the artificial intelligence model algorithm is obtained. The operation logic diagram is used to explain the operation logic of the artificial intelligence model algorithm.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据待测组电磁信号和对比组电磁信号,获得人工智能模型算法运行时对应的随时间变化的电磁场强度,根据人工智能模型算法运行时对应的随时间变化的电磁场强度,获得人工智能模型算法运行时对应的电磁场演变图。According to the electromagnetic signal of the test group and the electromagnetic signal of the comparison group, the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running is obtained. According to the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running, the artificial intelligence model algorithm operation is obtained. The electromagnetic field evolution diagram corresponding to time.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据待测组电磁信号,获得待测组随时间变化的电磁场强度,根据对比组电磁信号,获得对比组随时间变化的电磁场强度,将待测组随时间变化的电磁场强度与对比组随时间变化的电磁场强度相减,获得人工智能模型算法运行时对应的随时间变化的电磁场强度。According to the electromagnetic signal of the group to be tested, the electromagnetic field intensity of the group to be tested is obtained as time changes. According to the electromagnetic signal of the comparison group, the electromagnetic field intensity of the comparison group is obtained as time changes. The electromagnetic field intensity is subtracted to obtain the corresponding electromagnetic field intensity that changes with time when the artificial intelligence model algorithm is running.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据电磁场演变图,通过麦克斯韦方程组,获得随时间变化的电场强度,根据随时间变化的电场强度,获得随时间变化的电流,根据随时间变化的电流,获得人工智能模型算法运行时对应的电流信号变化图。According to the electromagnetic field evolution diagram and through Maxwell's equations, the electric field intensity that changes with time is obtained. According to the electric field intensity that changes with time, the current that changes with time is obtained. According to the current that changes with time, the corresponding current when the artificial intelligence model algorithm is running is obtained. Signal change graph.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

根据电流信号变化图,获得人工智能模型算法的初始运行逻辑,根据初始运行逻辑,结合芯片的物理逻辑,获得人工智能模型算法的运行逻辑图。According to the current signal change diagram, the initial operating logic of the artificial intelligence model algorithm is obtained. Based on the initial operating logic and combined with the physical logic of the chip, the operating logic diagram of the artificial intelligence model algorithm is obtained.

在一个实施例中,计算机程序被处理器执行时还实现以下步骤:In one embodiment, the computer program, when executed by the processor, also implements the following steps:

分析运行逻辑图,获得人工智能模型算法的运行逻辑,根据人工智能模型算法的运行逻辑,获得人工智能模型算法可解释性结果。Analyze the operation logic diagram to obtain the operation logic of the artificial intelligence model algorithm. According to the operation logic of the artificial intelligence model algorithm, obtain the interpretability results of the artificial intelligence model algorithm.

需要说明的是,本申请所涉及的用户信息(包括但不限于用户设备信息、用户个人信息等)和数据(包括但不限于用于分析的数据、存储的数据、展示的数据等),均为经用户授权或者经过各方充分授权的信息和数据。It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all It is information and data authorized by the user or fully authorized by all parties.

本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、数据库或其它介质的任何引用,均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器(Read-OnlyMemory,ROM)、磁带、软盘、闪存、光存储器、高密度嵌入式非易失性存储器、阻变存储器(ReRAM)、磁变存储器(Magnetoresistive Random Access Memory,MRAM)、铁电存储器(Ferroelectric Random Access Memory,FRAM)、相变存储器(Phase Change Memory,PCM)、石墨烯存储器等。易失性存储器可包括随机存取存储器(Random Access Memory,RAM)或外部高速缓冲存储器等。作为说明而非局限,RAM可以是多种形式,比如静态随机存取存储器(Static Random Access Memory,SRAM)或动态随机存取存储器(Dynamic RandomAccess Memory,DRAM)等。本申请所提供的各实施例中所涉及的数据库可包括关系型数据库和非关系型数据库中至少一种。非关系型数据库可包括基于区块链的分布式数据库等,不限于此。本申请所提供的各实施例中所涉及的处理器可为通用处理器、中央处理器、图形处理器、数字信号处理器、可编程逻辑器、基于量子计算的数据处理逻辑器等,不限于此。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage. In the media, when executed, the computer program may include the processes of the above method embodiments. Any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetic variable memory (Magnetoresistive Random) Access Memory (MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (PCM), graphene memory, etc. Volatile memory may include random access memory (Random Access Memory, RAM) or external cache memory. By way of illustration but not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM). The databases involved in the various embodiments provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include blockchain-based distributed databases, etc., but are not limited thereto. The processors involved in the various embodiments provided in this application may be general-purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to this.

以上实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined in any way. To simplify the description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, all possible combinations should be used. It is considered to be within the scope of this manual.

以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请的保护范围应以所附权利要求为准。The above-described embodiments only express several implementation modes of the present application, and their descriptions are relatively specific and detailed, but should not be construed as limiting the patent scope of the present application. It should be noted that, for those of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all fall within the protection scope of the present application. Therefore, the scope of protection of this application should be determined by the appended claims.

Claims (7)

1. A method of interpretation of an artificial intelligence model algorithm, the method comprising:
acquiring electromagnetic signals to be tested of a chip and electromagnetic signals of a comparison group, wherein the electromagnetic signals to be tested are electromagnetic signals when the chip runs an artificial intelligent model algorithm, and the electromagnetic signals of the comparison group are electromagnetic signals when the chip does not run the artificial intelligent model algorithm;
Obtaining the electromagnetic field intensity of the group to be tested, which changes along with time, according to the electromagnetic signals of the group to be tested; obtaining the electromagnetic field intensity of the contrast group changing along with time according to the electromagnetic signals of the contrast group; subtracting the time-varying electromagnetic field intensity of the to-be-detected group from the time-varying electromagnetic field intensity of the comparison group to obtain the corresponding time-varying electromagnetic field intensity when the artificial intelligent model algorithm operates; obtaining an electromagnetic field evolution diagram corresponding to the artificial intelligence model algorithm according to the electromagnetic field intensity corresponding to the artificial intelligence model algorithm during operation and changing along with time;
according to the electromagnetic field evolution diagram, obtaining a corresponding current signal variation diagram when an artificial intelligent model algorithm operates through a Maxwell equation set;
and according to the current signal change diagram, combining the physical logic of the chip to obtain an operation logic diagram of the artificial intelligent model algorithm, wherein the operation logic diagram is used for explaining the operation logic of the artificial intelligent model algorithm.
2. The interpretation method of artificial intelligence model algorithm as claimed in claim 1, wherein obtaining a current signal variation map corresponding to the operation of artificial intelligence model algorithm through maxwell's equations based on the electromagnetic field evolution map comprises:
According to the electromagnetic field evolution diagram, obtaining the electric field intensity changing along with time through a Maxwell equation set;
obtaining a current which changes with time according to the electric field intensity which changes with time;
and obtaining a corresponding current signal change diagram when the artificial intelligent model algorithm operates according to the current changing along with time.
3. The method of claim 2, wherein obtaining an operational logic map of an artificial intelligence model algorithm based on the current signal variation map in combination with physical logic of the chip comprises:
obtaining initial operation logic of an artificial intelligent model algorithm according to the current signal change diagram;
and according to the initial operation logic, combining the physical logic of the chip to obtain an operation logic diagram of an artificial intelligent model algorithm.
4. The method of interpretation of an artificial intelligence model algorithm of claim 1, further comprising:
analyzing the operation logic diagram to obtain operation logic of an artificial intelligent model algorithm;
and obtaining an interpretive result of the artificial intelligent model algorithm according to the operation logic of the artificial intelligent model algorithm.
5. An interpretation apparatus for an artificial intelligence model algorithm, the apparatus comprising:
the signal acquisition module is used for acquiring electromagnetic signals of a group to be detected and electromagnetic signals of a comparison group of chips, wherein the electromagnetic signals of the group to be detected are electromagnetic signals when the chips run an artificial intelligent model algorithm, and the electromagnetic signals of the comparison group are electromagnetic signals when the chips do not run the artificial intelligent model algorithm;
the electromagnetic field evolution diagram acquisition module is used for acquiring the electromagnetic field intensity of the to-be-measured group changing along with time according to the electromagnetic signals of the to-be-measured group; obtaining the electromagnetic field intensity of the contrast group changing along with time according to the electromagnetic signals of the contrast group; subtracting the time-varying electromagnetic field intensity of the to-be-detected group from the time-varying electromagnetic field intensity of the comparison group to obtain the corresponding time-varying electromagnetic field intensity when the artificial intelligent model algorithm operates; obtaining an electromagnetic field evolution diagram corresponding to the artificial intelligence model algorithm according to the electromagnetic field intensity corresponding to the artificial intelligence model algorithm during operation and changing along with time;
the current signal change diagram acquisition module is used for acquiring a corresponding current signal change diagram when the artificial intelligent model algorithm operates through a Maxwell equation set according to the electromagnetic field evolution diagram;
And the operation logic diagram acquisition module is used for acquiring an operation logic diagram of the artificial intelligent model algorithm according to the current signal change diagram and combining the physical logic of the chip, and the operation logic diagram is used for explaining the operation logic of the artificial intelligent model algorithm.
6. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 4 when the computer program is executed.
7. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 4.
CN202111313919.2A 2021-11-08 2021-11-08 Interpretation methods, devices and computer equipment for artificial intelligence model algorithms Active CN114217849B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111313919.2A CN114217849B (en) 2021-11-08 2021-11-08 Interpretation methods, devices and computer equipment for artificial intelligence model algorithms

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111313919.2A CN114217849B (en) 2021-11-08 2021-11-08 Interpretation methods, devices and computer equipment for artificial intelligence model algorithms

Publications (2)

Publication Number Publication Date
CN114217849A CN114217849A (en) 2022-03-22
CN114217849B true CN114217849B (en) 2023-11-07

Family

ID=80696637

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111313919.2A Active CN114217849B (en) 2021-11-08 2021-11-08 Interpretation methods, devices and computer equipment for artificial intelligence model algorithms

Country Status (1)

Country Link
CN (1) CN114217849B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112347679A (en) * 2020-11-16 2021-02-09 北京环境特性研究所 Metamaterial simulation method and device with electromagnetic dispersion
CN112527281A (en) * 2020-12-17 2021-03-19 北京百度网讯科技有限公司 Operator upgrading method and device based on artificial intelligence, electronic equipment and medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050246114A1 (en) * 2004-04-29 2005-11-03 Rannow Randy K In-line field sensor
US11016740B2 (en) * 2019-02-25 2021-05-25 Atos Syntel, Inc. Systems and methods for virtual programming by artificial intelligence

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112347679A (en) * 2020-11-16 2021-02-09 北京环境特性研究所 Metamaterial simulation method and device with electromagnetic dispersion
CN112527281A (en) * 2020-12-17 2021-03-19 北京百度网讯科技有限公司 Operator upgrading method and device based on artificial intelligence, electronic equipment and medium

Also Published As

Publication number Publication date
CN114217849A (en) 2022-03-22

Similar Documents

Publication Publication Date Title
Akbari et al. Depression recognition based on the reconstruction of phase space of EEG signals and geometrical features
Craddock et al. Connectomics and new approaches for analyzing human brain functional connectivity
Rué-Queralt et al. Decoding brain states on the intrinsic manifold of human brain dynamics across wakefulness and sleep
Peng et al. Self-weighted semi-supervised classification for joint EEG-based emotion recognition and affective activation patterns mining
Nikolaidis et al. Augmenting physiological time series data: A case study for sleep apnea detection
Razavian et al. Artificial intelligence explained for nonexperts
Chen et al. DNNBrain: a unifying toolbox for mapping deep neural networks and brains
Bahrami et al. Brain network analysis: A review on multivariate analytical methods
Dózsa et al. Variable projection support vector machines and some applications using adaptive hermite expansions
Ferrari et al. On the homogenization of heterogeneous inertial-based databases for human activity recognition
Hou et al. Rolling bearing fault diagnosis method by using feature extraction of convolutional time-frequency image
CN114217849B (en) Interpretation methods, devices and computer equipment for artificial intelligence model algorithms
Xie et al. Wavelet kernel principal component analysis in noisy multiscale data classification
Senthil et al. High-Performance Intelligent System for Real-Time Medical Image Using Deep Learning and Augmented Reality
Kotlar Handbook of research on methodologies and applications of supercomputing
Lee et al. Neural decoding on imbalanced calcium imaging data with a network of support vector machines
Sinha et al. Noise processing and diagnostics of a spintronic-based IOT sensor for magnetocardiography application using SpintronCardioNet
Batta et al. SVR-based Multimodal Active Subspace Analysis for the Brain using Neuroimaging Data
Agcaoglu et al. A Multi-dimensional Joint ICA Model with Gaussian Copula
Gu et al. Capped L21-norm-based common spatial patterns for EEG signals classification applicable to BCI systems
Li An intelligent computer-aided analysis framework for the impact of PTSD on rescuers based on EEG signal visualization algorithm
Mathur et al. Weighted vector visibility based graph signal processing (WVV-GSP) for neural decoding of motor imagery EEG signals
Capriglione et al. Measurement and Applications: Artificial Intelligence in the Field of Measurement Applications
Gao et al. A new feature extraction and recognition method for microexpression based on local non-negative matrix factorization
Batta et al. Multimodal active subspace analysis for computing assessment oriented subspaces from neuroimaging data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant