WO2020133324A1 - Procédés et appareils de construction d'application d'intelligence artificielle et de mise en œuvre opérationnelle, et dispositif de machine - Google Patents

Procédés et appareils de construction d'application d'intelligence artificielle et de mise en œuvre opérationnelle, et dispositif de machine Download PDF

Info

Publication number
WO2020133324A1
WO2020133324A1 PCT/CN2018/125255 CN2018125255W WO2020133324A1 WO 2020133324 A1 WO2020133324 A1 WO 2020133324A1 CN 2018125255 W CN2018125255 W CN 2018125255W WO 2020133324 A1 WO2020133324 A1 WO 2020133324A1
Authority
WO
WIPO (PCT)
Prior art keywords
artificial intelligence
intelligence application
user
mathematical
blocks
Prior art date
Application number
PCT/CN2018/125255
Other languages
English (en)
Chinese (zh)
Inventor
薛俊恩
谈国禹
Original Assignee
深圳砥脊科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳砥脊科技有限公司 filed Critical 深圳砥脊科技有限公司
Priority to CN201880002692.XA priority Critical patent/CN111819536A/zh
Priority to PCT/CN2018/125255 priority patent/WO2020133324A1/fr
Publication of WO2020133324A1 publication Critical patent/WO2020133324A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs

Definitions

  • the present invention relates to the field of Internet application technology, and in particular, to a method for building an artificial intelligence application, a method, a device, and a machine for implementing an operation in building an artificial intelligence application.
  • the present invention provides a method for building artificial intelligence applications, a method for implementing operation in the construction of artificial intelligence applications, Devices and machinery.
  • a method for building an artificial intelligence application includes:
  • the block is a graphical representation of the corresponding mathematical primitive
  • An operation implementation method in building an artificial intelligence application includes:
  • the server receives the character string corresponding to the dictionary, and the dictionary corresponding to the character string is used to describe the block configured for the construction of the artificial intelligence application;
  • the artificial intelligence application that the user chooses to build runs on the server.
  • An artificial intelligence application building device including:
  • the instruction receiving module is used to receive a selection instruction of a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive.
  • Construction module for configuring configuration blocks for building artificial intelligence applications in the construction area of the graphical interface through the selection instruction, and linking the blocks to form an artificial intelligence algorithm structure for artificial intelligence applications built under user control type.
  • the conversion module is used to convert the included chunks to the dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters, the core parameters corresponding to the chunks Configured.
  • the decoding initiation module is used to initiate decoding of the artificial intelligence application built by the user to the server through the dictionary, and trigger the artificial intelligence application to run on the server.
  • An operation realization device in the construction of manual and intelligent applications including:
  • the character receiving module is used for building an artificial intelligence application selected by the user, and the server receives a character string corresponding to a dictionary, and the dictionary corresponding to the character string is used to describe a block configured for building the artificial intelligence application.
  • the decoding module is used for decoding the character string to obtain the executable text of the artificial intelligence application.
  • An execution module is configured to enable the artificial intelligence application selected by the user to run on the server through execution of the executable text.
  • a machine equipment including:
  • a memory on which computer-readable instructions are stored, which when executed by the processor implements the method described above.
  • users will freely build artificial intelligence applications in the construction area of the graphical interface.
  • the block is The graphical representation of the corresponding mathematical primitives, and then configure the building blocks for the construction of artificial intelligence applications in the construction area of the graphical interface by selecting instructions, and link the blocks to form the artificial intelligence algorithm configuration of artificial intelligence applications built under user control ,
  • the conversion of the included chunks to the dictionary is obtained to obtain the dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters.
  • the core parameters are corresponding to the chunk configuration, and finally through the dictionary to the server Initiating the decoding of the artificial intelligence application built by the user can trigger the artificial intelligence application to run on the server, thereby satisfying the given artificial intelligence application needs, and implementing the artificial intelligence application for the user through the component corresponding to the mathematical primitive Since the obtained artificial intelligence applications are configured according to real needs, the blocks can be accurately adapted to the real needs. With the free configuration of the blocks, the WYSIWYG artificial intelligence applications are realized, which enhances the construction of artificial intelligence applications. Interactive performance, and lowered the threshold.
  • FIG. 1 is a schematic diagram of an implementation environment involved in the present invention
  • Fig. 2 is a block diagram of an apparatus according to an exemplary embodiment
  • Fig. 3 is a flowchart of a method for building an artificial intelligence application according to an exemplary embodiment
  • FIG. 4 is a flowchart illustrating step 330 according to the embodiment corresponding to FIG. 3;
  • FIG. 5 is a flowchart illustrating step 350 according to the embodiment corresponding to FIG. 3;
  • FIG. 6 is a flowchart illustrating step 370 according to the embodiment corresponding to FIG. 3;
  • Fig. 7 is a flowchart of a method for building an artificial intelligence application according to another exemplary embodiment
  • step 470 shown in another exemplary embodiment according to the corresponding embodiment of FIG. 7;
  • step 430 is a flowchart illustrating step 430 according to the embodiment corresponding to FIG. 7;
  • Fig. 10 is a flowchart of a method for implementing operation in building an artificial intelligence application according to an exemplary embodiment
  • FIG. 11 is a flowchart illustrating step 530 according to the embodiment corresponding to FIG. 10;
  • step 533 is a flowchart illustrating step 533 according to the embodiment corresponding to FIG. 11;
  • Fig. 13 is a schematic diagram showing a DAG structure corresponding to a simple mathematical primitive according to an exemplary embodiment
  • step 550 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10;
  • step 550 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10 in another exemplary embodiment
  • step 551b is a flowchart illustrating step 551b according to the embodiment corresponding to FIG. 15;
  • 17 is a flowchart of a method for implementing operation in building an artificial intelligence application shown in another exemplary embodiment
  • Fig. 18 is a schematic diagram of a graphical interface according to an exemplary embodiment
  • Fig. 19 is a schematic diagram of a block corresponding to a convolutional neural network operation on an operation interface according to an exemplary embodiment
  • FIG. 20 is a schematic diagram of block distribution and linking of a three-layer convolutional neural network on an operation interface according to the corresponding embodiment of FIG. 19;
  • 21 is a schematic diagram of interaction between the front end and the back end involved in the present invention according to an exemplary embodiment
  • Fig. 23 is a block diagram of a device for building an artificial intelligence application according to an exemplary embodiment
  • Fig. 24 is a block diagram of a device for implementing operation in building an artificial intelligence application according to an exemplary embodiment.
  • FIG. 1 is a schematic diagram of an implementation environment involved in the present invention.
  • the implementation environment includes a user terminal 110 and a server 130 configured in the background.
  • the user terminals 110 are not limited to a single number, that is to say, all kinds of users can interact with the server 130 through the held user terminals 110 to realize the construction of the artificial intelligence application of the present invention and the operation of the built artificial intelligence application.
  • the server 130 is accessed by the user terminal 110 for building artificial intelligence applications and running the built artificial intelligence applications.
  • the server 130 will be oriented to massive user terminals 110, and any user can freely build artificial intelligence applications and use the built artificial intelligence applications as long as they can access the server 130.
  • the threshold of the artificial intelligence application is effectively lowered, and the user will be able to immediately build and run the artificial intelligence application according to the artificial intelligence application demand generated by the user.
  • the user is provided with a platform capable of building the required artificial intelligence application at any time, but it is not limited to this, no matter whether it is an enterprise user or an end user, it no longer needs to be very expensive for their own needs. Independent development of artificial intelligence applications at cost.
  • Fig. 2 is a block diagram of a device according to an exemplary embodiment.
  • the device 200 may be the user terminal 110 in the implementation environment shown in FIG. 1.
  • the user terminal 110 is a terminal device held by a user such as a smart phone or a tablet computer, various cameras, and the like.
  • the device 200 includes at least the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, a sensor component 214 and a communication component 216.
  • the processing component 202 generally controls the overall operations of the device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 202 includes at least one or more processors 218 to execute instructions to complete all or part of the steps of the method described below.
  • the processing component 202 includes at least one or more modules to facilitate interaction between the processing component 202 and other components.
  • the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
  • the memory 204 is configured to store various types of data to support operation at the device 200. Examples of these data include instructions for any application or method operating on the device 200.
  • the memory 204 is implemented by at least any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM for short), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), read-only memory ( Read-Only Memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
  • One or more modules are also stored in the memory 204, and the one or more modules are configured to be executed by the one or more processors 218 to complete all or any of the methods shown in any of the following FIGS. 3 to 17 Partial steps.
  • the power supply component 206 provides power to various components of the device 200.
  • the power component 206 includes at least a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 200.
  • the multimedia component 208 includes a screen that provides an output interface between the device 200 and the user.
  • the screen may include a liquid crystal display (Liquid Crystal) (LCD for short) and a touch panel. If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or sliding action, but also detect the duration and pressure related to the touch or sliding operation.
  • the screen also includes Organic Light Emitting Display (Organic Light Emitting Display, OLED for short).
  • the audio component 210 is configured to output and/or input audio signals.
  • the audio component 210 includes a microphone (Microphone, MIC for short).
  • the microphone is configured to receive an external audio signal.
  • the received audio signal may be further stored in the memory 204 or sent via the communication component 216.
  • the audio component 210 further includes a speaker for outputting audio signals.
  • the sensor assembly 214 includes one or more sensors for providing the device 200 with status assessments in various aspects. For example, the sensor assembly 214 detects the on/off state of the device 200, the relative positioning of the components, and the sensor assembly 214 also detects a change in the position of the device 200 or one component of the device 200 and a change in the temperature of the device 200. In some embodiments, the sensor assembly 214 further includes a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices.
  • the device 200 accesses a wireless network based on a communication standard, such as WiFi (WIreless-Fidelity, wireless fidelity).
  • the communication component 216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short-range communication.
  • NFC Near Field Communication
  • the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth technology and other technologies. .
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • the apparatus 200 is controlled by one or more application specific integrated circuits (Application Specific Integrated Circuit (ASIC for short), digital signal processor, digital signal processing device, programmable logic device, field programmable gate array, control A microcontroller, microcontroller, microprocessor or other electronic component is implemented to perform the following method.
  • ASIC Application Specific Integrated Circuit
  • Fig. 3 is a flowchart of a method for building an artificial intelligence application according to an exemplary embodiment.
  • the method for building an artificial intelligence application includes at least the following steps.
  • step 310 a selection instruction for a block on the graphical interface is received, and the block is a graphical representation of the corresponding mathematical primitive.
  • the graphical interface is a user interface that can be used for free construction of artificial intelligence applications.
  • the artificial intelligence application construction refers to the configuration of the sequential execution of mathematical operations involved.
  • the mathematical operations configured to perform constitute the algorithm implementation of artificial intelligence applications , And then realize artificial intelligence applications that meet the set requirements.
  • the graphical interface includes an operation component selection bar, an operation interface, a toolbar, and an operation result display area.
  • the selection command applied to the block is triggered in the selection bar of the operation component.
  • the operation component selection bar includes a large number of blocks that can be selected, and these blocks correspond to the initially configured model and/or data. The user can complete the selection of the corresponding block by triggering an operation on the block and generating a selection instruction for the block, so that the selected block is configured on the operation interface.
  • the operation component selection bar on the one hand, it will be used to select the mathematical primitives involved for the currently built artificial intelligence application.
  • the mathematical primitives can be integrated models, on the other hand, they can also be built artificial intelligence.
  • the application selects the data used for the iterative training. No matter what kind of selection, it will exist in the form of a block on the selection bar of the operating component of the graphical interface.
  • the operation interface that is, the building area on the graphical interface is used to place the selected blocks for the construction of artificial intelligence applications, and these blocks will be placed under the control of the user to achieve the building.
  • the block in the operation component selection bar is triggered, it is placed on the operation interface.
  • the block in the operation component selection bar can be dragged to the operation interface by a drag operation applied to the block.
  • the block dragged to the operation interface is used for manual operation Smart application building.
  • a set of blocks corresponds to a set model or data, which is a graphical representation of the set model or data.
  • the set model can be a single mathematical operation, or a model realized by integrating more than two mathematical operations, whether it is a single mathematical operation or the integration of more than two mathematical operations, it is the integration of input, output and mathematical operations
  • the formed complex is an independent unit, also called a mathematical primitive.
  • Mathematical primitives correspond to chunks. Mathematical primitives are configured on the operation interface through chunks according to the algorithms involved in the artificial intelligence applications.
  • the mathematical primitives corresponding to chunks define mathematical operations on a level. Of course, with different levels, at a more subdivided level, the mathematical operations defined by the mathematical primitives will be subdivided, so that the block corresponds to several mathematical operations. Mathematical primitives will define the mathematical operations corresponding to the chunk from the input, output and the mathematical operations performed. In the construction of the artificial intelligence application, along with the configuration of the block, the configuration of the mathematical primitives involved in the artificial intelligence application is carried out, in order to deploy the mathematical operations performed in the constructed artificial intelligence application, and for the execution of each mathematical operation Control its input and output.
  • the toolbar on the graphical interface is used in the construction of artificial intelligence applications to adjust the corresponding data and models for the configured blocks, for example, to fine-tune the data and models.
  • the operation result display area on the graphical interface is used to display the results after the built artificial intelligence application runs. For example, after iterative training is performed on the currently built artificial intelligence application, the corresponding iterative training situation and the classification effect that can be obtained are displayed in the operation result display area.
  • the block configured in the building area is used. For the construction of artificial intelligence applications.
  • the blocks configured in the building area are the blocks selected for the artificial intelligence application currently built.
  • the mathematical primitives corresponding to the selected blocks will be used to form the current building.
  • the built artificial intelligence application for the artificial intelligence application construction, has realized the WYSIWYG artificial intelligence application construction, whether it is the degree of freedom or the self-adaptability of the built artificial intelligence application, can be enhanced.
  • the graphical interface is configured for the user to initialize the building blocks for artificial intelligence applications, that is, building the optional blocks for the current artificial intelligence applications.
  • the dragging on the required selected blocks Drag operation, selection operation, etc. have been able to achieve the construction area, that is, as mentioned above, the addition of the selected block on the operation interface, that is to say, will follow the selection instruction of the block on the graphical interface
  • the block selected by the user is configured in the building area.
  • the selection instruction indicates the block selected by the user.
  • the block is a graphical representation of the corresponding mathematical primitive. Therefore, the corresponding mathematical primitive identifier can be used to uniquely identify the block.
  • the selection instruction carries the mathematical primitive identifier to indicate the user's selection. And execute the corresponding response for this.
  • the process of realizing the construction of the artificial intelligence application will receive a selection instruction for the corresponding block on the graphical interface.
  • selection instructions corresponding to different chunks will be continuously received.
  • step 310 includes: among the several blocks of the initial configuration of the graphical interface, a user's operation applied to the chunk receives the instruction to select the chunks on the graphical interface until the artificial intelligence application is implemented All blocks are selected.
  • the graphical interface is initially configured with a large number of blocks, for example, the existence of blocks in the operation component selection bar. Users can continue to apply user operations to the required blocks according to the needs of artificial intelligence application building, such as dragging operations to the building area, so as to generate selection instructions for the continuously selected blocks, and the corresponding process will continue to receive To the generated selection instruction until all the required blocks are selected.
  • step 330 the configuration block of the artificial intelligence application is configured in the construction area of the graphical interface by selecting instructions, and the blocks are mutually linked to form an artificial intelligence algorithm configuration of the artificial intelligence application built under user control.
  • the building block for the artificial intelligence application is continuously configured in the construction area of the graphical interface, and the configured block corresponds to the mathematical primitive identifier carried in the selection instruction.
  • the building blocks of the graphical interface are configured with blocks corresponding to the involved mathematical primitives for artificial intelligence applications, and thus there are more than two blocks in the building area of the graphical interface.
  • the artificial intelligence algorithm configuration is a network topology that describes the mathematical operations performed in artificial intelligence applications, in other words, the network topology formed by the deployed mathematical primitives.
  • the output of the previous mathematical primitive will be used as the input of the next mathematical primitive, and so on to form the entire artificial intelligence algorithm configuration.
  • the artificial intelligence algorithm configuration exists in the form of a graph, that is, it may be in the form of an artificial intelligence algorithm configuration graph.
  • the configuration of the artificial intelligence algorithm indicates the blocks included in the constructed network topology and the link relationship between the contained blocks.
  • step 350 according to the configuration of the artificial intelligence algorithm, the included chunks are converted into dictionaries to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunks and the core parameters, the core parameters corresponding to the chunk configuration.
  • the configuration of the artificial intelligence algorithm indicates the blocks included in the network topology of the currently built artificial intelligence application and the link relationship between the blocks, and the blocks correspond to mathematical primitives, so
  • the conversion of chunks into dictionaries according to the configuration of artificial intelligence algorithms is the transformation of chunks into dictionary data.
  • the obtained dictionary data is used to form a dictionary for realizing artificial intelligence applications.
  • the dictionary data will be generated for the chunks to realize the conversion of the chunks contained in the artificial intelligence algorithm configuration to the dictionary.
  • the dictionary data generated for the chunks are used to indicate the corresponding mathematical primitives, and input and output control of the mathematical primitives are performed.
  • the configuration of the artificial intelligence algorithm is oriented to the network topology formed by the blocks, and the mathematical primitive identification and the core parameters configured for the mathematical primitive are obtained according to the mathematical primitives corresponding to the chunk, and the mathematical primitive identification For index items, the core parameter is the index value to construct the dictionary data corresponding to this group of blocks, and so on, the dictionary data corresponding to all the groups of blocks constitute the dictionary of the artificial intelligence application.
  • the core parameters correspond to the identification of mathematical primitives, that is, the core parameters are configured for the corresponding mathematical primitives.
  • the core parameters configured corresponding to the mathematical primitives will be obtained by fine-tuning the data and models of the corresponding components in the construction area on the toolbar.
  • the core parameters corresponding to mathematical primitives include key data such as hyperparameters, input dimensions, and output dimensions applicable to the model.
  • the configuration of the core parameters will ensure the smooth execution of the mathematical operations defined by the corresponding mathematical primitives.
  • step 370 the decoding of the artificial intelligence application built by the user is initiated to the server through the dictionary, and the artificial intelligence application is triggered to run on the server.
  • the decoding of the built artificial intelligence application can be initiated to the server through the dictionary to trigger the operation of the artificial intelligence application on the server.
  • the dictionary is obtained by the user building the artificial intelligence application, which will enable the server to obtain the built artificial intelligence application in the form of a dictionary through the mathematical primitive identification and core parameters of the included dictionary data records.
  • an artificial intelligence application based on a graphical interface is built on the user side realized by the user terminal, that is, graphical programming, and after the user completes the construction of the artificial intelligence application, the built artificial intelligence application uses block-oriented
  • the dictionary generated by the corresponding mathematical primitives enables the user to build the artificial intelligence application that can be learned by the server and then runs on the server to meet the user's artificial intelligence needs and obtain what the built artificial intelligence application can provide. Function.
  • the exemplary embodiment described above is to encapsulate the algorithms involved in artificial intelligence applications, that is, mathematical operations and their input and output into mathematical primitives, to present to the user in the form of chunks, on the basis of which the graphical interface The construction of the application of artificial intelligence was carried out.
  • FIG. 4 is a flowchart illustrating step 330 according to the embodiment corresponding to FIG. 3.
  • this step 330 is shown in FIG. 4 and includes at least:
  • step 331 the block indicated by the selection instruction is placed in the construction area of the graphical interface.
  • the building area will be configured with blocks according to the received selection instruction, so that the block indicated by the selection instruction is added to the construction area of the graphical interface.
  • step 331 is a step-by-step process of adding the required mathematical primitives for the currently built artificial intelligence application, in order to finally construct the artificial intelligence algorithm configuration that realizes the artificial intelligence application, that is, the artificial intelligence application corresponding mathematical basis Meta network topology.
  • step 333 the corresponding core parameters are obtained for the blocks placed in the building area.
  • the selection instruction is continuously triggered and generated, so that the group selected by the user can be continuously added in the building area.
  • the corresponding core parameters can be configured and adjusted to be suitable for the artificial intelligence applications currently built.
  • the configuration and adjustment of the core parameters of the corresponding mathematical primitives are performed. After the configuration and adjustment of the core parameters of the group of blocks, other The core parameter configuration and adjustment of the block.
  • the core parameter configuration and adjustment of the block can be initiated by selecting the block in the construction area. Specifically, after selecting a group of blocks in the construction area, the toolbar on the graphical interface is used to configure and adjust the core parameters of this group of blocks. At this time, the user only needs to set parameters on this toolbar Configuration and adjustment.
  • the core parameters include the hyperparameters used by the model in the mathematical primitives as well as the input and output dimensions.
  • the transformation of the link relationship of the corresponding chunks not only needs to transform the other chunks linked by the chunks in the building area, but also should adapt to the mathematical primitives of the linked chunks and adjust the input dimension and/or output dimension to adapt to the dynamics Changed artificial intelligence application building.
  • step 333 includes: selecting the block for the graphical interface building area, and obtaining the core parameter corresponding to the block according to the core parameter configuration performed by the user on the block.
  • the building area is distributed with at least one block, and any group of blocks can initiate the corresponding core parameter configuration process through its selection on the building area. Once a group of blocks is selected in the building area, the core parameter configuration of this group of blocks can be configured.
  • the core parameter configuration is the process of inputting parameters, adjusting parameters and selecting parameters under the control of the user. Different mathematical primitives corresponding to different blocks will also correspond to different core parameter configuration processes.
  • the core parameters corresponding to the selected blocks in the building area will be obtained through the core parameter configuration, and the core parameters corresponding to all the blocks in the building area will be obtained by analogy, that is, all The core parameters of the block are configured to ensure the operation of the artificial intelligence application built.
  • step 335 with the configuration of more than two blocks in the building area, the interconnection between the blocks is formed to form the artificial intelligence algorithm configuration of the artificial intelligence application built under user control.
  • the links between the blocks will be controlled under the user's control, so that the blocks distributed in the building area can be built into artificial intelligence algorithms for artificial intelligence applications structure.
  • the link between the blocks refers to the connection of the blocks in the building area. In addition to indicating the connection between the blocks, it also indicates the input and output relationship between the connected blocks; the other In terms of aspects, the link between the group blocks also indicates that the output of the previous group of blocks will be used as the input of the next group of linked blocks.
  • an artificial intelligence algorithm configuration is formed.
  • This artificial intelligence algorithm configuration is an algorithm description of the artificial intelligence application currently built by the user.
  • the running process will be the process of executing the algorithm according to the mathematical primitives and the interlinking relationship indicated by the blocks in the corresponding artificial intelligence algorithm configuration.
  • the interconnection between the blocks is realized by the wiring between the blocks under user operation.
  • the resulting artificial intelligence algorithm configuration is realized under the control of the user.
  • the user control referred to here refers to the block selection operation and the connection operation between the blocks that the user needs to trigger when building the artificial intelligence application.
  • Any operation that can configure blocks for the built artificial intelligence application and build links between the configured blocks is a user operation triggered by forming an artificial intelligence algorithm configuration.
  • an artificial intelligence algorithm configuration is built for the currently built artificial intelligence application, so as to realize algorithm development, enhance users to build artificial intelligence algorithm configurations at will for their own needs, and at the same time increase flexibility Achieved the required artificial intelligence application building, which is no longer limited by the lack of professional knowledge such as code knowledge, artificial intelligence algorithms and mathematical representation.
  • FIG. 5 is a flowchart illustrating step 350 according to the embodiment corresponding to FIG. 3.
  • the step 350 includes:
  • step 351 for the blocks included in the configuration of the artificial intelligence algorithm, the mathematical primitive identification and core parameters corresponding to the blocks are obtained.
  • the artificial intelligence algorithm configuration is an algorithm logic description of the models and data used in the built artificial intelligence application, that is, the algorithm logic composed of the introduced mathematical primitives, and as pointed out in the foregoing description, the artificial intelligence algorithm configuration is The network topology composed of all the multiple blocks.
  • the blocks distributed in the building area and the relationship between them form the block architecture of the artificial intelligence application, which indicates that the artificial Mathematical primitives used in intelligent application building and the linking relationship between mathematical primitives.
  • each mathematical primitive has a corresponding code description, that is, code information including core parameters, so as to achieve the execution of the corresponding mathematical operation through the execution of the corresponding code description.
  • code description that is, code information including core parameters
  • the configuration of artificial intelligence algorithms composed of blocks, the existence of corresponding mathematical primitives will indicate the code description information for performing a series of mathematical operations under this artificial intelligence algorithm configuration, that is, the corresponding and containing The executable text composed of the code information of the core parameters.
  • the generated dictionary is used to deliver the artificial intelligence algorithm configuration adaptively constructed by the user to the server, so as to obtain the artificial intelligence application running on the server.
  • Each block has a corresponding mathematical primitive, that is, the block is a graphical representation of the corresponding mathematical primitive. Therefore, for the block under the artificial intelligence algorithm framework, the corresponding mathematical primitive identifier can be obtained , And the core parameters are obtained along with the core parameter configuration of the chunks described above. For a group of blocks, the obtained core parameters correspond to the identification of mathematical primitives.
  • step 353 a dictionary of artificial intelligence applications is constructed with the mathematical primitive identifier as the index item and the core parameter as the index value.
  • the dictionary data is constructed for each block under the configuration of the artificial intelligence algorithm, that is, the corresponding mathematical primitive identification is used as the index item, and the core parameter is used as the index value to construct the dictionary data for the block, and so on,
  • the dictionary data of all the blocks under the configuration of artificial intelligence algorithm will form the dictionary of artificial intelligence application.
  • the image information of the chunk is converted into code that exists on the server side, that is, the executable text of the artificial intelligence application is obtained, so as to solve the dilemma of the artificial intelligence algorithm is complex and difficult to adapt to user development.
  • the core parameters of the artificial intelligence application built by the user will also be passed to provide the server with the core parameters of the user's personalized configuration, ensuring the accuracy of the construction of the artificial intelligence application Adapt to the user's artificial intelligence application needs.
  • FIG. 6 is a flowchart illustrating step 370 according to the corresponding embodiment of FIG. 3.
  • the step 370 includes at least:
  • step 371 character string conversion is performed on the mathematical primitive identification and indexed core parameters in the dictionary.
  • the dictionary After generating the dictionary for the artificial intelligence application built by the user through the foregoing exemplary embodiment, the dictionary needs to be converted into a string, so that the dictionary carries the mathematical primitive identification and core parameters from the user terminal to the server.
  • the mathematical primitive identification in the dictionary and the core parameters of the index are converted into JSON strings, and the dictionary will be transmitted to the server in the form of JSON strings.
  • step 373 the artificial intelligence application built for the user transmits a character string to the server, and initiates decoding of the character string by the server through transmission of the character string to obtain executable text of the artificial intelligence application to run on the server.
  • the server After receiving the character string sent by the user terminal to the built artificial intelligence application, the server converts the character string decoding back into the form of a dictionary, and then decodes the mathematical language representation of graph theory to obtain executable text.
  • the executable text is the code description of the artificial intelligence application built by the user.
  • the execution of executable text executes a series of operations configured by the user to realize the artificial intelligence application. This process is the running process of the artificial intelligence application.
  • the built artificial intelligence application can exist on the server side, and then the functions configured in the artificial intelligence application can be fully realized through excellent hardware conditions on the server side.
  • Fig. 7 is a flowchart illustrating a method for building an artificial intelligence application according to another exemplary embodiment.
  • the method for building an artificial intelligence application further includes the following steps:
  • step 410 the block configured in the building area receives a user's new block selection instruction, and the new block selection instruction acts on at least one block configured in the building area.
  • the building area is under the control of the user to add at least one block.
  • This user-controlled process of adding blocks to the building area can be the process of building an artificial intelligence application, or it can be built for subsequent artificial intelligence applications.
  • the process of adding blocks can be the process of building an artificial intelligence application, or it can be built for subsequent artificial intelligence applications.
  • new blocks can be added, so that the initial configuration of the graphical interface block is added according to user needs, which is convenient for the subsequent construction of artificial intelligence applications.
  • a new block can be added to the selected at least one block, and a new block selection instruction can be generated.
  • the newly added block selection instruction is applied to at least one block selected by the user in the building area.
  • step 430 a dictionary corresponding to the block corresponding to the newly added block selection instruction is generated, and the dictionary includes a mathematical primitive identifier corresponding to the block and core parameters.
  • a dictionary is generated for the block acting on the new block selection instruction.
  • the dictionary generated for adding new blocks describes the corresponding mathematical primitive identification and core information of the combined blocks. For the newly added chunks and the corresponding newly added mathematical primitives, the generated dictionary is described by data for this purpose.
  • the mathematical primitive identifier uniquely identifies the corresponding block
  • the core parameters corresponding to the block are Contains the input dimension and output dimension corresponding to the mathematical operation, so it will indicate the link relationship between the chunks.
  • the core parameters of the input dimension and the output dimension are specified for the chunks, that is, the mathematical primitives, which will be used to determine the links between chunks. If the output dimension of the mathematical primitive corresponding to one group of blocks is the input dimension of the mathematical primitive corresponding to another group of blocks, it indicates that the two groups of blocks are linked to each other.
  • the generated dictionary the grouped blocks and the link relationship between the blocks can be accurately known without consuming excessive storage space and more calculation cost.
  • step 450 the mathematical primitive identification and core parameters in the dictionary are combined and added into the newly added mathematical primitives through the mathematical language representation of graph theory.
  • the dictionary is used as the data description of the newly added mathematical primitives.
  • the data description in the dictionary is represented as a mathematical language of graph theory according to the mathematical primitive identification and its corresponding core parameters, so as to obtain several block combinations New mathematical primitives formed by encapsulation.
  • the mathematical language representation of graph theory is to track the input values in the basic mathematical primitives, the mathematical operations done on the input values, and the output values, in order to reconstruct and characterize the mathematical primitives. No matter the input value, mathematical operation or output value, they will be reconstructed in the form of nodes, and then form the mathematical language representation of mathematical primitives in graph theory. Through the mathematical language representation of graph theory, the newly added mathematical primitives can be reconstructed accurately and quickly.
  • the server obtains the character string and decodes it and converts it back into a dictionary, it reconstructs the mathematical language representation of each mathematical primitive on the graph theory based on the dictionary, in order to quickly repeat Construct mathematical operations performed by artificial intelligence applications and the input and output dimensions of the performed mathematical operations.
  • the artificial intelligence application obtained by the construction of multiple blocks is composed of several mathematical primitives.
  • the newly added blocks constitute an executable program, similar to it, which is also built by at least one or more blocks
  • the reconstruction of the mathematical primitives of the newly added blocks is also based on the reconstruction of the mathematical language representation of each mathematical primitive in the graph theory based on the dictionary.
  • step 470 the new mathematical primitives are updated to the graphical interface and the server.
  • step 450 After obtaining the mathematical primitives corresponding to the newly added chunks through the execution and reconstruction of step 450, it is necessary to update the graphical interface and the server. On the one hand, there are new blocks among the many blocks that the graphical interface can provide to users, so that users can add new blocks to the building area. On the other hand, it will also enable the server to be used by the graphical interface.
  • the newly added chunks are configured during the initialization of the chunks, and the data related to the newly added chunks are identified in the received dictionary, so that the mathematical primitives corresponding to the newly added chunks can be run on the server.
  • the new mathematical primitives are updated, including the image information related to the block.
  • the new mathematical primitives are uniquely identified and the mathematical primitives are stored for all mathematical primitives that constitute the new mathematical primitives. Identification and core parameters. Therefore, the update of the newly added mathematical primitives also includes the update of mathematical primitive definition information such as mathematical primitive identification and core parameters.
  • the updated mathematical primitive definition information describes the newly added mathematical primitives and the execution of mathematical operations in the newly added mathematical primitives.
  • the function of adding new blocks is provided for the construction of artificial intelligence applications, so that users can build configuration blocks according to their own application requirements and habits, in addition to the existence of the graphical interface
  • configuration blocks In addition to the original configuration blocks, there will also be user-defined configuration blocks, and the convenience and freedom of building artificial intelligence applications will be enhanced.
  • the blocks that are frequently combined for artificial intelligence application building are packaged and packaged together to form a new block.
  • it is to combine the original more detailed mathematical operations into a new mathematical operation, in order to build a new operation for the artificial intelligence application performed by the user, and enhance the execution performance of the artificial intelligence application.
  • step 470 includes: adding a new block to the graphical interface for the newly added mathematical primitive according to the configured block name, so as to update the added new block among the several blocks of the initial configuration of the graphical interface Add chunks.
  • the newly added mathematical primitives must have corresponding newly added blocks on the graphical interface, that is to say, the newly added mathematical primitives must be represented in the form of newly added blocks on the graphical interface.
  • the blocks that represent mathematical primitives also called tiles, are the targets that users manipulate to build artificial intelligence applications.
  • the newly added blocks corresponding to the newly added mathematical primitive configuration on the graphical interface are marked with the names of the corresponding blocks to distinguish them from other blocks. It is convenient for users to choose.
  • FIG. 8 is a flowchart illustrating step 470 shown in another exemplary embodiment according to the corresponding embodiment of FIG. 7.
  • this step 470 includes at least:
  • step 471 a new mathematical primitive identifier is generated for the new mathematical primitive.
  • the newly added mathematical primitive logo is similar to the aforementioned mathematical primitive logo, and is used to uniquely identify the corresponding mathematical primitive and block.
  • the configured core parameters correspond to the generated new mathematical primitive identifiers.
  • step 473 the mathematical primitive definition information and the core parameter of the newly added mathematical primitive package are generated under the newly added mathematical primitive identifier.
  • the newly added chunks are composed of at least one chunk.
  • the newly added mathematical primitives corresponding to the newly added chunks are also formed by packaging and packaging at least one mathematical primitive.
  • the new mathematical identifier generated for the new mathematical primitive corresponds to at least one set of mathematical primitive identifiers and core parameters.
  • a set of mathematical primitive identifiers and core parameters used to describe the digital primitives of the corresponding block together with other sets of mathematical primitive identifiers and core parameters, describe the new mathematical primitives, that is, generate math for the new mathematical primitives Primitive definition information.
  • step 475 the mathematical primitive definition information is updated to the server.
  • the updating of the mathematical primitive definition information on the server enables the newly added mathematical primitive to add the corresponding block in the initialization of the graphical interface by the server.
  • the existence of mathematical primitive definition information on the server means that the corresponding newly added mathematical primitives and blocks are deployed in the subsequent artificial intelligence application building, and the subsequent artificial intelligence for the user through the graphical interface Application building, you can use the newly added blocks, and then configure the newly added mathematical primitives in the built artificial intelligence applications.
  • FIG. 9 is a flowchart illustrating step 430 according to the embodiment corresponding to FIG. 7.
  • the step 430 includes at least:
  • step 431 the corresponding mathematical primitive identification and core parameters are obtained respectively according to all the blocks acting on the newly added block selection instruction.
  • the newly added chunks are implemented corresponding to at least one chunk selected by the user, which is to combine at least one mathematical primitive corresponding to the chunks and form a new group for this purpose Piece.
  • the user chooses to add a new block, it is equivalent to selecting at least one corresponding block, which will enhance the convenience and efficiency of artificial intelligence application building, and can quickly build artificial intelligence applications.
  • the block interconnections form a network topology capable of performing at least one mathematical operation.
  • the input and output dimensions of the core parameters corresponding to the chunks have been configured according to the currently constructed link relationship, and the corresponding mathematical primitive identification and core parameters can be obtained for each chunk to be used for each group
  • the block generates dictionary data, and the dictionary data indicates the link relationship between the located block and the other linked blocks.
  • step 433 for each group of blocks, a corresponding mathematical primitive identifier is used as an index item, and core parameters are index values to construct dictionary data to generate a dictionary corresponding to the newly added group of blocks.
  • dictionary data is constructed for each group of blocks through a key-value pair data structure, where the key-value pair data structure uses mathematical primitives as index items and core parameters as index values.
  • Dictionary data is constructed separately for all the blocks that make up the newly added blocks, and the dictionary corresponding to the newly added blocks is generated from all dictionary data.
  • Fig. 10 is a flow chart showing a method for implementing operation in building an artificial intelligence application according to an exemplary embodiment.
  • the operation implementation method in the construction of an artificial intelligence application includes at least the following steps.
  • step 510 when the user chooses to build an artificial intelligence application, the server receives the character string corresponding to the dictionary, and the dictionary corresponding to the character string is used to describe the building blocks configured for the artificial intelligence application.
  • the deployed server will respond to the manipulation of the user terminal and cooperate with the realization of the construction of the artificial intelligence application to obtain the artificial intelligence application existing on the server for the user.
  • the operation of artificial intelligence applications is achieved through the execution of a series of mathematical operations, that is, the operations required by users are realized in units of mathematical primitives.
  • the execution of mathematical operations must be supported by the corresponding code information to control the execution of the mathematical operations on the server side. Therefore, the server side stores the information related to the code for the deployed blocks accordingly, which requires users to retrieve them separately under the control of the dictionary generated by the built artificial intelligence application to obtain executable text that can realize the operation of the artificial intelligence application. .
  • the dictionary generated for the built artificial intelligence application will be converted into a string and sent to the server, so that the server can obtain the user's Built artificial intelligence applications.
  • the server will receive the character string sent by the user terminal.
  • the dictionary converted to this character string describes and defines the corresponding mathematical primitives for the corresponding chunks through a piece of dictionary data.
  • the mathematical primitives are the operation units for implementing artificial intelligence applications in the construction of artificial intelligence applications for users. They can divide the operation units at different levels according to needs, and then configure the mathematical primitives and The corresponding chunk.
  • neural network operations For example, according to artificial intelligence algorithms, neural network operations, dot product operations, and matrix multiplication operations are all configured as operating units. Some neural network operations include dot product operations. Therefore, you can see that both It is the division of operating units at different levels, but it does not affect the configuration of the corresponding mathematical primitives and chunks.
  • the subdivided operation units can also be combined to form a new operation unit on the upper layer, that is, mathematical primitives and chunks. This is the process of adding chunks referred to in the foregoing exemplary embodiments.
  • step 530 the character string is decoded to obtain the executable text of the artificial intelligence application.
  • the character string obtained by the dictionary conversion can be decoded to obtain the mathematical primitive identification and core parameters involved in the built artificial intelligence application.
  • the DAG data is continuously expressed by the mathematical language of graph theory.
  • the structure reconstructs each mathematical primitive, and constructs the link relationship between this mathematical primitive and other mathematical primitives for this purpose, and finally forms the executable text corresponding to the built artificial intelligence application.
  • the executable text contains all the executable sentences of the built artificial intelligence application, which is composed of the code information of all mathematical primitives.
  • step 550 through execution of the executable text, the user is allowed to choose to build the artificial intelligence application to run the server.
  • the operation of the artificial intelligence application can be triggered.
  • the functions deployed by the artificial intelligence application will be realized through the execution of the sentences in the executable text to satisfy the user’s Artificial intelligence needs.
  • FIG. 11 is a flowchart illustrating step 530 according to the embodiment corresponding to FIG. 10.
  • the step 530 includes at least the following steps:
  • step 531 the character string is decoded and converted into a dictionary, which contains the mathematical primitive identification and core parameters corresponding to the chunks configured for artificial intelligence applications.
  • step 533 the code information for performing the corresponding mathematical operation is reconstructed through the mathematical primitive identifier and core parameters contained in the dictionary to obtain the executable text of the artificial intelligence application.
  • a set of mathematical primitive identifiers and core parameters corresponding to each mathematical primitive can be obtained from the obtained dictionary.
  • the set of dictionary data of the mathematical primitive identification and core parameters indicate the corresponding mathematical primitives and other mathematical primitives linked to this mathematical primitive, ie the input dimension is the math of the output dimension in the core parameters
  • the primitive is the link to the current mathematical primitive.
  • FIG. 12 is a flowchart describing step 533 according to the embodiment corresponding to FIG. 11. In an exemplary embodiment, this step 533 is shown in FIG. 12 and includes at least the following steps.
  • step 601 the data missing code of the corresponding mathematical operation is obtained according to the mathematical primitive identification in the dictionary.
  • the server is controlled by the artificial intelligence applications built by the user terminal to obtain a dictionary for the built artificial intelligence applications, the dictionary records the mathematical primitives corresponding to each mathematical primitive used by the built artificial intelligence applications Logo and core parameters.
  • the server also stores the information related to the code for the mathematical operations that need to be performed.
  • the code-related information stored for the execution of each mathematical operation is the data-missing code with missing core parameters.
  • the data missing codes are stored correspondingly with the index of the mathematical primitive as the index.
  • the data missing code with missing core parameters can be adapted to fill different core parameters with the realization of different artificial intelligence applications, and realize different configurations of the mathematical operations performed, so as to fully adapt to the realization of artificial intelligence applications.
  • the server side provides users with artificial intelligence application algorithms supported by the data missing code, allowing users to build artificial intelligence applications simply and intuitively through the block, and the other
  • the aspect will also obtain flexible and free algorithm implementation with the support of data missing code, which enhances the flexibility of artificial intelligence application construction.
  • step 603 the core parameters corresponding to the mathematical primitive identification are filled into the obtained data missing code to obtain code information for performing the corresponding mathematical operation.
  • the core parameters in the dictionary are corresponding to the mathematical primitive identification. Therefore, after the data missing code is obtained from the mathematical primitive identification, the corresponding core parameters will also be obtained from the mathematical primitive identification.
  • the acquired core parameters are filled into the data-missing code to obtain complete code information for performing the corresponding mathematical operation.
  • the code information obtained by filling in the core parameters is a mathematical primitive description at the code level. Under the effect of missing data codes and code information, users can build artificial intelligence applications according to their own needs even without programming intelligence and programming skills.
  • step 605 according to the input dimension and output dimension indicated in the core parameter corresponding to the mathematical primitive identification, the executable information of the artificial intelligence application is reconstructed from the output of the code information to the input through the mathematical language of graph theory.
  • the core parameters are the corresponding mathematical operations performed, and also indicate the input and output dimensions for the implementation of the artificial intelligence algorithm through the code information. Therefore, it can be based on this and other Mathematical primitive docking.
  • the mathematical language representation of graph theory is for mathematical primitives, and also for code information that performs corresponding mathematical operations.
  • the mathematical language representation of graph theory is to use the DAG structure to quickly and accurately reconstruct the input, output, and mathematical operations corresponding to the mathematical primitives, and then on the basis of this, the DAG structure corresponding to the mathematical primitives is continuously carried out in the order of output to input. Until the completion of the reconstruction of all mathematical primitives corresponding to the dictionary.
  • the corresponding code information can be reconstructed according to the mathematical language representation of graph theory to obtain the executable text of the artificial intelligence application.
  • Fig. 13 is a schematic diagram of a DAG structure corresponding to a simple mathematical primitive according to an exemplary embodiment.
  • the following table shows the "I” and "O" data tables configured by the user on the block Add in the graphical interface.
  • the block add indicates that the corresponding mathematical primitive will perform an addition operation on the input data, as shown in the following table. which is:
  • the construction of artificial intelligence applications can be quickly realized even if complex artificial intelligence algorithms are involved by means of the DAG structure.
  • FIG. 14 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10.
  • this step 550 includes at least the following steps.
  • step 551a in the training mode, sample data suitable for artificial intelligence applications is obtained, and the training mode is the mode selected by the user on the graphical interface.
  • step 553a an artificial intelligence application is run on the server through execution of executable text, and parameter training is performed through sample data during the operation of the artificial intelligence application.
  • This exemplary embodiment provides the training process of the artificial intelligence application for the artificial intelligence application built by the user, so that the artificial intelligence application built by the user completes the iterative training of the parameters through the set sample parameters, and then the built artificial intelligence application can be used normally .
  • the sample data suitable for artificial intelligence applications is configured by the user in an exemplary embodiment, for example, the user imports sample data through the toolbar set by the graphical interface, and can also be related to the data through the operation interface
  • the set of blocks can be used to set the sample data for the artificial intelligence applications built, and the sample data can also be selected through the check box set in the toolbar.
  • the sample data is collected by the user, it can also be stored on the server and shared by other users, or it can be pre-configured by the server according to the needs of various artificial intelligence applications. It is not limited here.
  • the artificial intelligence application for the artificial intelligence application that has been built, it can be placed in training mode or operation decision mode through user control, so as to control the operation of the artificial intelligence application.
  • it can set a switch that is turned on in the training mode or decision mode on the graphical interface. The user only needs to manipulate the switch to select the corresponding mode.
  • sample data suitable for artificial intelligence applications according to the sample data configuration performed by the user, for example, obtain sample data recommended by the server, obtain sample data shared by other users, and import it in the graphical interface The required sample data, etc.
  • the application of artificial intelligence is based on machine learning, and solves specific problems for users through machine learning algorithms.
  • the machine learning algorithm may be a neural network algorithm. Therefore, the completed artificial intelligence application must involve the realization of training, and the parameters required for the normal operation of the artificial intelligence application can be obtained through iterative training.
  • the entrance of sample data acquisition is realized for the built artificial intelligence application. Even if the user is limited to various situations and cannot obtain a large amount of sample data, it can be obtained by means of the server, thereby ensuring that the built Based on the training and subsequent use of artificial intelligence applications, users can also adapt to their own needs to prepare sample data to ensure the accuracy of subsequent decisions of the artificial intelligence applications built.
  • sample data submitted by the user to the server can be hidden according to their own choices, that is, stored as their own private data, but they can also be set to the public state for sharing on the server.
  • the sample data can also be obtained by crowdsourcing, which is not limited here.
  • FIG. 15 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10 in another exemplary embodiment.
  • this step 550 includes:
  • step 551b data selected by the user for input is acquired, and the data includes target data processed by the artificial intelligence application built by the user.
  • step 553b by executing an executable file that completes parameter training, running the trained artificial intelligence application in the decision mode completes the user's selection of input data.
  • This exemplary embodiment realizes that the user uses the self-built artificial intelligence application to make data decisions, and the built artificial intelligence application truly solves the user's data processing needs.
  • the data that the user chooses to input is the data that the user needs to process with the help of the built artificial intelligence application. It should be understood that the user is building the artificial intelligence application for this data processing requirement.
  • FIG. 16 is a flowchart illustrating step 551b according to the corresponding embodiment of FIG. 15.
  • this step 551b, as shown in FIG. 16, includes at least the following steps.
  • step 601 the data uploaded by the user to the artificial intelligence application built by the user on the graphical interface is received.
  • the user will upload the data processed by the artificial intelligence application on the graphical interface.
  • the data content and data types are different.
  • the uploaded request artificial intelligence The data processed by the application can be text data, video data or even audio data.
  • step 603 the artificial intelligence application built by the user is determined according to the user identifier carried in the data.
  • the server cooperates with many user terminals to implement the construction of artificial intelligence applications on each user terminal. Therefore, different users have different artificial intelligence applications. Therefore, for the server, the user identification is used as an index to store the dictionary to record the artificial intelligence applications corresponding to different users.
  • the artificial intelligence application that has been built and trained is completed, and its dictionary is stored on the server for users to call at any time.
  • the user can call the built and trained artificial intelligence application when he needs to access the server, and in the use of the artificial intelligence application, iteratively optimizes the parameters in the artificial intelligence application by means of decision-making results. To continuously improve the accuracy of decisions.
  • the user ID is used to uniquely identify the user. Therefore, the user can log in to the server through the user ID, and then call the built artificial intelligence application.
  • step 605 the target data requested by the artificial intelligence application built by itself to be processed in the data is triggered to run the determined artificial intelligence application.
  • the artificial intelligence corresponding to the user identification is requested to process the uploaded data, in order to run the artificial intelligence application with the uploaded data as input.
  • Fig. 17 is a flowchart of a method for implementing operation in building an artificial intelligence application shown in another exemplary embodiment.
  • the operation implementation method in the construction of artificial intelligence applications includes at least the following steps.
  • step 710 the user's update of the newly added mathematical primitive is received to obtain digital primitive definition information.
  • the mathematical primitive definition information includes the newly added mathematical primitive identifier and the newly added mathematical primitive under the newly added mathematical primitive identifier At least one mathematical base identifier and core parameters corresponding to the package.
  • step 730 the mathematical primitive definition information is saved, and the graphical interface is initialized and configured with new blocks.
  • the server controlled by the user terminal will necessarily receive the mathematical primitive definition information sent by the user terminal.
  • the user will save the mathematical primitive definition information for the user to call in the subsequent artificial intelligence application construction.
  • the user's artificial intelligence application needs to be short-video action recognition. Take this as an example and explain in combination with the above method. Narrate.
  • the user needs to realize the video action recognition through the artificial intelligence application of the present invention.
  • the action can be recognized by an artificial intelligence application built by the user, and the action classification result can be output.
  • the user can drag and drop the required blocks in the operation component selection bar of the graphical interface to drag the required blocks to the operation interface, And build a link relationship through the connection between the blocks until the construction of the artificial intelligence algorithm configuration is completed.
  • the neural network operation adopted in the constructed artificial intelligence algorithm configuration is the mathematical operation adopted by the user for the artificial intelligence application.
  • Fig. 18 is a schematic diagram of a graphical interface according to an exemplary embodiment.
  • the operation component selection bar 810 is provided with a number of operation components, that is, blocks related to data and models; the operation interface 830 is a stay area where users need to drag and drop the blocks , Complete the data and model building by dragging and dropping the icon, that is, the component.
  • fine-tuning of data and models will also be performed through the toolbar 850 on the right.
  • the information related to the iterative training process such as the number of iterations and the related iterative training results, will be displayed through the operation result display area 870, where the accuracy of the data and model training will also be displayed to ensure that the user can master artificial intelligence Real performance.
  • the artificial intelligence application built by the user that can realize the video action video can try different artificial intelligence algorithm configurations through continuous block dragging to find available artificial intelligence algorithm configurations.
  • FIG. 19 is a convolutional neural network according to an exemplary embodiment. Schematic diagram of the block corresponding to the operation on the operation interface. Block I represents the input, block Dense represents the operation of the convolutional neural network in the deep learning neural network, and block O represents the output. On this basis, then to the operation interface Drag two blocks corresponding to the operation of the convolutional neural network to construct a three-layer convolutional neural network to achieve the extraction of convolutional features in the built artificial intelligence application.
  • FIG. 20 is shown according to the corresponding embodiment of FIG. 19 Schematic diagram of block distribution and links on the operation interface of the three-layer convolutional neural network.
  • the process is roughly as follows: first, learn the code knowledge completely, have a certain code development ability, and then learn the manual Intelligent expertise, in the end, as a developer, according to the current specific needs, choose the appropriate programming language to carry out algorithm development in the compiler, the time period required for this process is at least 7 years.
  • code knowledge deep learning algorithms related to machine learning, mathematical representation, and overall knowledge of artificial intelligence are difficult to popularize, and the code learning threshold is also insurmountable by the public.
  • the implementation and development of the present invention first provides a user-friendly interface for the public, and encapsulates many technical details in the form of blocks and mathematical primitives to achieve standardized Artificial intelligence model building process, so as to really help the public to use artificial intelligence technology.
  • the artificial intelligence algorithm is different from the simple algorithm logic similar to that involved in children's programming. It is a complex natural expression and is difficult to implement with the help of graphical user programming.
  • code encapsulation is implemented through mathematical primitives to achieve the required mathematical operations, and graphical blocks are defined on the graphical interface to represent them.
  • Fig. 21 is a schematic diagram of interaction between a front end and a back end involved in the present invention according to an exemplary embodiment.
  • the user side implements a website graphical interface, that is to say, for the user, the artificial intelligence application needed to be implemented through a web application only needs to know the corresponding background Visit the address to run the web application through the browser.
  • the back-end server will convert the graphics into code according to the user-configured block, that is, to obtain the built artificial intelligence application, and rely on the server to provide Cloud computing capabilities return results to users, or artificial intelligence algorithm configuration diagrams.
  • AI Artificial Intelligence
  • the user constructs an AI (Artificial Intelligence) algorithm in the mathematical language of graph theory, that is, the mathematical primitive referred to above, and the algorithm information involved is stored in a dictionary implemented in JavaScript language.
  • the dictionary can be submitted to the server in the background in the form of a JSON string.
  • the server sends it to the output end
  • the server will complete the training according to the AI code language and return the results to the website graphical interface and display it.
  • mathematical primitives correspond to mathematical operations, which can include basic mathematical operations (BMO, Basic, Mathematical Operations) such as addition, subtraction, multiplication, and division, as well as various complex mathematical operations, such as,
  • BMO Basic
  • Mathematical Operations such as addition, subtraction, multiplication, and division
  • various complex mathematical operations such as,
  • the mathematical language expression of mathematical primitives in graph theory, such as neural network operations is a DAG structure used to express mathematical operations, also known as MNG (Mathematical Network Graph).
  • DAG Directed Acyclic Graph
  • DAG Directed Acyclic Graph
  • FIG. 22 shows a schematic diagram of the implementation of the overall solution of the present invention in an exemplary embodiment.
  • an artificial intelligence application independently developed by a user, it includes four major stages, namely: a construction stage, a stage for sending pictures, a stage for translating a dictionary to MNG, and a loopback Results stage.
  • the construction period is the stage for the user to build the required artificial intelligence application.
  • the user can build the artificial intelligence algorithm and the new MNG block through the block, whether it is the artificial intelligence algorithm or the new MNG.
  • the construction of tiles, their corresponding mathematical primitive indexes and core parameters are marked and stored in the dictionary.
  • the phase of sending the diagram is carried out by the construction period.
  • the send map stage is the stage where the dictionary is sent for the constructed artificial intelligence algorithm or new MNG block.
  • the reason why it is called the send map stage refers to the artificial intelligence algorithm or MNG block corresponding to the dictionary.
  • a network topology diagram In a network topology diagram.
  • the type conversion of the character string received by the server is realized to eliminate the character string and decode and convert it back to the dictionary.
  • the translation dictionary is entered into the MNG stage.
  • the server will identify the MNG, that is, the mathematical primitive, to generate code through the DAG structure, obtain the executable AI code language, and train and Return the result.
  • the trained AI code language can be used to make decisions on the data.
  • the decision-making phase for data is still running and returning results.
  • the server completes the construction of the artificial intelligence application method, it obtains the AI code language. At this time, it will recognize the model and check whether it has been trained. If it has been trained and contains the data to be run, use this The data runs AI code language and returns the result.
  • the decision is made on the data, it will also be confirmed to the user by showing the artificial intelligence algorithm configuration diagram to the user, and the previously trained AI code language can be run on top of this basis.
  • This artificial intelligence algorithm configuration diagram has been constructed by building blocks when users build artificial intelligence applications.
  • the process of obtaining the AI code is the process of extracting important information from the artificial intelligence algorithm configuration diagram and parsing it into code, which is used to encapsulate, that is, encapsulate for each data primitive, and realize net-to-gate, that is, by Network structure to a single mathematical operation. So far, it can be understood that any mathematical operation or mathematical equation is a complex of BMO.
  • BMOs are linked together to form a DAG structure, which is expressed as MNG.
  • MNG has its own input and output, and the input and output between different MNGs can be linked to each other to form a complete logical network. Therefore, it can be used as an equivalent transition between block and code. In this way, the information corresponding to the block is accurately transferred to the code, and the conversion between the graphical interface and the text programming language is realized.
  • each mathematical primitive is realized at the beginning, and at the same time, they are also the basis for user control.
  • the network structure built by users through blocks will be converted into a dictionary as before. Then convert the dictionary to DAG format and parse it. Then, the network structure becomes a mathematical primitive, which is then added to the server as a new mathematical primitive.
  • the newly formed mathematical primitives can be used as other primitives to construct other networks. As this cycle repeats, more complex algorithms can be developed without increasing the difficulty of developing graphics-based programming languages.
  • the following is a device embodiment of the present invention, which is an embodiment of a building device for executing the above artificial intelligence application of the present invention.
  • a device embodiment of the present invention is an embodiment of a building device for executing the above artificial intelligence application of the present invention.
  • the device embodiment of the present invention please refer to the embodiment of the method for building an artificial intelligence application of the present invention.
  • Fig. 23 is a block diagram of a device for building an artificial intelligence application according to an exemplary embodiment.
  • the artificial intelligence application building device includes but is not limited to: an instruction receiving module 1010, a construction module 1030, a conversion module 1050, and a decoding initiation module 1070.
  • the instruction receiving module 1010 is configured to receive an instruction for selecting a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive.
  • Constructing module 1030 configured to configure blocks for building artificial intelligence applications in the building area of the graphical interface through the selection instruction, and link the blocks to form an artificial intelligence algorithm for artificial intelligence applications built under user control structure.
  • the conversion module 1050 is configured to convert the included chunks into a dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters, the core parameters corresponding to the group Block configuration.
  • the decoding initiation module 1070 is used to initiate decoding of the artificial intelligence application built by the user to the server through the dictionary, and trigger the artificial intelligence application to run on the server.
  • Fig. 24 is a block diagram of a device for implementing operation in building an artificial intelligence application according to an exemplary embodiment.
  • the operation implementation device in the manual and intelligent application building includes, but is not limited to: a character receiving module 1110, a decoding module 1130, and an execution module 1150.
  • the character receiving module 1110 is used for building an artificial intelligence application selected by the user, and the server receives a character string corresponding to a dictionary, and the dictionary corresponding to the character string is used to describe a block configured for building the artificial intelligence application.
  • the decoding module 1130 is configured to decode the character string to obtain the executable text of the artificial intelligence application.
  • the execution module 1150 is configured to enable the artificial intelligence application selected by the user to run on the server through execution of the executable text.
  • the present invention also provides an electronic device, which can be used in the implementation environment shown in FIG. 1 to perform all or part of the steps of any of the methods shown in FIGS. 3 to 17.
  • the device includes: a processor; a memory for storing processor executable instructions;
  • the processor is configured to perform the method mentioned above.
  • a storage medium is also provided.
  • the storage medium is a computer-readable storage medium, for example, it may be a temporary and non-transitory computer-readable storage medium including instructions.
  • the storage medium includes, for example, a memory 204 of instructions that can be executed by the processor 218 of the device 200 to complete the above method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Stored Programmes (AREA)

Abstract

L'invention concerne un procédé de construction d'une application d'intelligence artificielle, un procédé de mise en œuvre opérationnelle pendant une construction d'application d'intelligence artificielle, des appareils et un dispositif de machine. Le procédé comprend les étapes consistant à : recevoir une instruction de sélection pour des blocs sur une interface graphique, les blocs étant des représentations graphiques de primitives mathématiques correspondantes (310) ; au moyen de l'instruction de sélection, configurer dans une zone de construction les blocs pour une construction d'application d'intelligence artificielle, et relier les blocs les uns aux autres pour former une configuration d'algorithme d'intelligence artificielle d'une application d'intelligence artificielle construite sous la commande d'un utilisateur (330) ; selon la configuration d'algorithme d'intelligence artificielle, obtenir un dictionnaire composé d'identifiants de primitives mathématiques correspondant aux blocs et aux paramètres de cœur, les paramètres de cœur étant configurés pour correspondre aux blocs (350) ; au moyen du dictionnaire, déclencher l'application d'intelligence artificielle pour qu'elle fonctionne sur une extrémité de serveur. Le procédé répond à des exigences d'application d'intelligence artificielle données, met en œuvre une construction d'application d'intelligence artificielle au moyen de composantes correspondant aux primitives mathématiques, s'adapte précisément à des besoins réels, met en œuvre librement des applications d'intelligence artificielle « tel-tel », améliore les performances d'interaction, et abaisse les seuils.
PCT/CN2018/125255 2018-12-29 2018-12-29 Procédés et appareils de construction d'application d'intelligence artificielle et de mise en œuvre opérationnelle, et dispositif de machine WO2020133324A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880002692.XA CN111819536A (zh) 2018-12-29 2018-12-29 人工智能应用的搭建、运行实现方法、装置和机器设备
PCT/CN2018/125255 WO2020133324A1 (fr) 2018-12-29 2018-12-29 Procédés et appareils de construction d'application d'intelligence artificielle et de mise en œuvre opérationnelle, et dispositif de machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/125255 WO2020133324A1 (fr) 2018-12-29 2018-12-29 Procédés et appareils de construction d'application d'intelligence artificielle et de mise en œuvre opérationnelle, et dispositif de machine

Publications (1)

Publication Number Publication Date
WO2020133324A1 true WO2020133324A1 (fr) 2020-07-02

Family

ID=71127389

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/125255 WO2020133324A1 (fr) 2018-12-29 2018-12-29 Procédés et appareils de construction d'application d'intelligence artificielle et de mise en œuvre opérationnelle, et dispositif de machine

Country Status (2)

Country Link
CN (1) CN111819536A (fr)
WO (1) WO2020133324A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074107B1 (en) 2020-11-04 2021-07-27 RazorThink, Inc. Data processing system and method for managing AI solutions development lifecycle

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101110021A (zh) * 2002-03-25 2008-01-23 数据质量解决公司 对过程指令集进行可视化编程的方法
US20160140452A1 (en) * 2014-11-17 2016-05-19 Optimitive S.L.U. Methods and systems using a composition of autonomous self-learning software components for performing complex real time data-processing tasks
CN107861721A (zh) * 2017-11-03 2018-03-30 上海宽全智能科技有限公司 逆向图形化智能编程方法与装置、设备和存储介质
CN108898229A (zh) * 2018-06-26 2018-11-27 第四范式（北京）技术有限公司 用于构建机器学习建模过程的方法及系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2481191A (en) * 2010-02-25 2011-12-21 Sita Information Networking Computing Ireland Ltd Graphical development tool for software application development
CN103412745B (zh) * 2013-07-18 2016-08-24 中国联合网络通信集团有限公司 一种开发及应用平台
US20180024848A1 (en) * 2013-12-02 2018-01-25 Crowdin, Inc. Translatable Texts Identification in In-Context Localization Utilizing Pseudo-Language and an External Server
CN106959851A (zh) * 2017-03-03 2017-07-18 同济大学 一种面向人工智能研究的模块化可编程分布式交互系统
CN108737324B (zh) * 2017-04-13 2021-03-02 腾讯科技（深圳）有限公司 生成人工智能服务组件的方法、装置及相关设备、系统
CN107807814B (zh) * 2017-09-27 2021-10-26 百度在线网络技术（北京）有限公司 应用组件的构建方法、装置、设备及计算机可读存储介质
CN108509193A (zh) * 2018-05-22 2018-09-07 苏州蜗牛数字科技股份有限公司 一种使用可视化组件封装功能模块的系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101110021A (zh) * 2002-03-25 2008-01-23 数据质量解决公司 对过程指令集进行可视化编程的方法
US20160140452A1 (en) * 2014-11-17 2016-05-19 Optimitive S.L.U. Methods and systems using a composition of autonomous self-learning software components for performing complex real time data-processing tasks
CN107861721A (zh) * 2017-11-03 2018-03-30 上海宽全智能科技有限公司 逆向图形化智能编程方法与装置、设备和存储介质
CN108898229A (zh) * 2018-06-26 2018-11-27 第四范式（北京）技术有限公司 用于构建机器学习建模过程的方法及系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074107B1 (en) 2020-11-04 2021-07-27 RazorThink, Inc. Data processing system and method for managing AI solutions development lifecycle

Also Published As

Publication number Publication date
CN111819536A (zh) 2020-10-23

Similar Documents

Publication Publication Date Title
JP7208952B2 (ja) 対話モデルを生成するための方法及び装置
CN107632987B (zh) 一种对话生成方法及装置
US12008439B2 (en) Methods for sharing machine learning based web service models
US11461643B2 (en) Deep adaptive semantic logic network
CN110825884B (zh) 基于人工智能的嵌入表示处理方法、装置及电子设备
US20180307978A1 (en) Multi-Modal Construction of Deep Learning Networks
US11195098B2 (en) Method for generating neural network and electronic device
CN110023963A (zh) 使用神经网络处理文本序列
CN105593844B (zh) 运行时定制基础设施
CN109918607A (zh) 页面搭建方法及装置、介质和计算设备
CN105074816A (zh) 促进口述自然语言接口的开发
JP7350923B2 (ja) ディープラーニングフレームワークのオペレータ登録方法、装置、デバイス及び記憶媒体
CN108351796A (zh) 用于在各种运行时环境中与模型交互并执行模型的统一接口规范
US11900263B2 (en) Augmenting neural networks
US20190080232A1 (en) Deep neural network perforance analysis on shared memory accelerator systems
CN109725980A (zh) 生成镜像标签的方法、设备以及计算机可读介质
JP7337172B2 (ja) 音声パケット推薦方法、装置、電子機器およびプログラム
CN108984535A (zh) 语句翻译的方法、翻译模型训练的方法、设备及存储介质
CN114237582A (zh) 项目构建方法、装置、介质及电子设备
CN106371931B (zh) 一种基于Web框架的高性能地学计算服务系统
WO2020133324A1 (fr) Procédés et appareils de construction d'application d'intelligence artificielle et de mise en œuvre opérationnelle, et dispositif de machine
CN112818678A (zh) 基于依赖关系图的关系推理方法及系统
WO2020133322A1 (fr) Procédé et appareil d'ajout de bloc pour construire une application d'intelligence artificielle et dispositif de machine
WO2020133323A1 (fr) Procédé et dispositif d'exécution d'une mise en œuvre dans la construction d'une application d'intelligence artificielle et équipement de machine
WO2021035552A1 (fr) Système et procédé prenant en charge une programmation graphique sur la base de blocs neuronaux et support de stockage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18944659

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18944659

Country of ref document: EP

Kind code of ref document: A1