WO2020133324A1 - Methods and apparatuses for artificial intelligence application building and operational implementation, and machine device - Google Patents

Methods and apparatuses for artificial intelligence application building and operational implementation, and machine device Download PDF

Info

Publication number
WO2020133324A1
WO2020133324A1 PCT/CN2018/125255 CN2018125255W WO2020133324A1 WO 2020133324 A1 WO2020133324 A1 WO 2020133324A1 CN 2018125255 W CN2018125255 W CN 2018125255W WO 2020133324 A1 WO2020133324 A1 WO 2020133324A1
Authority
WO
WIPO (PCT)
Prior art keywords
artificial intelligence
intelligence application
user
mathematical
blocks
Prior art date
Application number
PCT/CN2018/125255
Other languages
French (fr)
Chinese (zh)
Inventor
薛俊恩
谈国禹
Original Assignee
深圳砥脊科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳砥脊科技有限公司 filed Critical 深圳砥脊科技有限公司
Priority to PCT/CN2018/125255 priority Critical patent/WO2020133324A1/en
Priority to CN201880002692.XA priority patent/CN111819536A/en
Publication of WO2020133324A1 publication Critical patent/WO2020133324A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs

Definitions

  • the present invention relates to the field of Internet application technology, and in particular, to a method for building an artificial intelligence application, a method, a device, and a machine for implementing an operation in building an artificial intelligence application.
  • the present invention provides a method for building artificial intelligence applications, a method for implementing operation in the construction of artificial intelligence applications, Devices and machinery.
  • a method for building an artificial intelligence application includes:
  • the block is a graphical representation of the corresponding mathematical primitive
  • An operation implementation method in building an artificial intelligence application includes:
  • the server receives the character string corresponding to the dictionary, and the dictionary corresponding to the character string is used to describe the block configured for the construction of the artificial intelligence application;
  • the artificial intelligence application that the user chooses to build runs on the server.
  • An artificial intelligence application building device including:
  • the instruction receiving module is used to receive a selection instruction of a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive.
  • Construction module for configuring configuration blocks for building artificial intelligence applications in the construction area of the graphical interface through the selection instruction, and linking the blocks to form an artificial intelligence algorithm structure for artificial intelligence applications built under user control type.
  • the conversion module is used to convert the included chunks to the dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters, the core parameters corresponding to the chunks Configured.
  • the decoding initiation module is used to initiate decoding of the artificial intelligence application built by the user to the server through the dictionary, and trigger the artificial intelligence application to run on the server.
  • An operation realization device in the construction of manual and intelligent applications including:
  • the character receiving module is used for building an artificial intelligence application selected by the user, and the server receives a character string corresponding to a dictionary, and the dictionary corresponding to the character string is used to describe a block configured for building the artificial intelligence application.
  • the decoding module is used for decoding the character string to obtain the executable text of the artificial intelligence application.
  • An execution module is configured to enable the artificial intelligence application selected by the user to run on the server through execution of the executable text.
  • a machine equipment including:
  • a memory on which computer-readable instructions are stored, which when executed by the processor implements the method described above.
  • users will freely build artificial intelligence applications in the construction area of the graphical interface.
  • the block is The graphical representation of the corresponding mathematical primitives, and then configure the building blocks for the construction of artificial intelligence applications in the construction area of the graphical interface by selecting instructions, and link the blocks to form the artificial intelligence algorithm configuration of artificial intelligence applications built under user control ,
  • the conversion of the included chunks to the dictionary is obtained to obtain the dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters.
  • the core parameters are corresponding to the chunk configuration, and finally through the dictionary to the server Initiating the decoding of the artificial intelligence application built by the user can trigger the artificial intelligence application to run on the server, thereby satisfying the given artificial intelligence application needs, and implementing the artificial intelligence application for the user through the component corresponding to the mathematical primitive Since the obtained artificial intelligence applications are configured according to real needs, the blocks can be accurately adapted to the real needs. With the free configuration of the blocks, the WYSIWYG artificial intelligence applications are realized, which enhances the construction of artificial intelligence applications. Interactive performance, and lowered the threshold.
  • FIG. 1 is a schematic diagram of an implementation environment involved in the present invention
  • Fig. 2 is a block diagram of an apparatus according to an exemplary embodiment
  • Fig. 3 is a flowchart of a method for building an artificial intelligence application according to an exemplary embodiment
  • FIG. 4 is a flowchart illustrating step 330 according to the embodiment corresponding to FIG. 3;
  • FIG. 5 is a flowchart illustrating step 350 according to the embodiment corresponding to FIG. 3;
  • FIG. 6 is a flowchart illustrating step 370 according to the embodiment corresponding to FIG. 3;
  • Fig. 7 is a flowchart of a method for building an artificial intelligence application according to another exemplary embodiment
  • step 470 shown in another exemplary embodiment according to the corresponding embodiment of FIG. 7;
  • step 430 is a flowchart illustrating step 430 according to the embodiment corresponding to FIG. 7;
  • Fig. 10 is a flowchart of a method for implementing operation in building an artificial intelligence application according to an exemplary embodiment
  • FIG. 11 is a flowchart illustrating step 530 according to the embodiment corresponding to FIG. 10;
  • step 533 is a flowchart illustrating step 533 according to the embodiment corresponding to FIG. 11;
  • Fig. 13 is a schematic diagram showing a DAG structure corresponding to a simple mathematical primitive according to an exemplary embodiment
  • step 550 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10;
  • step 550 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10 in another exemplary embodiment
  • step 551b is a flowchart illustrating step 551b according to the embodiment corresponding to FIG. 15;
  • 17 is a flowchart of a method for implementing operation in building an artificial intelligence application shown in another exemplary embodiment
  • Fig. 18 is a schematic diagram of a graphical interface according to an exemplary embodiment
  • Fig. 19 is a schematic diagram of a block corresponding to a convolutional neural network operation on an operation interface according to an exemplary embodiment
  • FIG. 20 is a schematic diagram of block distribution and linking of a three-layer convolutional neural network on an operation interface according to the corresponding embodiment of FIG. 19;
  • 21 is a schematic diagram of interaction between the front end and the back end involved in the present invention according to an exemplary embodiment
  • Fig. 23 is a block diagram of a device for building an artificial intelligence application according to an exemplary embodiment
  • Fig. 24 is a block diagram of a device for implementing operation in building an artificial intelligence application according to an exemplary embodiment.
  • FIG. 1 is a schematic diagram of an implementation environment involved in the present invention.
  • the implementation environment includes a user terminal 110 and a server 130 configured in the background.
  • the user terminals 110 are not limited to a single number, that is to say, all kinds of users can interact with the server 130 through the held user terminals 110 to realize the construction of the artificial intelligence application of the present invention and the operation of the built artificial intelligence application.
  • the server 130 is accessed by the user terminal 110 for building artificial intelligence applications and running the built artificial intelligence applications.
  • the server 130 will be oriented to massive user terminals 110, and any user can freely build artificial intelligence applications and use the built artificial intelligence applications as long as they can access the server 130.
  • the threshold of the artificial intelligence application is effectively lowered, and the user will be able to immediately build and run the artificial intelligence application according to the artificial intelligence application demand generated by the user.
  • the user is provided with a platform capable of building the required artificial intelligence application at any time, but it is not limited to this, no matter whether it is an enterprise user or an end user, it no longer needs to be very expensive for their own needs. Independent development of artificial intelligence applications at cost.
  • Fig. 2 is a block diagram of a device according to an exemplary embodiment.
  • the device 200 may be the user terminal 110 in the implementation environment shown in FIG. 1.
  • the user terminal 110 is a terminal device held by a user such as a smart phone or a tablet computer, various cameras, and the like.
  • the device 200 includes at least the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, a sensor component 214 and a communication component 216.
  • the processing component 202 generally controls the overall operations of the device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 202 includes at least one or more processors 218 to execute instructions to complete all or part of the steps of the method described below.
  • the processing component 202 includes at least one or more modules to facilitate interaction between the processing component 202 and other components.
  • the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
  • the memory 204 is configured to store various types of data to support operation at the device 200. Examples of these data include instructions for any application or method operating on the device 200.
  • the memory 204 is implemented by at least any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM for short), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), read-only memory ( Read-Only Memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
  • One or more modules are also stored in the memory 204, and the one or more modules are configured to be executed by the one or more processors 218 to complete all or any of the methods shown in any of the following FIGS. 3 to 17 Partial steps.
  • the power supply component 206 provides power to various components of the device 200.
  • the power component 206 includes at least a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 200.
  • the multimedia component 208 includes a screen that provides an output interface between the device 200 and the user.
  • the screen may include a liquid crystal display (Liquid Crystal) (LCD for short) and a touch panel. If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or sliding action, but also detect the duration and pressure related to the touch or sliding operation.
  • the screen also includes Organic Light Emitting Display (Organic Light Emitting Display, OLED for short).
  • the audio component 210 is configured to output and/or input audio signals.
  • the audio component 210 includes a microphone (Microphone, MIC for short).
  • the microphone is configured to receive an external audio signal.
  • the received audio signal may be further stored in the memory 204 or sent via the communication component 216.
  • the audio component 210 further includes a speaker for outputting audio signals.
  • the sensor assembly 214 includes one or more sensors for providing the device 200 with status assessments in various aspects. For example, the sensor assembly 214 detects the on/off state of the device 200, the relative positioning of the components, and the sensor assembly 214 also detects a change in the position of the device 200 or one component of the device 200 and a change in the temperature of the device 200. In some embodiments, the sensor assembly 214 further includes a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices.
  • the device 200 accesses a wireless network based on a communication standard, such as WiFi (WIreless-Fidelity, wireless fidelity).
  • the communication component 216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short-range communication.
  • NFC Near Field Communication
  • the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth technology and other technologies. .
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • the apparatus 200 is controlled by one or more application specific integrated circuits (Application Specific Integrated Circuit (ASIC for short), digital signal processor, digital signal processing device, programmable logic device, field programmable gate array, control A microcontroller, microcontroller, microprocessor or other electronic component is implemented to perform the following method.
  • ASIC Application Specific Integrated Circuit
  • Fig. 3 is a flowchart of a method for building an artificial intelligence application according to an exemplary embodiment.
  • the method for building an artificial intelligence application includes at least the following steps.
  • step 310 a selection instruction for a block on the graphical interface is received, and the block is a graphical representation of the corresponding mathematical primitive.
  • the graphical interface is a user interface that can be used for free construction of artificial intelligence applications.
  • the artificial intelligence application construction refers to the configuration of the sequential execution of mathematical operations involved.
  • the mathematical operations configured to perform constitute the algorithm implementation of artificial intelligence applications , And then realize artificial intelligence applications that meet the set requirements.
  • the graphical interface includes an operation component selection bar, an operation interface, a toolbar, and an operation result display area.
  • the selection command applied to the block is triggered in the selection bar of the operation component.
  • the operation component selection bar includes a large number of blocks that can be selected, and these blocks correspond to the initially configured model and/or data. The user can complete the selection of the corresponding block by triggering an operation on the block and generating a selection instruction for the block, so that the selected block is configured on the operation interface.
  • the operation component selection bar on the one hand, it will be used to select the mathematical primitives involved for the currently built artificial intelligence application.
  • the mathematical primitives can be integrated models, on the other hand, they can also be built artificial intelligence.
  • the application selects the data used for the iterative training. No matter what kind of selection, it will exist in the form of a block on the selection bar of the operating component of the graphical interface.
  • the operation interface that is, the building area on the graphical interface is used to place the selected blocks for the construction of artificial intelligence applications, and these blocks will be placed under the control of the user to achieve the building.
  • the block in the operation component selection bar is triggered, it is placed on the operation interface.
  • the block in the operation component selection bar can be dragged to the operation interface by a drag operation applied to the block.
  • the block dragged to the operation interface is used for manual operation Smart application building.
  • a set of blocks corresponds to a set model or data, which is a graphical representation of the set model or data.
  • the set model can be a single mathematical operation, or a model realized by integrating more than two mathematical operations, whether it is a single mathematical operation or the integration of more than two mathematical operations, it is the integration of input, output and mathematical operations
  • the formed complex is an independent unit, also called a mathematical primitive.
  • Mathematical primitives correspond to chunks. Mathematical primitives are configured on the operation interface through chunks according to the algorithms involved in the artificial intelligence applications.
  • the mathematical primitives corresponding to chunks define mathematical operations on a level. Of course, with different levels, at a more subdivided level, the mathematical operations defined by the mathematical primitives will be subdivided, so that the block corresponds to several mathematical operations. Mathematical primitives will define the mathematical operations corresponding to the chunk from the input, output and the mathematical operations performed. In the construction of the artificial intelligence application, along with the configuration of the block, the configuration of the mathematical primitives involved in the artificial intelligence application is carried out, in order to deploy the mathematical operations performed in the constructed artificial intelligence application, and for the execution of each mathematical operation Control its input and output.
  • the toolbar on the graphical interface is used in the construction of artificial intelligence applications to adjust the corresponding data and models for the configured blocks, for example, to fine-tune the data and models.
  • the operation result display area on the graphical interface is used to display the results after the built artificial intelligence application runs. For example, after iterative training is performed on the currently built artificial intelligence application, the corresponding iterative training situation and the classification effect that can be obtained are displayed in the operation result display area.
  • the block configured in the building area is used. For the construction of artificial intelligence applications.
  • the blocks configured in the building area are the blocks selected for the artificial intelligence application currently built.
  • the mathematical primitives corresponding to the selected blocks will be used to form the current building.
  • the built artificial intelligence application for the artificial intelligence application construction, has realized the WYSIWYG artificial intelligence application construction, whether it is the degree of freedom or the self-adaptability of the built artificial intelligence application, can be enhanced.
  • the graphical interface is configured for the user to initialize the building blocks for artificial intelligence applications, that is, building the optional blocks for the current artificial intelligence applications.
  • the dragging on the required selected blocks Drag operation, selection operation, etc. have been able to achieve the construction area, that is, as mentioned above, the addition of the selected block on the operation interface, that is to say, will follow the selection instruction of the block on the graphical interface
  • the block selected by the user is configured in the building area.
  • the selection instruction indicates the block selected by the user.
  • the block is a graphical representation of the corresponding mathematical primitive. Therefore, the corresponding mathematical primitive identifier can be used to uniquely identify the block.
  • the selection instruction carries the mathematical primitive identifier to indicate the user's selection. And execute the corresponding response for this.
  • the process of realizing the construction of the artificial intelligence application will receive a selection instruction for the corresponding block on the graphical interface.
  • selection instructions corresponding to different chunks will be continuously received.
  • step 310 includes: among the several blocks of the initial configuration of the graphical interface, a user's operation applied to the chunk receives the instruction to select the chunks on the graphical interface until the artificial intelligence application is implemented All blocks are selected.
  • the graphical interface is initially configured with a large number of blocks, for example, the existence of blocks in the operation component selection bar. Users can continue to apply user operations to the required blocks according to the needs of artificial intelligence application building, such as dragging operations to the building area, so as to generate selection instructions for the continuously selected blocks, and the corresponding process will continue to receive To the generated selection instruction until all the required blocks are selected.
  • step 330 the configuration block of the artificial intelligence application is configured in the construction area of the graphical interface by selecting instructions, and the blocks are mutually linked to form an artificial intelligence algorithm configuration of the artificial intelligence application built under user control.
  • the building block for the artificial intelligence application is continuously configured in the construction area of the graphical interface, and the configured block corresponds to the mathematical primitive identifier carried in the selection instruction.
  • the building blocks of the graphical interface are configured with blocks corresponding to the involved mathematical primitives for artificial intelligence applications, and thus there are more than two blocks in the building area of the graphical interface.
  • the artificial intelligence algorithm configuration is a network topology that describes the mathematical operations performed in artificial intelligence applications, in other words, the network topology formed by the deployed mathematical primitives.
  • the output of the previous mathematical primitive will be used as the input of the next mathematical primitive, and so on to form the entire artificial intelligence algorithm configuration.
  • the artificial intelligence algorithm configuration exists in the form of a graph, that is, it may be in the form of an artificial intelligence algorithm configuration graph.
  • the configuration of the artificial intelligence algorithm indicates the blocks included in the constructed network topology and the link relationship between the contained blocks.
  • step 350 according to the configuration of the artificial intelligence algorithm, the included chunks are converted into dictionaries to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunks and the core parameters, the core parameters corresponding to the chunk configuration.
  • the configuration of the artificial intelligence algorithm indicates the blocks included in the network topology of the currently built artificial intelligence application and the link relationship between the blocks, and the blocks correspond to mathematical primitives, so
  • the conversion of chunks into dictionaries according to the configuration of artificial intelligence algorithms is the transformation of chunks into dictionary data.
  • the obtained dictionary data is used to form a dictionary for realizing artificial intelligence applications.
  • the dictionary data will be generated for the chunks to realize the conversion of the chunks contained in the artificial intelligence algorithm configuration to the dictionary.
  • the dictionary data generated for the chunks are used to indicate the corresponding mathematical primitives, and input and output control of the mathematical primitives are performed.
  • the configuration of the artificial intelligence algorithm is oriented to the network topology formed by the blocks, and the mathematical primitive identification and the core parameters configured for the mathematical primitive are obtained according to the mathematical primitives corresponding to the chunk, and the mathematical primitive identification For index items, the core parameter is the index value to construct the dictionary data corresponding to this group of blocks, and so on, the dictionary data corresponding to all the groups of blocks constitute the dictionary of the artificial intelligence application.
  • the core parameters correspond to the identification of mathematical primitives, that is, the core parameters are configured for the corresponding mathematical primitives.
  • the core parameters configured corresponding to the mathematical primitives will be obtained by fine-tuning the data and models of the corresponding components in the construction area on the toolbar.
  • the core parameters corresponding to mathematical primitives include key data such as hyperparameters, input dimensions, and output dimensions applicable to the model.
  • the configuration of the core parameters will ensure the smooth execution of the mathematical operations defined by the corresponding mathematical primitives.
  • step 370 the decoding of the artificial intelligence application built by the user is initiated to the server through the dictionary, and the artificial intelligence application is triggered to run on the server.
  • the decoding of the built artificial intelligence application can be initiated to the server through the dictionary to trigger the operation of the artificial intelligence application on the server.
  • the dictionary is obtained by the user building the artificial intelligence application, which will enable the server to obtain the built artificial intelligence application in the form of a dictionary through the mathematical primitive identification and core parameters of the included dictionary data records.
  • an artificial intelligence application based on a graphical interface is built on the user side realized by the user terminal, that is, graphical programming, and after the user completes the construction of the artificial intelligence application, the built artificial intelligence application uses block-oriented
  • the dictionary generated by the corresponding mathematical primitives enables the user to build the artificial intelligence application that can be learned by the server and then runs on the server to meet the user's artificial intelligence needs and obtain what the built artificial intelligence application can provide. Function.
  • the exemplary embodiment described above is to encapsulate the algorithms involved in artificial intelligence applications, that is, mathematical operations and their input and output into mathematical primitives, to present to the user in the form of chunks, on the basis of which the graphical interface The construction of the application of artificial intelligence was carried out.
  • FIG. 4 is a flowchart illustrating step 330 according to the embodiment corresponding to FIG. 3.
  • this step 330 is shown in FIG. 4 and includes at least:
  • step 331 the block indicated by the selection instruction is placed in the construction area of the graphical interface.
  • the building area will be configured with blocks according to the received selection instruction, so that the block indicated by the selection instruction is added to the construction area of the graphical interface.
  • step 331 is a step-by-step process of adding the required mathematical primitives for the currently built artificial intelligence application, in order to finally construct the artificial intelligence algorithm configuration that realizes the artificial intelligence application, that is, the artificial intelligence application corresponding mathematical basis Meta network topology.
  • step 333 the corresponding core parameters are obtained for the blocks placed in the building area.
  • the selection instruction is continuously triggered and generated, so that the group selected by the user can be continuously added in the building area.
  • the corresponding core parameters can be configured and adjusted to be suitable for the artificial intelligence applications currently built.
  • the configuration and adjustment of the core parameters of the corresponding mathematical primitives are performed. After the configuration and adjustment of the core parameters of the group of blocks, other The core parameter configuration and adjustment of the block.
  • the core parameter configuration and adjustment of the block can be initiated by selecting the block in the construction area. Specifically, after selecting a group of blocks in the construction area, the toolbar on the graphical interface is used to configure and adjust the core parameters of this group of blocks. At this time, the user only needs to set parameters on this toolbar Configuration and adjustment.
  • the core parameters include the hyperparameters used by the model in the mathematical primitives as well as the input and output dimensions.
  • the transformation of the link relationship of the corresponding chunks not only needs to transform the other chunks linked by the chunks in the building area, but also should adapt to the mathematical primitives of the linked chunks and adjust the input dimension and/or output dimension to adapt to the dynamics Changed artificial intelligence application building.
  • step 333 includes: selecting the block for the graphical interface building area, and obtaining the core parameter corresponding to the block according to the core parameter configuration performed by the user on the block.
  • the building area is distributed with at least one block, and any group of blocks can initiate the corresponding core parameter configuration process through its selection on the building area. Once a group of blocks is selected in the building area, the core parameter configuration of this group of blocks can be configured.
  • the core parameter configuration is the process of inputting parameters, adjusting parameters and selecting parameters under the control of the user. Different mathematical primitives corresponding to different blocks will also correspond to different core parameter configuration processes.
  • the core parameters corresponding to the selected blocks in the building area will be obtained through the core parameter configuration, and the core parameters corresponding to all the blocks in the building area will be obtained by analogy, that is, all The core parameters of the block are configured to ensure the operation of the artificial intelligence application built.
  • step 335 with the configuration of more than two blocks in the building area, the interconnection between the blocks is formed to form the artificial intelligence algorithm configuration of the artificial intelligence application built under user control.
  • the links between the blocks will be controlled under the user's control, so that the blocks distributed in the building area can be built into artificial intelligence algorithms for artificial intelligence applications structure.
  • the link between the blocks refers to the connection of the blocks in the building area. In addition to indicating the connection between the blocks, it also indicates the input and output relationship between the connected blocks; the other In terms of aspects, the link between the group blocks also indicates that the output of the previous group of blocks will be used as the input of the next group of linked blocks.
  • an artificial intelligence algorithm configuration is formed.
  • This artificial intelligence algorithm configuration is an algorithm description of the artificial intelligence application currently built by the user.
  • the running process will be the process of executing the algorithm according to the mathematical primitives and the interlinking relationship indicated by the blocks in the corresponding artificial intelligence algorithm configuration.
  • the interconnection between the blocks is realized by the wiring between the blocks under user operation.
  • the resulting artificial intelligence algorithm configuration is realized under the control of the user.
  • the user control referred to here refers to the block selection operation and the connection operation between the blocks that the user needs to trigger when building the artificial intelligence application.
  • Any operation that can configure blocks for the built artificial intelligence application and build links between the configured blocks is a user operation triggered by forming an artificial intelligence algorithm configuration.
  • an artificial intelligence algorithm configuration is built for the currently built artificial intelligence application, so as to realize algorithm development, enhance users to build artificial intelligence algorithm configurations at will for their own needs, and at the same time increase flexibility Achieved the required artificial intelligence application building, which is no longer limited by the lack of professional knowledge such as code knowledge, artificial intelligence algorithms and mathematical representation.
  • FIG. 5 is a flowchart illustrating step 350 according to the embodiment corresponding to FIG. 3.
  • the step 350 includes:
  • step 351 for the blocks included in the configuration of the artificial intelligence algorithm, the mathematical primitive identification and core parameters corresponding to the blocks are obtained.
  • the artificial intelligence algorithm configuration is an algorithm logic description of the models and data used in the built artificial intelligence application, that is, the algorithm logic composed of the introduced mathematical primitives, and as pointed out in the foregoing description, the artificial intelligence algorithm configuration is The network topology composed of all the multiple blocks.
  • the blocks distributed in the building area and the relationship between them form the block architecture of the artificial intelligence application, which indicates that the artificial Mathematical primitives used in intelligent application building and the linking relationship between mathematical primitives.
  • each mathematical primitive has a corresponding code description, that is, code information including core parameters, so as to achieve the execution of the corresponding mathematical operation through the execution of the corresponding code description.
  • code description that is, code information including core parameters
  • the configuration of artificial intelligence algorithms composed of blocks, the existence of corresponding mathematical primitives will indicate the code description information for performing a series of mathematical operations under this artificial intelligence algorithm configuration, that is, the corresponding and containing The executable text composed of the code information of the core parameters.
  • the generated dictionary is used to deliver the artificial intelligence algorithm configuration adaptively constructed by the user to the server, so as to obtain the artificial intelligence application running on the server.
  • Each block has a corresponding mathematical primitive, that is, the block is a graphical representation of the corresponding mathematical primitive. Therefore, for the block under the artificial intelligence algorithm framework, the corresponding mathematical primitive identifier can be obtained , And the core parameters are obtained along with the core parameter configuration of the chunks described above. For a group of blocks, the obtained core parameters correspond to the identification of mathematical primitives.
  • step 353 a dictionary of artificial intelligence applications is constructed with the mathematical primitive identifier as the index item and the core parameter as the index value.
  • the dictionary data is constructed for each block under the configuration of the artificial intelligence algorithm, that is, the corresponding mathematical primitive identification is used as the index item, and the core parameter is used as the index value to construct the dictionary data for the block, and so on,
  • the dictionary data of all the blocks under the configuration of artificial intelligence algorithm will form the dictionary of artificial intelligence application.
  • the image information of the chunk is converted into code that exists on the server side, that is, the executable text of the artificial intelligence application is obtained, so as to solve the dilemma of the artificial intelligence algorithm is complex and difficult to adapt to user development.
  • the core parameters of the artificial intelligence application built by the user will also be passed to provide the server with the core parameters of the user's personalized configuration, ensuring the accuracy of the construction of the artificial intelligence application Adapt to the user's artificial intelligence application needs.
  • FIG. 6 is a flowchart illustrating step 370 according to the corresponding embodiment of FIG. 3.
  • the step 370 includes at least:
  • step 371 character string conversion is performed on the mathematical primitive identification and indexed core parameters in the dictionary.
  • the dictionary After generating the dictionary for the artificial intelligence application built by the user through the foregoing exemplary embodiment, the dictionary needs to be converted into a string, so that the dictionary carries the mathematical primitive identification and core parameters from the user terminal to the server.
  • the mathematical primitive identification in the dictionary and the core parameters of the index are converted into JSON strings, and the dictionary will be transmitted to the server in the form of JSON strings.
  • step 373 the artificial intelligence application built for the user transmits a character string to the server, and initiates decoding of the character string by the server through transmission of the character string to obtain executable text of the artificial intelligence application to run on the server.
  • the server After receiving the character string sent by the user terminal to the built artificial intelligence application, the server converts the character string decoding back into the form of a dictionary, and then decodes the mathematical language representation of graph theory to obtain executable text.
  • the executable text is the code description of the artificial intelligence application built by the user.
  • the execution of executable text executes a series of operations configured by the user to realize the artificial intelligence application. This process is the running process of the artificial intelligence application.
  • the built artificial intelligence application can exist on the server side, and then the functions configured in the artificial intelligence application can be fully realized through excellent hardware conditions on the server side.
  • Fig. 7 is a flowchart illustrating a method for building an artificial intelligence application according to another exemplary embodiment.
  • the method for building an artificial intelligence application further includes the following steps:
  • step 410 the block configured in the building area receives a user's new block selection instruction, and the new block selection instruction acts on at least one block configured in the building area.
  • the building area is under the control of the user to add at least one block.
  • This user-controlled process of adding blocks to the building area can be the process of building an artificial intelligence application, or it can be built for subsequent artificial intelligence applications.
  • the process of adding blocks can be the process of building an artificial intelligence application, or it can be built for subsequent artificial intelligence applications.
  • new blocks can be added, so that the initial configuration of the graphical interface block is added according to user needs, which is convenient for the subsequent construction of artificial intelligence applications.
  • a new block can be added to the selected at least one block, and a new block selection instruction can be generated.
  • the newly added block selection instruction is applied to at least one block selected by the user in the building area.
  • step 430 a dictionary corresponding to the block corresponding to the newly added block selection instruction is generated, and the dictionary includes a mathematical primitive identifier corresponding to the block and core parameters.
  • a dictionary is generated for the block acting on the new block selection instruction.
  • the dictionary generated for adding new blocks describes the corresponding mathematical primitive identification and core information of the combined blocks. For the newly added chunks and the corresponding newly added mathematical primitives, the generated dictionary is described by data for this purpose.
  • the mathematical primitive identifier uniquely identifies the corresponding block
  • the core parameters corresponding to the block are Contains the input dimension and output dimension corresponding to the mathematical operation, so it will indicate the link relationship between the chunks.
  • the core parameters of the input dimension and the output dimension are specified for the chunks, that is, the mathematical primitives, which will be used to determine the links between chunks. If the output dimension of the mathematical primitive corresponding to one group of blocks is the input dimension of the mathematical primitive corresponding to another group of blocks, it indicates that the two groups of blocks are linked to each other.
  • the generated dictionary the grouped blocks and the link relationship between the blocks can be accurately known without consuming excessive storage space and more calculation cost.
  • step 450 the mathematical primitive identification and core parameters in the dictionary are combined and added into the newly added mathematical primitives through the mathematical language representation of graph theory.
  • the dictionary is used as the data description of the newly added mathematical primitives.
  • the data description in the dictionary is represented as a mathematical language of graph theory according to the mathematical primitive identification and its corresponding core parameters, so as to obtain several block combinations New mathematical primitives formed by encapsulation.
  • the mathematical language representation of graph theory is to track the input values in the basic mathematical primitives, the mathematical operations done on the input values, and the output values, in order to reconstruct and characterize the mathematical primitives. No matter the input value, mathematical operation or output value, they will be reconstructed in the form of nodes, and then form the mathematical language representation of mathematical primitives in graph theory. Through the mathematical language representation of graph theory, the newly added mathematical primitives can be reconstructed accurately and quickly.
  • the server obtains the character string and decodes it and converts it back into a dictionary, it reconstructs the mathematical language representation of each mathematical primitive on the graph theory based on the dictionary, in order to quickly repeat Construct mathematical operations performed by artificial intelligence applications and the input and output dimensions of the performed mathematical operations.
  • the artificial intelligence application obtained by the construction of multiple blocks is composed of several mathematical primitives.
  • the newly added blocks constitute an executable program, similar to it, which is also built by at least one or more blocks
  • the reconstruction of the mathematical primitives of the newly added blocks is also based on the reconstruction of the mathematical language representation of each mathematical primitive in the graph theory based on the dictionary.
  • step 470 the new mathematical primitives are updated to the graphical interface and the server.
  • step 450 After obtaining the mathematical primitives corresponding to the newly added chunks through the execution and reconstruction of step 450, it is necessary to update the graphical interface and the server. On the one hand, there are new blocks among the many blocks that the graphical interface can provide to users, so that users can add new blocks to the building area. On the other hand, it will also enable the server to be used by the graphical interface.
  • the newly added chunks are configured during the initialization of the chunks, and the data related to the newly added chunks are identified in the received dictionary, so that the mathematical primitives corresponding to the newly added chunks can be run on the server.
  • the new mathematical primitives are updated, including the image information related to the block.
  • the new mathematical primitives are uniquely identified and the mathematical primitives are stored for all mathematical primitives that constitute the new mathematical primitives. Identification and core parameters. Therefore, the update of the newly added mathematical primitives also includes the update of mathematical primitive definition information such as mathematical primitive identification and core parameters.
  • the updated mathematical primitive definition information describes the newly added mathematical primitives and the execution of mathematical operations in the newly added mathematical primitives.
  • the function of adding new blocks is provided for the construction of artificial intelligence applications, so that users can build configuration blocks according to their own application requirements and habits, in addition to the existence of the graphical interface
  • configuration blocks In addition to the original configuration blocks, there will also be user-defined configuration blocks, and the convenience and freedom of building artificial intelligence applications will be enhanced.
  • the blocks that are frequently combined for artificial intelligence application building are packaged and packaged together to form a new block.
  • it is to combine the original more detailed mathematical operations into a new mathematical operation, in order to build a new operation for the artificial intelligence application performed by the user, and enhance the execution performance of the artificial intelligence application.
  • step 470 includes: adding a new block to the graphical interface for the newly added mathematical primitive according to the configured block name, so as to update the added new block among the several blocks of the initial configuration of the graphical interface Add chunks.
  • the newly added mathematical primitives must have corresponding newly added blocks on the graphical interface, that is to say, the newly added mathematical primitives must be represented in the form of newly added blocks on the graphical interface.
  • the blocks that represent mathematical primitives also called tiles, are the targets that users manipulate to build artificial intelligence applications.
  • the newly added blocks corresponding to the newly added mathematical primitive configuration on the graphical interface are marked with the names of the corresponding blocks to distinguish them from other blocks. It is convenient for users to choose.
  • FIG. 8 is a flowchart illustrating step 470 shown in another exemplary embodiment according to the corresponding embodiment of FIG. 7.
  • this step 470 includes at least:
  • step 471 a new mathematical primitive identifier is generated for the new mathematical primitive.
  • the newly added mathematical primitive logo is similar to the aforementioned mathematical primitive logo, and is used to uniquely identify the corresponding mathematical primitive and block.
  • the configured core parameters correspond to the generated new mathematical primitive identifiers.
  • step 473 the mathematical primitive definition information and the core parameter of the newly added mathematical primitive package are generated under the newly added mathematical primitive identifier.
  • the newly added chunks are composed of at least one chunk.
  • the newly added mathematical primitives corresponding to the newly added chunks are also formed by packaging and packaging at least one mathematical primitive.
  • the new mathematical identifier generated for the new mathematical primitive corresponds to at least one set of mathematical primitive identifiers and core parameters.
  • a set of mathematical primitive identifiers and core parameters used to describe the digital primitives of the corresponding block together with other sets of mathematical primitive identifiers and core parameters, describe the new mathematical primitives, that is, generate math for the new mathematical primitives Primitive definition information.
  • step 475 the mathematical primitive definition information is updated to the server.
  • the updating of the mathematical primitive definition information on the server enables the newly added mathematical primitive to add the corresponding block in the initialization of the graphical interface by the server.
  • the existence of mathematical primitive definition information on the server means that the corresponding newly added mathematical primitives and blocks are deployed in the subsequent artificial intelligence application building, and the subsequent artificial intelligence for the user through the graphical interface Application building, you can use the newly added blocks, and then configure the newly added mathematical primitives in the built artificial intelligence applications.
  • FIG. 9 is a flowchart illustrating step 430 according to the embodiment corresponding to FIG. 7.
  • the step 430 includes at least:
  • step 431 the corresponding mathematical primitive identification and core parameters are obtained respectively according to all the blocks acting on the newly added block selection instruction.
  • the newly added chunks are implemented corresponding to at least one chunk selected by the user, which is to combine at least one mathematical primitive corresponding to the chunks and form a new group for this purpose Piece.
  • the user chooses to add a new block, it is equivalent to selecting at least one corresponding block, which will enhance the convenience and efficiency of artificial intelligence application building, and can quickly build artificial intelligence applications.
  • the block interconnections form a network topology capable of performing at least one mathematical operation.
  • the input and output dimensions of the core parameters corresponding to the chunks have been configured according to the currently constructed link relationship, and the corresponding mathematical primitive identification and core parameters can be obtained for each chunk to be used for each group
  • the block generates dictionary data, and the dictionary data indicates the link relationship between the located block and the other linked blocks.
  • step 433 for each group of blocks, a corresponding mathematical primitive identifier is used as an index item, and core parameters are index values to construct dictionary data to generate a dictionary corresponding to the newly added group of blocks.
  • dictionary data is constructed for each group of blocks through a key-value pair data structure, where the key-value pair data structure uses mathematical primitives as index items and core parameters as index values.
  • Dictionary data is constructed separately for all the blocks that make up the newly added blocks, and the dictionary corresponding to the newly added blocks is generated from all dictionary data.
  • Fig. 10 is a flow chart showing a method for implementing operation in building an artificial intelligence application according to an exemplary embodiment.
  • the operation implementation method in the construction of an artificial intelligence application includes at least the following steps.
  • step 510 when the user chooses to build an artificial intelligence application, the server receives the character string corresponding to the dictionary, and the dictionary corresponding to the character string is used to describe the building blocks configured for the artificial intelligence application.
  • the deployed server will respond to the manipulation of the user terminal and cooperate with the realization of the construction of the artificial intelligence application to obtain the artificial intelligence application existing on the server for the user.
  • the operation of artificial intelligence applications is achieved through the execution of a series of mathematical operations, that is, the operations required by users are realized in units of mathematical primitives.
  • the execution of mathematical operations must be supported by the corresponding code information to control the execution of the mathematical operations on the server side. Therefore, the server side stores the information related to the code for the deployed blocks accordingly, which requires users to retrieve them separately under the control of the dictionary generated by the built artificial intelligence application to obtain executable text that can realize the operation of the artificial intelligence application. .
  • the dictionary generated for the built artificial intelligence application will be converted into a string and sent to the server, so that the server can obtain the user's Built artificial intelligence applications.
  • the server will receive the character string sent by the user terminal.
  • the dictionary converted to this character string describes and defines the corresponding mathematical primitives for the corresponding chunks through a piece of dictionary data.
  • the mathematical primitives are the operation units for implementing artificial intelligence applications in the construction of artificial intelligence applications for users. They can divide the operation units at different levels according to needs, and then configure the mathematical primitives and The corresponding chunk.
  • neural network operations For example, according to artificial intelligence algorithms, neural network operations, dot product operations, and matrix multiplication operations are all configured as operating units. Some neural network operations include dot product operations. Therefore, you can see that both It is the division of operating units at different levels, but it does not affect the configuration of the corresponding mathematical primitives and chunks.
  • the subdivided operation units can also be combined to form a new operation unit on the upper layer, that is, mathematical primitives and chunks. This is the process of adding chunks referred to in the foregoing exemplary embodiments.
  • step 530 the character string is decoded to obtain the executable text of the artificial intelligence application.
  • the character string obtained by the dictionary conversion can be decoded to obtain the mathematical primitive identification and core parameters involved in the built artificial intelligence application.
  • the DAG data is continuously expressed by the mathematical language of graph theory.
  • the structure reconstructs each mathematical primitive, and constructs the link relationship between this mathematical primitive and other mathematical primitives for this purpose, and finally forms the executable text corresponding to the built artificial intelligence application.
  • the executable text contains all the executable sentences of the built artificial intelligence application, which is composed of the code information of all mathematical primitives.
  • step 550 through execution of the executable text, the user is allowed to choose to build the artificial intelligence application to run the server.
  • the operation of the artificial intelligence application can be triggered.
  • the functions deployed by the artificial intelligence application will be realized through the execution of the sentences in the executable text to satisfy the user’s Artificial intelligence needs.
  • FIG. 11 is a flowchart illustrating step 530 according to the embodiment corresponding to FIG. 10.
  • the step 530 includes at least the following steps:
  • step 531 the character string is decoded and converted into a dictionary, which contains the mathematical primitive identification and core parameters corresponding to the chunks configured for artificial intelligence applications.
  • step 533 the code information for performing the corresponding mathematical operation is reconstructed through the mathematical primitive identifier and core parameters contained in the dictionary to obtain the executable text of the artificial intelligence application.
  • a set of mathematical primitive identifiers and core parameters corresponding to each mathematical primitive can be obtained from the obtained dictionary.
  • the set of dictionary data of the mathematical primitive identification and core parameters indicate the corresponding mathematical primitives and other mathematical primitives linked to this mathematical primitive, ie the input dimension is the math of the output dimension in the core parameters
  • the primitive is the link to the current mathematical primitive.
  • FIG. 12 is a flowchart describing step 533 according to the embodiment corresponding to FIG. 11. In an exemplary embodiment, this step 533 is shown in FIG. 12 and includes at least the following steps.
  • step 601 the data missing code of the corresponding mathematical operation is obtained according to the mathematical primitive identification in the dictionary.
  • the server is controlled by the artificial intelligence applications built by the user terminal to obtain a dictionary for the built artificial intelligence applications, the dictionary records the mathematical primitives corresponding to each mathematical primitive used by the built artificial intelligence applications Logo and core parameters.
  • the server also stores the information related to the code for the mathematical operations that need to be performed.
  • the code-related information stored for the execution of each mathematical operation is the data-missing code with missing core parameters.
  • the data missing codes are stored correspondingly with the index of the mathematical primitive as the index.
  • the data missing code with missing core parameters can be adapted to fill different core parameters with the realization of different artificial intelligence applications, and realize different configurations of the mathematical operations performed, so as to fully adapt to the realization of artificial intelligence applications.
  • the server side provides users with artificial intelligence application algorithms supported by the data missing code, allowing users to build artificial intelligence applications simply and intuitively through the block, and the other
  • the aspect will also obtain flexible and free algorithm implementation with the support of data missing code, which enhances the flexibility of artificial intelligence application construction.
  • step 603 the core parameters corresponding to the mathematical primitive identification are filled into the obtained data missing code to obtain code information for performing the corresponding mathematical operation.
  • the core parameters in the dictionary are corresponding to the mathematical primitive identification. Therefore, after the data missing code is obtained from the mathematical primitive identification, the corresponding core parameters will also be obtained from the mathematical primitive identification.
  • the acquired core parameters are filled into the data-missing code to obtain complete code information for performing the corresponding mathematical operation.
  • the code information obtained by filling in the core parameters is a mathematical primitive description at the code level. Under the effect of missing data codes and code information, users can build artificial intelligence applications according to their own needs even without programming intelligence and programming skills.
  • step 605 according to the input dimension and output dimension indicated in the core parameter corresponding to the mathematical primitive identification, the executable information of the artificial intelligence application is reconstructed from the output of the code information to the input through the mathematical language of graph theory.
  • the core parameters are the corresponding mathematical operations performed, and also indicate the input and output dimensions for the implementation of the artificial intelligence algorithm through the code information. Therefore, it can be based on this and other Mathematical primitive docking.
  • the mathematical language representation of graph theory is for mathematical primitives, and also for code information that performs corresponding mathematical operations.
  • the mathematical language representation of graph theory is to use the DAG structure to quickly and accurately reconstruct the input, output, and mathematical operations corresponding to the mathematical primitives, and then on the basis of this, the DAG structure corresponding to the mathematical primitives is continuously carried out in the order of output to input. Until the completion of the reconstruction of all mathematical primitives corresponding to the dictionary.
  • the corresponding code information can be reconstructed according to the mathematical language representation of graph theory to obtain the executable text of the artificial intelligence application.
  • Fig. 13 is a schematic diagram of a DAG structure corresponding to a simple mathematical primitive according to an exemplary embodiment.
  • the following table shows the "I” and "O" data tables configured by the user on the block Add in the graphical interface.
  • the block add indicates that the corresponding mathematical primitive will perform an addition operation on the input data, as shown in the following table. which is:
  • the construction of artificial intelligence applications can be quickly realized even if complex artificial intelligence algorithms are involved by means of the DAG structure.
  • FIG. 14 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10.
  • this step 550 includes at least the following steps.
  • step 551a in the training mode, sample data suitable for artificial intelligence applications is obtained, and the training mode is the mode selected by the user on the graphical interface.
  • step 553a an artificial intelligence application is run on the server through execution of executable text, and parameter training is performed through sample data during the operation of the artificial intelligence application.
  • This exemplary embodiment provides the training process of the artificial intelligence application for the artificial intelligence application built by the user, so that the artificial intelligence application built by the user completes the iterative training of the parameters through the set sample parameters, and then the built artificial intelligence application can be used normally .
  • the sample data suitable for artificial intelligence applications is configured by the user in an exemplary embodiment, for example, the user imports sample data through the toolbar set by the graphical interface, and can also be related to the data through the operation interface
  • the set of blocks can be used to set the sample data for the artificial intelligence applications built, and the sample data can also be selected through the check box set in the toolbar.
  • the sample data is collected by the user, it can also be stored on the server and shared by other users, or it can be pre-configured by the server according to the needs of various artificial intelligence applications. It is not limited here.
  • the artificial intelligence application for the artificial intelligence application that has been built, it can be placed in training mode or operation decision mode through user control, so as to control the operation of the artificial intelligence application.
  • it can set a switch that is turned on in the training mode or decision mode on the graphical interface. The user only needs to manipulate the switch to select the corresponding mode.
  • sample data suitable for artificial intelligence applications according to the sample data configuration performed by the user, for example, obtain sample data recommended by the server, obtain sample data shared by other users, and import it in the graphical interface The required sample data, etc.
  • the application of artificial intelligence is based on machine learning, and solves specific problems for users through machine learning algorithms.
  • the machine learning algorithm may be a neural network algorithm. Therefore, the completed artificial intelligence application must involve the realization of training, and the parameters required for the normal operation of the artificial intelligence application can be obtained through iterative training.
  • the entrance of sample data acquisition is realized for the built artificial intelligence application. Even if the user is limited to various situations and cannot obtain a large amount of sample data, it can be obtained by means of the server, thereby ensuring that the built Based on the training and subsequent use of artificial intelligence applications, users can also adapt to their own needs to prepare sample data to ensure the accuracy of subsequent decisions of the artificial intelligence applications built.
  • sample data submitted by the user to the server can be hidden according to their own choices, that is, stored as their own private data, but they can also be set to the public state for sharing on the server.
  • the sample data can also be obtained by crowdsourcing, which is not limited here.
  • FIG. 15 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10 in another exemplary embodiment.
  • this step 550 includes:
  • step 551b data selected by the user for input is acquired, and the data includes target data processed by the artificial intelligence application built by the user.
  • step 553b by executing an executable file that completes parameter training, running the trained artificial intelligence application in the decision mode completes the user's selection of input data.
  • This exemplary embodiment realizes that the user uses the self-built artificial intelligence application to make data decisions, and the built artificial intelligence application truly solves the user's data processing needs.
  • the data that the user chooses to input is the data that the user needs to process with the help of the built artificial intelligence application. It should be understood that the user is building the artificial intelligence application for this data processing requirement.
  • FIG. 16 is a flowchart illustrating step 551b according to the corresponding embodiment of FIG. 15.
  • this step 551b, as shown in FIG. 16, includes at least the following steps.
  • step 601 the data uploaded by the user to the artificial intelligence application built by the user on the graphical interface is received.
  • the user will upload the data processed by the artificial intelligence application on the graphical interface.
  • the data content and data types are different.
  • the uploaded request artificial intelligence The data processed by the application can be text data, video data or even audio data.
  • step 603 the artificial intelligence application built by the user is determined according to the user identifier carried in the data.
  • the server cooperates with many user terminals to implement the construction of artificial intelligence applications on each user terminal. Therefore, different users have different artificial intelligence applications. Therefore, for the server, the user identification is used as an index to store the dictionary to record the artificial intelligence applications corresponding to different users.
  • the artificial intelligence application that has been built and trained is completed, and its dictionary is stored on the server for users to call at any time.
  • the user can call the built and trained artificial intelligence application when he needs to access the server, and in the use of the artificial intelligence application, iteratively optimizes the parameters in the artificial intelligence application by means of decision-making results. To continuously improve the accuracy of decisions.
  • the user ID is used to uniquely identify the user. Therefore, the user can log in to the server through the user ID, and then call the built artificial intelligence application.
  • step 605 the target data requested by the artificial intelligence application built by itself to be processed in the data is triggered to run the determined artificial intelligence application.
  • the artificial intelligence corresponding to the user identification is requested to process the uploaded data, in order to run the artificial intelligence application with the uploaded data as input.
  • Fig. 17 is a flowchart of a method for implementing operation in building an artificial intelligence application shown in another exemplary embodiment.
  • the operation implementation method in the construction of artificial intelligence applications includes at least the following steps.
  • step 710 the user's update of the newly added mathematical primitive is received to obtain digital primitive definition information.
  • the mathematical primitive definition information includes the newly added mathematical primitive identifier and the newly added mathematical primitive under the newly added mathematical primitive identifier At least one mathematical base identifier and core parameters corresponding to the package.
  • step 730 the mathematical primitive definition information is saved, and the graphical interface is initialized and configured with new blocks.
  • the server controlled by the user terminal will necessarily receive the mathematical primitive definition information sent by the user terminal.
  • the user will save the mathematical primitive definition information for the user to call in the subsequent artificial intelligence application construction.
  • the user's artificial intelligence application needs to be short-video action recognition. Take this as an example and explain in combination with the above method. Narrate.
  • the user needs to realize the video action recognition through the artificial intelligence application of the present invention.
  • the action can be recognized by an artificial intelligence application built by the user, and the action classification result can be output.
  • the user can drag and drop the required blocks in the operation component selection bar of the graphical interface to drag the required blocks to the operation interface, And build a link relationship through the connection between the blocks until the construction of the artificial intelligence algorithm configuration is completed.
  • the neural network operation adopted in the constructed artificial intelligence algorithm configuration is the mathematical operation adopted by the user for the artificial intelligence application.
  • Fig. 18 is a schematic diagram of a graphical interface according to an exemplary embodiment.
  • the operation component selection bar 810 is provided with a number of operation components, that is, blocks related to data and models; the operation interface 830 is a stay area where users need to drag and drop the blocks , Complete the data and model building by dragging and dropping the icon, that is, the component.
  • fine-tuning of data and models will also be performed through the toolbar 850 on the right.
  • the information related to the iterative training process such as the number of iterations and the related iterative training results, will be displayed through the operation result display area 870, where the accuracy of the data and model training will also be displayed to ensure that the user can master artificial intelligence Real performance.
  • the artificial intelligence application built by the user that can realize the video action video can try different artificial intelligence algorithm configurations through continuous block dragging to find available artificial intelligence algorithm configurations.
  • FIG. 19 is a convolutional neural network according to an exemplary embodiment. Schematic diagram of the block corresponding to the operation on the operation interface. Block I represents the input, block Dense represents the operation of the convolutional neural network in the deep learning neural network, and block O represents the output. On this basis, then to the operation interface Drag two blocks corresponding to the operation of the convolutional neural network to construct a three-layer convolutional neural network to achieve the extraction of convolutional features in the built artificial intelligence application.
  • FIG. 20 is shown according to the corresponding embodiment of FIG. 19 Schematic diagram of block distribution and links on the operation interface of the three-layer convolutional neural network.
  • the process is roughly as follows: first, learn the code knowledge completely, have a certain code development ability, and then learn the manual Intelligent expertise, in the end, as a developer, according to the current specific needs, choose the appropriate programming language to carry out algorithm development in the compiler, the time period required for this process is at least 7 years.
  • code knowledge deep learning algorithms related to machine learning, mathematical representation, and overall knowledge of artificial intelligence are difficult to popularize, and the code learning threshold is also insurmountable by the public.
  • the implementation and development of the present invention first provides a user-friendly interface for the public, and encapsulates many technical details in the form of blocks and mathematical primitives to achieve standardized Artificial intelligence model building process, so as to really help the public to use artificial intelligence technology.
  • the artificial intelligence algorithm is different from the simple algorithm logic similar to that involved in children's programming. It is a complex natural expression and is difficult to implement with the help of graphical user programming.
  • code encapsulation is implemented through mathematical primitives to achieve the required mathematical operations, and graphical blocks are defined on the graphical interface to represent them.
  • Fig. 21 is a schematic diagram of interaction between a front end and a back end involved in the present invention according to an exemplary embodiment.
  • the user side implements a website graphical interface, that is to say, for the user, the artificial intelligence application needed to be implemented through a web application only needs to know the corresponding background Visit the address to run the web application through the browser.
  • the back-end server will convert the graphics into code according to the user-configured block, that is, to obtain the built artificial intelligence application, and rely on the server to provide Cloud computing capabilities return results to users, or artificial intelligence algorithm configuration diagrams.
  • AI Artificial Intelligence
  • the user constructs an AI (Artificial Intelligence) algorithm in the mathematical language of graph theory, that is, the mathematical primitive referred to above, and the algorithm information involved is stored in a dictionary implemented in JavaScript language.
  • the dictionary can be submitted to the server in the background in the form of a JSON string.
  • the server sends it to the output end
  • the server will complete the training according to the AI code language and return the results to the website graphical interface and display it.
  • mathematical primitives correspond to mathematical operations, which can include basic mathematical operations (BMO, Basic, Mathematical Operations) such as addition, subtraction, multiplication, and division, as well as various complex mathematical operations, such as,
  • BMO Basic
  • Mathematical Operations such as addition, subtraction, multiplication, and division
  • various complex mathematical operations such as,
  • the mathematical language expression of mathematical primitives in graph theory, such as neural network operations is a DAG structure used to express mathematical operations, also known as MNG (Mathematical Network Graph).
  • DAG Directed Acyclic Graph
  • DAG Directed Acyclic Graph
  • FIG. 22 shows a schematic diagram of the implementation of the overall solution of the present invention in an exemplary embodiment.
  • an artificial intelligence application independently developed by a user, it includes four major stages, namely: a construction stage, a stage for sending pictures, a stage for translating a dictionary to MNG, and a loopback Results stage.
  • the construction period is the stage for the user to build the required artificial intelligence application.
  • the user can build the artificial intelligence algorithm and the new MNG block through the block, whether it is the artificial intelligence algorithm or the new MNG.
  • the construction of tiles, their corresponding mathematical primitive indexes and core parameters are marked and stored in the dictionary.
  • the phase of sending the diagram is carried out by the construction period.
  • the send map stage is the stage where the dictionary is sent for the constructed artificial intelligence algorithm or new MNG block.
  • the reason why it is called the send map stage refers to the artificial intelligence algorithm or MNG block corresponding to the dictionary.
  • a network topology diagram In a network topology diagram.
  • the type conversion of the character string received by the server is realized to eliminate the character string and decode and convert it back to the dictionary.
  • the translation dictionary is entered into the MNG stage.
  • the server will identify the MNG, that is, the mathematical primitive, to generate code through the DAG structure, obtain the executable AI code language, and train and Return the result.
  • the trained AI code language can be used to make decisions on the data.
  • the decision-making phase for data is still running and returning results.
  • the server completes the construction of the artificial intelligence application method, it obtains the AI code language. At this time, it will recognize the model and check whether it has been trained. If it has been trained and contains the data to be run, use this The data runs AI code language and returns the result.
  • the decision is made on the data, it will also be confirmed to the user by showing the artificial intelligence algorithm configuration diagram to the user, and the previously trained AI code language can be run on top of this basis.
  • This artificial intelligence algorithm configuration diagram has been constructed by building blocks when users build artificial intelligence applications.
  • the process of obtaining the AI code is the process of extracting important information from the artificial intelligence algorithm configuration diagram and parsing it into code, which is used to encapsulate, that is, encapsulate for each data primitive, and realize net-to-gate, that is, by Network structure to a single mathematical operation. So far, it can be understood that any mathematical operation or mathematical equation is a complex of BMO.
  • BMOs are linked together to form a DAG structure, which is expressed as MNG.
  • MNG has its own input and output, and the input and output between different MNGs can be linked to each other to form a complete logical network. Therefore, it can be used as an equivalent transition between block and code. In this way, the information corresponding to the block is accurately transferred to the code, and the conversion between the graphical interface and the text programming language is realized.
  • each mathematical primitive is realized at the beginning, and at the same time, they are also the basis for user control.
  • the network structure built by users through blocks will be converted into a dictionary as before. Then convert the dictionary to DAG format and parse it. Then, the network structure becomes a mathematical primitive, which is then added to the server as a new mathematical primitive.
  • the newly formed mathematical primitives can be used as other primitives to construct other networks. As this cycle repeats, more complex algorithms can be developed without increasing the difficulty of developing graphics-based programming languages.
  • the following is a device embodiment of the present invention, which is an embodiment of a building device for executing the above artificial intelligence application of the present invention.
  • a device embodiment of the present invention is an embodiment of a building device for executing the above artificial intelligence application of the present invention.
  • the device embodiment of the present invention please refer to the embodiment of the method for building an artificial intelligence application of the present invention.
  • Fig. 23 is a block diagram of a device for building an artificial intelligence application according to an exemplary embodiment.
  • the artificial intelligence application building device includes but is not limited to: an instruction receiving module 1010, a construction module 1030, a conversion module 1050, and a decoding initiation module 1070.
  • the instruction receiving module 1010 is configured to receive an instruction for selecting a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive.
  • Constructing module 1030 configured to configure blocks for building artificial intelligence applications in the building area of the graphical interface through the selection instruction, and link the blocks to form an artificial intelligence algorithm for artificial intelligence applications built under user control structure.
  • the conversion module 1050 is configured to convert the included chunks into a dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters, the core parameters corresponding to the group Block configuration.
  • the decoding initiation module 1070 is used to initiate decoding of the artificial intelligence application built by the user to the server through the dictionary, and trigger the artificial intelligence application to run on the server.
  • Fig. 24 is a block diagram of a device for implementing operation in building an artificial intelligence application according to an exemplary embodiment.
  • the operation implementation device in the manual and intelligent application building includes, but is not limited to: a character receiving module 1110, a decoding module 1130, and an execution module 1150.
  • the character receiving module 1110 is used for building an artificial intelligence application selected by the user, and the server receives a character string corresponding to a dictionary, and the dictionary corresponding to the character string is used to describe a block configured for building the artificial intelligence application.
  • the decoding module 1130 is configured to decode the character string to obtain the executable text of the artificial intelligence application.
  • the execution module 1150 is configured to enable the artificial intelligence application selected by the user to run on the server through execution of the executable text.
  • the present invention also provides an electronic device, which can be used in the implementation environment shown in FIG. 1 to perform all or part of the steps of any of the methods shown in FIGS. 3 to 17.
  • the device includes: a processor; a memory for storing processor executable instructions;
  • the processor is configured to perform the method mentioned above.
  • a storage medium is also provided.
  • the storage medium is a computer-readable storage medium, for example, it may be a temporary and non-transitory computer-readable storage medium including instructions.
  • the storage medium includes, for example, a memory 204 of instructions that can be executed by the processor 218 of the device 200 to complete the above method.

Abstract

A method for building an artificial intelligence application, a method for operational implementation during artificial intelligence application building, apparatuses, and a machine device. The method comprises: receiving a selection instruction for blocks on a graphical interface, wherein the blocks are graphical representations of corresponding mathematical primitives (310); by means of the selection instruction, configuring in a building area the blocks for artificial intelligence application building, and linking the blocks with each other to form an artificial intelligence algorithm configuration of an artificial intelligence application built under the control of a user (330); according to the artificial intelligence algorithm configuration, obtaining a dictionary composed of mathematical primitive identifiers corresponding to the blocks and core parameters, the core parameters being configured to correspond to the blocks (350); by means of the dictionary, triggering the artificial intelligence application to operate on a server end. The method meets given artificial intelligence application requirements, implements artificial intelligence application building by means of components corresponding to the mathematical primitives, accurately adapts to real needs, freely implements "what you see is what you get" artificial intelligence applications, enhances interaction performance, and lowers thresholds.

Description

人工智能应用的搭建、运行实现方法、装置和机器设备Artificial intelligence application construction, operation implementation method, device and machine equipment 技术领域Technical field
本发明涉及互联网应用技术领域,特别涉及一种人工智能应用的搭建方法、人工智能应用搭建中的运行实现方法、装置和机器设备。The present invention relates to the field of Internet application technology, and in particular, to a method for building an artificial intelligence application, a method, a device, and a machine for implementing an operation in building an artificial intelligence application.
背景技术Background technique
随着人工智能技术的发展,越来越多的人工智能应用在诸多场景基于人工智能技术为所获得的数据进行着各种决策。与此相对应的,各类用户,例如,企业用户、终端用户,都能够借助于人工智能应用获得便利。With the development of artificial intelligence technology, more and more artificial intelligence applications are used in many scenarios to make various decisions based on artificial intelligence technology for the data obtained. Corresponding to this, all kinds of users, for example, enterprise users and end users, can benefit from the application of artificial intelligence.
用户会在很多场景下存在着人工智能应用需求,进而通过开发或者下载所发布的人工智能应用,来达成获得所需要的人工智能技术。Users will have artificial intelligence application needs in many scenarios, and then develop or download the published artificial intelligence applications to achieve the required artificial intelligence technology.
对于企业用户,往往会进行所需要人工智能应用的开发,以获得能够满足自身业务需求的人工智能应用。例如,对于存在着需要通过人工智能技术实现自身数据处理的企业用户,只能通过自身开发或者委托开发的进行,艰难的获得所需要的人工智能应用。For enterprise users, they often develop the artificial intelligence applications they need to obtain artificial intelligence applications that can meet their own business needs. For example, for enterprise users who need to realize their own data processing through artificial intelligence technology, they can only obtain the required artificial intelligence applications through their own development or commissioned development.
对于终端用户,并不具备开发能力,其仅能够在互联网络进行资源搜索,搜索能够满足自身需求的人工智能应用,并下载。For end users, they do not have development capabilities. They can only search for resources on the Internet, search for artificial intelligence applications that meet their own needs, and download them.
但无论哪一类用户,都难以获得符合自身需求的人工智能应用,亟待需要提供一种人工智能应用搭建的实现,以使得各类用户都能够基于自身人工智能应用需求而搭建人工智能应用。However, no matter what kind of users, it is difficult to obtain artificial intelligence applications that meet their own needs, and it is urgent to provide an implementation of artificial intelligence application construction, so that all kinds of users can build artificial intelligence applications based on their own artificial intelligence application needs.
但是,人工智能应用的搭建,实质就是人工智能应用开发的进行。无论是对哪一类用户,自主开发人工智能应用都是非常困难的,人工智能技术所涉及算法的复杂性以及编程的难度,对于大众而言存在着难以逾越的门槛。However, the construction of artificial intelligence applications is essentially the development of artificial intelligence applications. No matter what kind of users, it is very difficult to develop artificial intelligence applications independently. The complexity of the algorithms involved in artificial intelligence technology and the difficulty of programming have an insurmountable threshold for the public.
也就是说,亟待为用户实现人工智能应用的自由搭建,以为各类用户解决当前所获得人工智能应用无法准确适应于真实需求的困境。In other words, there is an urgent need to realize the free construction of artificial intelligence applications for users, so as to solve the dilemma for various users that the currently obtained artificial intelligence applications cannot accurately adapt to real needs.
发明内容Summary of the invention
为了解决相关技术中用户无法实现人工智能应用搭建,所获得人工智能应用无法准确适应于真实需求的技术问题,本发明提供一种人工智能应用的搭建方法、人工智能应用搭建中的运行实现方法、装置和机器设备。In order to solve the technical problem that users cannot achieve the construction of artificial intelligence applications in related technologies, and the obtained artificial intelligence applications cannot be accurately adapted to real needs, the present invention provides a method for building artificial intelligence applications, a method for implementing operation in the construction of artificial intelligence applications, Devices and machinery.
种人工智能应用的搭建方法,所述方法包括:A method for building an artificial intelligence application, the method includes:
接收对图形界面上组块的选取指令,所述组块是所对应数学基元的图形表示;Receiving a selection instruction for a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive;
通过所述选取指令在所述图形界面的搭建区为人工智能应用的搭建配置组块,且将组块之间相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型;Configuring the building blocks of the artificial intelligence application in the building area of the graphical interface through the selection instruction, and linking the blocks to each other to form the artificial intelligence algorithm configuration of the artificial intelligence application built under user control;
根据所述人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数学基元标识以及核心参数构成的字典,所述核心参数是对应于所述组块配置的;Convert the included chunks into a dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identifier corresponding to the chunk and the core parameters, the core parameters corresponding to the chunk configuration;
通过所述字典向服务端发起用户所搭建人工智能应用的解码,触发所述人工智能应用在服务端运行。Initiating decoding of the artificial intelligence application built by the user to the server through the dictionary, triggering the artificial intelligence application to run on the server.
一种人工智能应用搭建中的运行实现方法,所述方法包括:An operation implementation method in building an artificial intelligence application, the method includes:
用户选择进行的人工智能应用搭建中,服务端接收字典所对应字符串,所述字符串对应的字典用于描述为所述人工智能应用搭建所配置的组块;In the construction of the artificial intelligence application selected by the user, the server receives the character string corresponding to the dictionary, and the dictionary corresponding to the character string is used to describe the block configured for the construction of the artificial intelligence application;
解码所述字符串获得所述人工智能应用的可执行文本;Decoding the character string to obtain the executable text of the artificial intelligence application;
通过所述可执行文本的执行,使用户选择搭建的所述人工智能应用运行于所述服务端。Through the execution of the executable text, the artificial intelligence application that the user chooses to build runs on the server.
一种人工智能应用的搭建装置,包括:An artificial intelligence application building device, including:
指令接收模块,用于接收对图形界面上组块的选取指令,所述组块是所对应数学基元的图形表示。The instruction receiving module is used to receive a selection instruction of a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive.
构造模块,用于通过所述选取指令在所述图形界面的搭建区为人工智能应用的搭建配置组块,且将组块之间相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型。Construction module for configuring configuration blocks for building artificial intelligence applications in the construction area of the graphical interface through the selection instruction, and linking the blocks to form an artificial intelligence algorithm structure for artificial intelligence applications built under user control type.
转换模块,用于根据所述人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数学基元标识以及核心参数构成的字典,所述核心参数是对应于所述组块配置的。The conversion module is used to convert the included chunks to the dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters, the core parameters corresponding to the chunks Configured.
解码发起模块,用于通过所述字典向服务端发起用户所搭建人工智能应用的解码,触发所述人工智能应用在服务端运行。The decoding initiation module is used to initiate decoding of the artificial intelligence application built by the user to the server through the dictionary, and trigger the artificial intelligence application to run on the server.
一种人工和智能应用搭建中的运行实现装置,包括:An operation realization device in the construction of manual and intelligent applications, including:
字符接收模块,用于用户选择进行的人工智能应用搭建中,服务端接收字典所对应字符串,所述字符串对应的字典用于描述为所述人工智能应用搭建所配置的组块。The character receiving module is used for building an artificial intelligence application selected by the user, and the server receives a character string corresponding to a dictionary, and the dictionary corresponding to the character string is used to describe a block configured for building the artificial intelligence application.
解码模块,用于解码所述字符串获得所述人工智能应用的可执行文本。The decoding module is used for decoding the character string to obtain the executable text of the artificial intelligence application.
执行模块,用于通过所述可执行文本的执行,使用户选择搭建的所述人工智能应用运行于所述服务端。An execution module is configured to enable the artificial intelligence application selected by the user to run on the server through execution of the executable text.
一种机器设备,包括:A machine equipment, including:
处理器;以及Processor; and
存储器,所述存储器上存储有计算机可读指令,所述计算机可读指令被所述处理器执行时实现如上所述的方法。A memory, on which computer-readable instructions are stored, which when executed by the processor implements the method described above.
本发明的实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the embodiments of the present invention may include the following beneficial effects:
对于给定的人工智能应用需求,用户将在图形界面的搭建区自由进行人工智能应用的搭建,在人工智能应用搭建的进行中,将接收对图像界面上组块的选取指令,该组块是所对应数学基元的图形表示,然后通过选取指令在图形界面的搭建区为人工智能应用的搭建配置组块,并且将组块相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型,根据人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数学基元标识以及核心参数构成的字典,该核心参数是对应于组块配置的,最后通过字典向服务端发起用户所搭建人工智能应用的解码,即可触发人工智能应用在服务端运行,由此,便满足给定的人工智能应用需求,通过对应于数学基元的组件为用户实现了人工智能应用搭建,所获得的人工智能应用由于是按照真实需求而配置组块的,因此,能够准确适应于真实需求,随着组块的自由配置实现所见即所得的人工智能应用,增强了人工智能应用搭建的交互性能,且降低了门槛。For the given artificial intelligence application requirements, users will freely build artificial intelligence applications in the construction area of the graphical interface. During the construction of artificial intelligence applications, they will receive the instruction to select the block on the image interface. The block is The graphical representation of the corresponding mathematical primitives, and then configure the building blocks for the construction of artificial intelligence applications in the construction area of the graphical interface by selecting instructions, and link the blocks to form the artificial intelligence algorithm configuration of artificial intelligence applications built under user control ,According to the configuration of the artificial intelligence algorithm, the conversion of the included chunks to the dictionary is obtained to obtain the dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters. The core parameters are corresponding to the chunk configuration, and finally through the dictionary to the server Initiating the decoding of the artificial intelligence application built by the user can trigger the artificial intelligence application to run on the server, thereby satisfying the given artificial intelligence application needs, and implementing the artificial intelligence application for the user through the component corresponding to the mathematical primitive Since the obtained artificial intelligence applications are configured according to real needs, the blocks can be accurately adapted to the real needs. With the free configuration of the blocks, the WYSIWYG artificial intelligence applications are realized, which enhances the construction of artificial intelligence applications. Interactive performance, and lowered the threshold.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性的,并不能限制本发明。It should be understood that the above general description and the following detailed description are only exemplary and do not limit the present invention.
附图说明BRIEF DESCRIPTION
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本发明的实施例,并于说明书一起用于解释本发明的原理。The drawings herein are incorporated into and constitute a part of the specification, show embodiments consistent with the present invention, and are used together with the specification to explain the principles of the present invention.
图1是根据本发明所涉及的实施环境的示意图;FIG. 1 is a schematic diagram of an implementation environment involved in the present invention;
图2是根据一示例性实施例示出的一种装置的框图Fig. 2 is a block diagram of an apparatus according to an exemplary embodiment
图3是根据一示例性实施例示出的一种人工智能应用的搭建方法的流程图;Fig. 3 is a flowchart of a method for building an artificial intelligence application according to an exemplary embodiment;
图4是根据图3对应实施例示出的对步骤330进行描述的流程图;FIG. 4 is a flowchart illustrating step 330 according to the embodiment corresponding to FIG. 3;
图5是根据图3对应实施例示出的对步骤350进行描述的流程图;FIG. 5 is a flowchart illustrating step 350 according to the embodiment corresponding to FIG. 3;
图6是根据图3对应实施例示出的对步骤370进行描述的流程图;6 is a flowchart illustrating step 370 according to the embodiment corresponding to FIG. 3;
图7是根据另一示例性实施例示出的一种人工智能应用的搭建方法的流程图;Fig. 7 is a flowchart of a method for building an artificial intelligence application according to another exemplary embodiment;
图8是根据图7对应实施例在另一个示例性实施例中示出的对步骤470进行描述的流程图;8 is a flowchart illustrating step 470 shown in another exemplary embodiment according to the corresponding embodiment of FIG. 7;
图9是根据图7对应实施例示出的对步骤430进行描述的流程图;9 is a flowchart illustrating step 430 according to the embodiment corresponding to FIG. 7;
图10是根据一示例性实施例示出的一种人工智能应用搭建中的运行实现方法的流程 图;Fig. 10 is a flowchart of a method for implementing operation in building an artificial intelligence application according to an exemplary embodiment;
图11是根据图10对应实施例示出的对步骤530进行描述的流程图;FIG. 11 is a flowchart illustrating step 530 according to the embodiment corresponding to FIG. 10;
图12是根据图11对应实施例示出的对步骤533进行描述的流程图;12 is a flowchart illustrating step 533 according to the embodiment corresponding to FIG. 11;
图13是根据一示例性实施例示出的一简单数学基元所对应DAG结构的示意图;Fig. 13 is a schematic diagram showing a DAG structure corresponding to a simple mathematical primitive according to an exemplary embodiment;
图14是根据图10对应实施例示出的对步骤550进行描述的流程图;14 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10;
图15是根据图10所对应实施例在另一个示例性实施例示出的对步骤550进行描述的流程图;15 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10 in another exemplary embodiment;
图16是根据图15对应实施例示出的对步骤551b进行描述的流程图;16 is a flowchart illustrating step 551b according to the embodiment corresponding to FIG. 15;
图17是在另一示例性实施例示出的一种人工智能应用搭建中的运行实现方法的流程图;17 is a flowchart of a method for implementing operation in building an artificial intelligence application shown in another exemplary embodiment;
图18是根据一示例性实施例示出的图形界面示意图;Fig. 18 is a schematic diagram of a graphical interface according to an exemplary embodiment;
图19是根据一示例性实施例示出的一卷积神经网络操作所对应组块在操作界面上的示意图;Fig. 19 is a schematic diagram of a block corresponding to a convolutional neural network operation on an operation interface according to an exemplary embodiment;
图20是根据图19对应实施例示出的三层卷积神经网络在操作界面上的组块分布以及链接示意图;20 is a schematic diagram of block distribution and linking of a three-layer convolutional neural network on an operation interface according to the corresponding embodiment of FIG. 19;
图21是根据一示例性实施例示出的本发明所涉及前端与后端之间的交互示意图;21 is a schematic diagram of interaction between the front end and the back end involved in the present invention according to an exemplary embodiment;
图22示出了一示例性实施例中本发明整体方案的实现示意图;22 shows a schematic diagram of the implementation of the overall solution of the present invention in an exemplary embodiment;
图23是根据一示例性实施例示出的一种人工智能应用的搭建装置的框图;Fig. 23 is a block diagram of a device for building an artificial intelligence application according to an exemplary embodiment;
图24是根据一示例性实施例示出的一种人工智能应用搭建中的运行实现装置的框图。Fig. 24 is a block diagram of a device for implementing operation in building an artificial intelligence application according to an exemplary embodiment.
具体实施方式detailed description
这里将详细地对示例性实施例执行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本发明相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本发明的一些方面相一致的装置和方法的例子。The exemplary embodiments will be explained in detail here, examples of which are shown in the drawings. When referring to the drawings below, unless otherwise indicated, the same numerals in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of devices and methods consistent with some aspects of the invention as detailed in the appended claims.
图1是根据本发明所涉及的实施环境的示意图。在一个示例性实施例中,该实施环境包括用户终端110以及被配置于后台的的服务器130。用户终端110并不限于单一数量,也就是说,各类用户均可通过所持有的用户终端110与服务器130交互,以实现本发明的人工智能应用搭建,以及所搭建人工智能应用的运行。FIG. 1 is a schematic diagram of an implementation environment involved in the present invention. In an exemplary embodiment, the implementation environment includes a user terminal 110 and a server 130 configured in the background. The user terminals 110 are not limited to a single number, that is to say, all kinds of users can interact with the server 130 through the held user terminals 110 to realize the construction of the artificial intelligence application of the present invention and the operation of the built artificial intelligence application.
服务器130,是用户终端110为了进行人工智能应用搭建以及所搭建人工智能应用运行而访问的。服务器130将面向于海量用户终端110,任意用户只要能够访问服务器130即可自由进行人工智能应用的自由搭建,以及所搭建人工智能应用的使用。The server 130 is accessed by the user terminal 110 for building artificial intelligence applications and running the built artificial intelligence applications. The server 130 will be oriented to massive user terminals 110, and any user can freely build artificial intelligence applications and use the built artificial intelligence applications as long as they can access the server 130.
在用户终端110与服务器130的作用下,使得人工智能应用的门槛得到有效降低,用户将得以根据自身所产生的人工智能应用需求即时进行人工智能应用的搭建和运行。Under the action of the user terminal 110 and the server 130, the threshold of the artificial intelligence application is effectively lowered, and the user will be able to immediately build and run the artificial intelligence application according to the artificial intelligence application demand generated by the user.
可以理解,通过本发明的实现,为用户提供了能够随时搭建所需要人工智能应用的平台,但并不限于此,无论是企业用户还是终端用户,都不再需要为了自身需求而耗费非常大的成本自主开发人工智能应用。It can be understood that through the implementation of the present invention, the user is provided with a platform capable of building the required artificial intelligence application at any time, but it is not limited to this, no matter whether it is an enterprise user or an end user, it no longer needs to be very expensive for their own needs. Independent development of artificial intelligence applications at cost.
图2是根据一示例性实施例示出的一种装置的框图。例如,装置200可以是图1所示实施环境中的用户终端110。例如,用户终端110是智能手机、平板电脑等用户手持的终端设备、各种摄像机等。Fig. 2 is a block diagram of a device according to an exemplary embodiment. For example, the device 200 may be the user terminal 110 in the implementation environment shown in FIG. 1. For example, the user terminal 110 is a terminal device held by a user such as a smart phone or a tablet computer, various cameras, and the like.
参照图2,装置200至少包括以下组件:处理组件202,存储器204,电源组件206,多媒体组件208,音频组件210,传感器组件214以及通信组件216。2, the device 200 includes at least the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, a sensor component 214 and a communication component 216.
处理组件202通常控制装置200的整体操作,诸如与显示,电话呼叫,数据通信,相机操作以及记录操作相关联的操作等。处理组件202至少包括一个或多个处理器218来执行指令,以完成下述的方法的全部或部分步骤。此外,处理组件202至少包括一个或多个模块,便于处理组件202和其他组件之间的交互。例如,处理组件202可以包括多媒体模 块,以方便多媒体组件208和处理组件202之间的交互。The processing component 202 generally controls the overall operations of the device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 202 includes at least one or more processors 218 to execute instructions to complete all or part of the steps of the method described below. In addition, the processing component 202 includes at least one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
存储器204被配置为存储各种类型的数据以支持在装置200的操作。这些数据的示例包括用于在装置200上操作的任何应用程序或方法的指令。存储器204至少由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(Static Random Access Memory,简称SRAM),电可擦除可编程只读存储器(Electrically Erasable Programmable Read-Only Memory,简称EEPROM),可擦除可编程只读存储器(Erasable Programmable Read Only Memory,简称EPROM),可编程只读存储器(Programmable Red-Only Memory,简称PROM),只读存储器(Read-Only Memory,简称ROM),磁存储器,快闪存储器,磁盘或光盘。存储器204中还存储有一个或多个模块,该一个或多个模块被配置成由该一个或多个处理器218执行,以完成下述图3至图17任一所示方法中的全部或者部分步骤。The memory 204 is configured to store various types of data to support operation at the device 200. Examples of these data include instructions for any application or method operating on the device 200. The memory 204 is implemented by at least any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM for short), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), read-only memory ( Read-Only Memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. One or more modules are also stored in the memory 204, and the one or more modules are configured to be executed by the one or more processors 218 to complete all or any of the methods shown in any of the following FIGS. 3 to 17 Partial steps.
电源组件206为装置200的各种组件提供电力。电源组件206至少包括电源管理系统,一个或多个电源,及其他与为装置200生成、管理和分配电力相关联的组件。The power supply component 206 provides power to various components of the device 200. The power component 206 includes at least a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 200.
多媒体组件208包括在所述装置200和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(Liquid Crystal Display,简称LCD)和触摸面板。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。屏幕还包括有机电致发光显示器(Organic Light Emitting Display,简称OLED)。The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (Liquid Crystal) (LCD for short) and a touch panel. If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or sliding action, but also detect the duration and pressure related to the touch or sliding operation. The screen also includes Organic Light Emitting Display (Organic Light Emitting Display, OLED for short).
音频组件210被配置为输出和/或输入音频信号。例如,音频组件210包括一个麦克风(Microphone,简称MIC),当装置200处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器204或经由通信组件216发送。在一些实施例中,音频组件210还包括一个扬声器,用于输出音频信号。The audio component 210 is configured to output and/or input audio signals. For example, the audio component 210 includes a microphone (Microphone, MIC for short). When the device 200 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal may be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.
传感器组件214包括一个或多个传感器,用于为装置200提供各个方面的状态评估。例如,传感器组件214检测到装置200的打开/关闭状态,组件的相对定位,传感器组件214还检测装置200或装置200一个组件的位置改变以及装置200的温度变化。在一些实施例中,该传感器组件214还包括磁传感器,压力传感器或温度传感器。The sensor assembly 214 includes one or more sensors for providing the device 200 with status assessments in various aspects. For example, the sensor assembly 214 detects the on/off state of the device 200, the relative positioning of the components, and the sensor assembly 214 also detects a change in the position of the device 200 or one component of the device 200 and a change in the temperature of the device 200. In some embodiments, the sensor assembly 214 further includes a magnetic sensor, a pressure sensor, or a temperature sensor.
通信组件216被配置为便于装置200和其他设备之间有线或无线方式的通信。装置200接入基于通信标准的无线网络,如WiFi(WIreless-Fidelity,无线保真)。在一个示例性实施例中,通信组件216经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,通信组件216还包括近场通信(Near Field Communication,简称NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(Radio Frequency Identification,简称RFID)技术,红外数据协会(Infrared Data Association,简称IrDA)技术,超宽带(Ultra Wideband,简称UWB)技术,蓝牙技术和其他技术来实现。The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 accesses a wireless network based on a communication standard, such as WiFi (WIreless-Fidelity, wireless fidelity). In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth technology and other technologies. .
在示例性实施例中,装置200被一个或多个应用专用集成电路(Application Specific Integrated Circuit,简称ASIC)、数字信号处理器、数字信号处理设备、可编程逻辑器件、现场可编程门阵列、控制器、微控制器、微处理器或其他电子元件实现,用于执行下述方法。In an exemplary embodiment, the apparatus 200 is controlled by one or more application specific integrated circuits (Application Specific Integrated Circuit (ASIC for short), digital signal processor, digital signal processing device, programmable logic device, field programmable gate array, control A microcontroller, microcontroller, microprocessor or other electronic component is implemented to perform the following method.
图3是根据一示例性实施例示出的一种人工智能应用的搭建方法的流程图。在一个示例性实施例中,该人工智能应用的搭建方法,如图3所示,至少包括以下步骤。Fig. 3 is a flowchart of a method for building an artificial intelligence application according to an exemplary embodiment. In an exemplary embodiment, the method for building an artificial intelligence application, as shown in FIG. 3, includes at least the following steps.
在步骤310中,接收对图形界面上组块的选取指令,组块是所对应数学基元的图形表示。In step 310, a selection instruction for a block on the graphical interface is received, and the block is a graphical representation of the corresponding mathematical primitive.
其中,图形界面是可供自由进行人工智能应用搭建的用户界面,所指的人工智能应用搭建,即为所涉及顺序执行数学操作的配置,配置执行的数学操作便构成了人工智能应用的算法实现,进而实现满足设定需求的人工智能应用。Among them, the graphical interface is a user interface that can be used for free construction of artificial intelligence applications. The artificial intelligence application construction refers to the configuration of the sequential execution of mathematical operations involved. The mathematical operations configured to perform constitute the algorithm implementation of artificial intelligence applications , And then realize artificial intelligence applications that meet the set requirements.
可选的,图形界面包括了操作组件选取栏、操作界面、工具栏以及操作结果显示区。 施加于组块上的选取指令,便是在操作组件选取栏所触发的。操作组件选取栏包括着众多可供选取的组块,这些组块是对应于初始化配置的模型和/或数据的。用户可通过对组块触发操作而对此组块触发生成选取指令,以此来完成所对应组块的选取,至此,所选取的组块便被配置于操作界面。Optionally, the graphical interface includes an operation component selection bar, an operation interface, a toolbar, and an operation result display area. The selection command applied to the block is triggered in the selection bar of the operation component. The operation component selection bar includes a large number of blocks that can be selected, and these blocks correspond to the initially configured model and/or data. The user can complete the selection of the corresponding block by triggering an operation on the block and generating a selection instruction for the block, so that the selected block is configured on the operation interface.
对于操作组件选取栏,一方面将用于为当前搭建的人工智能应用选择所涉及的数学基元,例如,数学基元可为整合在一起的模型,另一方面也可为已搭建的人工智能应用选择所迭代训练使用的数据,无论何种选择,在图形界面的操作组件选取栏上,都将以组块的形式存在。For the operation component selection bar, on the one hand, it will be used to select the mathematical primitives involved for the currently built artificial intelligence application. For example, the mathematical primitives can be integrated models, on the other hand, they can also be built artificial intelligence. The application selects the data used for the iterative training. No matter what kind of selection, it will exist in the form of a block on the selection bar of the operating component of the graphical interface.
操作界面,即为图形界面上的搭建区用于为人工智能应用的搭建放置所选取的组块,并且这些组块将在用户操控下摆放,以此来实现搭建。操作组件选取栏中的组块被触发之后,便被置于操作界面。例如,所进行的组块选取,可通过施加于组块上的拖拽操作而将操作组件选取栏中的组块拖拽至操作界面,被拖拽至操作界面的组块便用于进行人工智能应用的搭建。The operation interface, that is, the building area on the graphical interface is used to place the selected blocks for the construction of artificial intelligence applications, and these blocks will be placed under the control of the user to achieve the building. After the block in the operation component selection bar is triggered, it is placed on the operation interface. For example, in the selection of a block, the block in the operation component selection bar can be dragged to the operation interface by a drag operation applied to the block. The block dragged to the operation interface is used for manual operation Smart application building.
正如前述描述所指出的,一组块是对应于一设定模型或者数据的,其是所设定模型或数据的图形表示。所设定模型可以是单一数学操作,也可以是两个以上数学操作整合在一起所实现的模型,无论单一数学操作,还是两个以上数学操作的整合,其都是输入、输出以及数学操作整合所形成的复合体,是独立单元,也称之为数学基元。数学基元对应于组块,数学基元是根据所搭建人工智能应用需要涉及的算法而通过组块配置于操作界面之上的。As indicated in the foregoing description, a set of blocks corresponds to a set model or data, which is a graphical representation of the set model or data. The set model can be a single mathematical operation, or a model realized by integrating more than two mathematical operations, whether it is a single mathematical operation or the integration of more than two mathematical operations, it is the integration of input, output and mathematical operations The formed complex is an independent unit, also called a mathematical primitive. Mathematical primitives correspond to chunks. Mathematical primitives are configured on the operation interface through chunks according to the algorithms involved in the artificial intelligence applications.
应当理解,对应于组块的数学基元,定义了在一个层面上的数学操作。当然,随着所在层面的不同,在更为细分的层面上,数学基元所定义的数学操作将被细分,而使得组块是对应了几个数学操作的。数学基元将从输入、输出以及所执行的数学操作来定义组块所对应执行的数学操作。人工智能应用的搭建中,随着组块的配置,进行着人工智能应用所涉及数学基元的配置,以此来部署所搭建人工智能应用中执行的数学操作,并为每一数学操作的执行控制其输入和输出。It should be understood that the mathematical primitives corresponding to chunks define mathematical operations on a level. Of course, with different levels, at a more subdivided level, the mathematical operations defined by the mathematical primitives will be subdivided, so that the block corresponds to several mathematical operations. Mathematical primitives will define the mathematical operations corresponding to the chunk from the input, output and the mathematical operations performed. In the construction of the artificial intelligence application, along with the configuration of the block, the configuration of the mathematical primitives involved in the artificial intelligence application is carried out, in order to deploy the mathematical operations performed in the constructed artificial intelligence application, and for the execution of each mathematical operation Control its input and output.
图形界面上的工具栏用于在人工智能应用的搭建中,为所配置组块进行所对应数据和模型的调整,例如,对数据和模型进行微调等。The toolbar on the graphical interface is used in the construction of artificial intelligence applications to adjust the corresponding data and models for the configured blocks, for example, to fine-tune the data and models.
图形界面上的操作结果显示区,则用于进行所搭建人工智能应用运行之后的结果显示。例如,对当前搭建的人工智能应用进行迭代训练之后,在操作结果显示区显示所对应迭代训练情况以及所能够获得的分类效果。The operation result display area on the graphical interface is used to display the results after the built artificial intelligence application runs. For example, after iterative training is performed on the currently built artificial intelligence application, the corresponding iterative training situation and the classification effect that can be obtained are displayed in the operation result display area.
综上所述的,在为人工智能应用搭建的进行而显示于用户终端的图形界面中,通过对初始化提供的组块进行着其中搭建区的配置,被配置到搭建区的组块便被用于进行人工智能应用的搭建。In summary, in the graphical interface displayed on the user terminal for the progress of the artificial intelligence application, by configuring the building block in the initializing block, the block configured in the building area is used. For the construction of artificial intelligence applications.
由此,可以确定,搭建区所配置的组块,即为当前所搭建人工智能应用所选用的组块,与之相对应的,所选用组块对应的数学基元将被用于构成当前所搭建的人工智能应用,对于所进行的人工智能应用搭建而言,实现了所见即所得的人工智能应用搭建,无论是自由度还是所搭建人工智能应用的自适应性,都能够得到增强。From this, it can be determined that the blocks configured in the building area are the blocks selected for the artificial intelligence application currently built. Correspondingly, the mathematical primitives corresponding to the selected blocks will be used to form the current building The built artificial intelligence application, for the artificial intelligence application construction, has realized the WYSIWYG artificial intelligence application construction, whether it is the degree of freedom or the self-adaptability of the built artificial intelligence application, can be enhanced.
图形界面为用户初始化配置了可供进行人工智能应用搭建的组块,即为当前所进行的人工智能应用搭建可供选用的组块,除此之外,施加于所需要选用组块上的拖拽操作、选定操作等,都得以实现了搭建区,即如前述所指的操作界面上所选用组块的新增,就说是说,将随着对图形界面上组块的选取指令使得用户选取的组块被配置于搭建区中。The graphical interface is configured for the user to initialize the building blocks for artificial intelligence applications, that is, building the optional blocks for the current artificial intelligence applications. In addition, the dragging on the required selected blocks Drag operation, selection operation, etc., have been able to achieve the construction area, that is, as mentioned above, the addition of the selected block on the operation interface, that is to say, will follow the selection instruction of the block on the graphical interface The block selected by the user is configured in the building area.
选取指令指示了用户所选取的组块。如前所述的,组块是所对应数学基元的图形表示,因此,可通过所对应数学基元标识来唯一标示组块,选取指令携带了数学基元标识,以此来标示用户所选取的组块,并为此执行相应的响应。The selection instruction indicates the block selected by the user. As mentioned above, the block is a graphical representation of the corresponding mathematical primitive. Therefore, the corresponding mathematical primitive identifier can be used to uniquely identify the block. The selection instruction carries the mathematical primitive identifier to indicate the user's selection. And execute the corresponding response for this.
每当进行一次组块选取,实现人工智能应用搭建的进程都将接收得到对图形界面上所对应组块的选取指令。以此类推,随着组块选取的不断进行,将不断接收到对应于不同组块的选取指令。Whenever a block selection is performed, the process of realizing the construction of the artificial intelligence application will receive a selection instruction for the corresponding block on the graphical interface. By analogy, as the selection of chunks continues, selection instructions corresponding to different chunks will be continuously received.
在一个示例性实施例中,步骤310包括:在图形界面初始化配置的若干组块中,通过施加于组块上的用户操作接收得到对图形界面上组块的选取指令,直至实现人工智能应用的组块被全部选取。In an exemplary embodiment, step 310 includes: among the several blocks of the initial configuration of the graphical interface, a user's operation applied to the chunk receives the instruction to select the chunks on the graphical interface until the artificial intelligence application is implemented All blocks are selected.
其中,如前所述的,图形界面初始化配置了众多组块,例如,操作组件选取栏中组块的存在。用户可根据人工智能应用搭建的需要而不断在所需要的组块施加用户操作,例如向搭建区的拖拽操作,以此来对不断选用的组块生成选取指令,所对应的进程便不断接收到生成的选取指令,直至所需要的组块被全部选取。Among them, as mentioned above, the graphical interface is initially configured with a large number of blocks, for example, the existence of blocks in the operation component selection bar. Users can continue to apply user operations to the required blocks according to the needs of artificial intelligence application building, such as dragging operations to the building area, so as to generate selection instructions for the continuously selected blocks, and the corresponding process will continue to receive To the generated selection instruction until all the required blocks are selected.
在步骤330中,通过选取指令在图形界面的搭建区为人工智能应用的搭建配置组块,且将组块之间相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型。In step 330, the configuration block of the artificial intelligence application is configured in the construction area of the graphical interface by selecting instructions, and the blocks are mutually linked to form an artificial intelligence algorithm configuration of the artificial intelligence application built under user control.
其中,如前所述的,随着选取指令的接收,不断在图形界面的搭建区为人工智能应用的搭建配置组块,所配置的组块是选取指令中携带的数学基元标识对应的。Among them, as mentioned above, as the selection instruction is received, the building block for the artificial intelligence application is continuously configured in the construction area of the graphical interface, and the configured block corresponds to the mathematical primitive identifier carried in the selection instruction.
在选取指令的作用下,在图形界面的搭建区为人工智能应用配置了所涉及数学基元对应的组块,进而使得图形界面的搭建区存在着两个以上的组块。Under the action of the selection instruction, the building blocks of the graphical interface are configured with blocks corresponding to the involved mathematical primitives for artificial intelligence applications, and thus there are more than two blocks in the building area of the graphical interface.
应当理解,随着图形界面上组块选取的进行,所选取的组块零散分布于图形界面的搭建区。此时,将在用户操控下进行组块之间的相互链接,以此来获得所搭建人工智能应用的人工智能算法构型。It should be understood that as the selection of blocks on the graphical interface proceeds, the selected blocks are scattered in the construction area of the graphical interface. At this time, the interconnection between the blocks will be performed under the control of the user to obtain the artificial intelligence algorithm configuration of the built artificial intelligence application.
人工智能算法构型是描述人工智能应用中执行数学操作的网络拓扑,换而言之,也是所部署数学基元形成的网络拓扑。对于相互链接的数学基元,上一数学基元的输出将作为下一数学基元的输入,以此类推形成整个人工智能算法构型。The artificial intelligence algorithm configuration is a network topology that describes the mathematical operations performed in artificial intelligence applications, in other words, the network topology formed by the deployed mathematical primitives. For interlinked mathematical primitives, the output of the previous mathematical primitive will be used as the input of the next mathematical primitive, and so on to form the entire artificial intelligence algorithm configuration.
在一个示例性实施例中,人工智能算法构型是以图的形式存在的,即其可为人工智能算法构型图的形式。人工智能算法构型指示了所构建网络拓扑中包含的组块以及所包含组块之间的链接关系。In an exemplary embodiment, the artificial intelligence algorithm configuration exists in the form of a graph, that is, it may be in the form of an artificial intelligence algorithm configuration graph. The configuration of the artificial intelligence algorithm indicates the blocks included in the constructed network topology and the link relationship between the contained blocks.
在可供进行人工智能应用搭建的图形界面上,随着用户操作为所搭建人工智能应用自由进行着组块的选用配置,以及构建所选用配置组块之间的链接关系,这些都将由用户操作而根据自身的人工智能应用需求自由进行,实现了人工智能应用搭建的图形化编程,以此来最大限度的降低门槛。On the graphical interface available for building artificial intelligence applications, as the user operates to freely select and configure the blocks for the built artificial intelligence application, and build the link relationship between the selected configuration blocks, these will be operated by the user According to the needs of its own artificial intelligence applications, it is free to implement the graphical programming built by artificial intelligence applications, in order to reduce the threshold to the maximum extent.
在步骤350中,根据人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数学基元标识以及核心参数构成的字典,该核心参数是对应于组块配置的。In step 350, according to the configuration of the artificial intelligence algorithm, the included chunks are converted into dictionaries to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunks and the core parameters, the core parameters corresponding to the chunk configuration.
其中,如前所述的,人工智能算法构型指示了当前所搭建人工智能应用的网络拓扑中包含的组块以及组块之间的链接关系,并且组块是对应于数学基元的,因此,根据人工智能算法构型而进行的组块向字典的转换,是组块向字典数据的转换,所获得的字典数据便用于形成实现所搭建人工智能应用的字典。Among them, as mentioned above, the configuration of the artificial intelligence algorithm indicates the blocks included in the network topology of the currently built artificial intelligence application and the link relationship between the blocks, and the blocks correspond to mathematical primitives, so The conversion of chunks into dictionaries according to the configuration of artificial intelligence algorithms is the transformation of chunks into dictionary data. The obtained dictionary data is used to form a dictionary for realizing artificial intelligence applications.
也就是说,对人工智能算法构型,都将针对于组块进行着字典数据的生成,以实现人工智能算法构型所包含组块向字典的转换。对组块所生成的字典数据用于指示所对应的数学基元,并且对此数学基元进行输入和输出控制。That is to say, for the artificial intelligence algorithm configuration, the dictionary data will be generated for the chunks to realize the conversion of the chunks contained in the artificial intelligence algorithm configuration to the dictionary. The dictionary data generated for the chunks are used to indicate the corresponding mathematical primitives, and input and output control of the mathematical primitives are performed.
可选的,人工智能算法构型是面向于组块所形成的网络拓扑,按照组块所对应数学基元获得数学基元标识以及为此数学基元而配置的核心参数,以数学基元标识为索引项,核心参数为索引值构建得到此组块所对应的字典数据,以此类推,所有组块对应的字典数据便构成了所搭建人工智能应用的字典。Optionally, the configuration of the artificial intelligence algorithm is oriented to the network topology formed by the blocks, and the mathematical primitive identification and the core parameters configured for the mathematical primitive are obtained according to the mathematical primitives corresponding to the chunk, and the mathematical primitive identification For index items, the core parameter is the index value to construct the dictionary data corresponding to this group of blocks, and so on, the dictionary data corresponding to all the groups of blocks constitute the dictionary of the artificial intelligence application.
在此,应当补充说明的是,核心参数是对应于数学基元标识的,也就是说,核心参数为所对应数学基元而配置的。将通过搭建区中所对应组件在工具栏所进行的数据和模型微调而获得所配置对应于数学基元的核心参数。Here, it should be added that the core parameters correspond to the identification of mathematical primitives, that is, the core parameters are configured for the corresponding mathematical primitives. The core parameters configured corresponding to the mathematical primitives will be obtained by fine-tuning the data and models of the corresponding components in the construction area on the toolbar.
在一个示例性实施例中,对于人工智能应用所涉及的诸多算法,对应于数学基元的核心参数包括了模型所适用的超参数、输入维度以及输出维度等关键数据。核心参数的配置将得以保证所对应数学基元定义数学操作的顺利执行。In an exemplary embodiment, for many algorithms involved in artificial intelligence applications, the core parameters corresponding to mathematical primitives include key data such as hyperparameters, input dimensions, and output dimensions applicable to the model. The configuration of the core parameters will ensure the smooth execution of the mathematical operations defined by the corresponding mathematical primitives.
在步骤370中,通过字典向服务端发起用户所搭建人工智能应用的解码,触发人工智能应用在服务端运行。In step 370, the decoding of the artificial intelligence application built by the user is initiated to the server through the dictionary, and the artificial intelligence application is triggered to run on the server.
其中,在为当前所搭建人工智能应用转换得到字典之后,即可通过字典向服务端发起所搭建人工智能应用的解码,以此来触发人工智能应用在服务端的运行。Among them, after a dictionary is converted for the currently built artificial intelligence application, the decoding of the built artificial intelligence application can be initiated to the server through the dictionary to trigger the operation of the artificial intelligence application on the server.
字典是用户搭建人工智能应用所获得的,其将通过所包含字典数据记录的数学基元标识以及核心参数而使得服务端能够以字典的形式获得所搭建的人工智能应用。The dictionary is obtained by the user building the artificial intelligence application, which will enable the server to obtain the built artificial intelligence application in the form of a dictionary through the mathematical primitive identification and core parameters of the included dictionary data records.
通过此示例性实施例,在用户终端所实现的用户侧进行着基于图形界面的人工智能应用搭建,即图形化编程,用户完成人工智能应用的搭建之后,搭建的人工智能应用便借助面向组块所对应数学基元生成的字典,使得用户所进行的人工智能应用搭建能够被服务端所获悉,进而运行在服务端,以此来满足用户的人工智能需求,获得所搭建人工智能应用所能够提供的功能。Through this exemplary embodiment, an artificial intelligence application based on a graphical interface is built on the user side realized by the user terminal, that is, graphical programming, and after the user completes the construction of the artificial intelligence application, the built artificial intelligence application uses block-oriented The dictionary generated by the corresponding mathematical primitives enables the user to build the artificial intelligence application that can be learned by the server and then runs on the server to meet the user's artificial intelligence needs and obtain what the built artificial intelligence application can provide. Function.
对于所进行的人工智能应用搭建而言,在图形界面以及对应于数学基元的组块作用下,得以面向于用户实现了人工智能应用所涉及复杂算法的开发,即通过不同组块的选用以及相互链接来构建得到所需要的复杂算法,但用户并不需要具备代码开发能力且学习人工智能专业知识,仅需要大致了解每一组块所对应数学基元的功能即可,为大众消除了人工智能应用搭建的门槛。For the construction of artificial intelligence applications, under the action of the graphical interface and the blocks corresponding to the mathematical primitives, the development of complex algorithms involved in artificial intelligence applications can be realized for users, that is, through the selection of different blocks and Link to each other to build the complex algorithms needed, but users do not need to have code development capabilities and learn artificial intelligence expertise, only need to roughly understand the function of the mathematical primitives corresponding to each block, which eliminates labor for the public The threshold for building smart applications.
如上所述的示例性实施例,是将人工智能应用所涉及的算法,即数学操作及其输入输出封装为数学基元,为以组块的形式向用户呈现,以此为基础使得图形界面之上人工智能应用的搭建得以进行。The exemplary embodiment described above is to encapsulate the algorithms involved in artificial intelligence applications, that is, mathematical operations and their input and output into mathematical primitives, to present to the user in the form of chunks, on the basis of which the graphical interface The construction of the application of artificial intelligence was carried out.
图4是根据图3对应实施例示出的对步骤330进行描述的流程图。在一个示例性实施例中,该步骤330如图4所示,至少包括:FIG. 4 is a flowchart illustrating step 330 according to the embodiment corresponding to FIG. 3. In an exemplary embodiment, this step 330 is shown in FIG. 4 and includes at least:
在步骤331中,配置选取指令指示的组块于图形界面的搭建区。In step 331, the block indicated by the selection instruction is placed in the construction area of the graphical interface.
其中,随着所进行选取指令的接收,将根据所接收的选取指令对搭建区进行着组块的配置,以使得选取指令指示的组块被添加至图形界面的搭建区。As the selection instruction is received, the building area will be configured with blocks according to the received selection instruction, so that the block indicated by the selection instruction is added to the construction area of the graphical interface.
步骤331的执行,是为当前所搭建的人工智能应用一步步添加所需要数学基元的过程,以此来最终构建实现人工智能应用的人工智能算法构型,即实现人工智能应用所对应数学基元的网络拓扑。The execution of step 331 is a step-by-step process of adding the required mathematical primitives for the currently built artificial intelligence application, in order to finally construct the artificial intelligence algorithm configuration that realizes the artificial intelligence application, that is, the artificial intelligence application corresponding mathematical basis Meta network topology.
在步骤333中,对置于搭建区的组块获取所对应的核心参数。In step 333, the corresponding core parameters are obtained for the blocks placed in the building area.
其中,随着用户操作的进行,选取指令被不断触发生成,进而得以不断在搭建区添加用户所选取的组块。而对于每一组块,都可进行所对应核心参数的配置和调整,以适用于当前所搭建的人工智能应用。Among them, as the user's operation progresses, the selection instruction is continuously triggered and generated, so that the group selected by the user can be continuously added in the building area. For each block, the corresponding core parameters can be configured and adjusted to be suitable for the artificial intelligence applications currently built.
在一个示例性实施例中,针对置于搭建区的一组块,进行所对应数学基元中核心参数的配置和调整,在完成这一组块的核心参数配置和调整之后,便可进行其它组块的核心参数配置和调整。In an exemplary embodiment, for a group of blocks placed in the construction area, the configuration and adjustment of the core parameters of the corresponding mathematical primitives are performed. After the configuration and adjustment of the core parameters of the group of blocks, other The core parameter configuration and adjustment of the block.
例如,通过搭建区中组块的选定即可发起对该组块的核心参数配置和调整。具体的,选定搭建区中的一组块之后,图形界面上的工具栏便用于进行这一组块的核心参数配置和调整,此时,用户仅需要在此工具栏上进行设定参数的配置和调整即可。For example, the core parameter configuration and adjustment of the block can be initiated by selecting the block in the construction area. Specifically, after selecting a group of blocks in the construction area, the toolbar on the graphical interface is used to configure and adjust the core parameters of this group of blocks. At this time, the user only needs to set parameters on this toolbar Configuration and adjustment.
核心参数包括着数学基元中模型所使用的超参数以及输入维度、输出维度。所对应组块的链接关系变换,不仅需要在搭建区变换组块所链接的其它组块,还应当适应于所链接组块的数学基元而调整输入维度和/或输出维度,以适应于动态变化的人工智能应用搭建。The core parameters include the hyperparameters used by the model in the mathematical primitives as well as the input and output dimensions. The transformation of the link relationship of the corresponding chunks not only needs to transform the other chunks linked by the chunks in the building area, but also should adapt to the mathematical primitives of the linked chunks and adjust the input dimension and/or output dimension to adapt to the dynamics Changed artificial intelligence application building.
在一个示例性实施例中,步骤333包括:为图形界面搭建区所选定的组块,根据用户对组块进行的核心参数配置,获取得到组块对应的核心参数。In an exemplary embodiment, step 333 includes: selecting the block for the graphical interface building area, and obtaining the core parameter corresponding to the block according to the core parameter configuration performed by the user on the block.
其中,正如前述描述所指出的,搭建区分布着至少一个组块,而对任意一组块,都可通过其在搭建区上的选定而发起所对应的核心参数配置过程。一旦在搭建区选定了一组块之后,就能够进行这一组块的核心参数配置。Among them, as pointed out in the foregoing description, the building area is distributed with at least one block, and any group of blocks can initiate the corresponding core parameter configuration process through its selection on the building area. Once a group of blocks is selected in the building area, the core parameter configuration of this group of blocks can be configured.
所进行的核心参数配置,便是在用户操控下所进行输入参数、调整参数以及选取参数等的过程,不同组块所对应的数学基元的不同,也将对应着不同的核心参数配置过程。The core parameter configuration is the process of inputting parameters, adjusting parameters and selecting parameters under the control of the user. Different mathematical primitives corresponding to different blocks will also correspond to different core parameter configuration processes.
无论如何,都将通过所进行的核心参数配置而获得为搭建区所选定组块对应的核心参数,并且以此类推得到搭建区中所有组块分别对应的核心参数,即完成搭建区中所有组块 的核心参数配置,进而保障所搭建人工智能应用的运行。In any case, the core parameters corresponding to the selected blocks in the building area will be obtained through the core parameter configuration, and the core parameters corresponding to all the blocks in the building area will be obtained by analogy, that is, all The core parameters of the block are configured to ensure the operation of the artificial intelligence application built.
在步骤335中,随着搭建区中两个以上组块的配置,进行组块之间的相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型。In step 335, with the configuration of more than two blocks in the building area, the interconnection between the blocks is formed to form the artificial intelligence algorithm configuration of the artificial intelligence application built under user control.
其中,对于存储于搭建区中两个以上的组块,将在用户操控下进行组块之间的链接,以通过此来使得搭建区中分布的组块能够搭建成为人工智能应用的人工智能算法构型。Among them, for more than two blocks stored in the building area, the links between the blocks will be controlled under the user's control, so that the blocks distributed in the building area can be built into artificial intelligence algorithms for artificial intelligence applications structure.
组块之间的链接,一方面是指组块在搭建区的连线,此连线除了指示组块之间相互连接之外,还指示了所连接组块之间的输入输出关系;另一方面,组块之间的链接还指示上一组块的输出将作为所链接下一组块的输入。The link between the blocks, on the one hand, refers to the connection of the blocks in the building area. In addition to indicating the connection between the blocks, it also indicates the input and output relationship between the connected blocks; the other In terms of aspects, the link between the group blocks also indicates that the output of the previous group of blocks will be used as the input of the next group of linked blocks.
以此类推,随着搭建区中所添加组块的结束,以及组块之间链接的设置,形成人工智能算法构型。此人工智能算法构型是对用户当前所搭建人工智能应用进行的算法描述。对于用户当前所搭建的人工智能应用而言,其运行过程将是按照所对应的人工智能算法构型中组块所指示的数学基元以及相互链接关系执行算法的过程。By analogy, with the end of the added blocks in the building area and the setting of links between the blocks, an artificial intelligence algorithm configuration is formed. This artificial intelligence algorithm configuration is an algorithm description of the artificial intelligence application currently built by the user. For the artificial intelligence application currently built by the user, the running process will be the process of executing the algorithm according to the mathematical primitives and the interlinking relationship indicated by the blocks in the corresponding artificial intelligence algorithm configuration.
在一个示例性实施例中,组块之间在用户操作下通过所进行组块之间的连线而实现了组块之间的相互链接。由此而获得的人工智能算法构型是在用户操控下实现的,在此所指的用户操控,是搭建人工智能应用时用户需要触发的组块选取操作以及对组块之间连线的操作等,在此不进行限定,任意能够为所搭建的人工智能应用配置组块以及构建所配置组块之间链接的操作,都是形成人工智能算法构型而触发进行的用户操作。In an exemplary embodiment, the interconnection between the blocks is realized by the wiring between the blocks under user operation. The resulting artificial intelligence algorithm configuration is realized under the control of the user. The user control referred to here refers to the block selection operation and the connection operation between the blocks that the user needs to trigger when building the artificial intelligence application. There is no limitation here. Any operation that can configure blocks for the built artificial intelligence application and build links between the configured blocks is a user operation triggered by forming an artificial intelligence algorithm configuration.
通过此示例性实施例,为当前所搭建人工智能应用进行了人工智能算法构型的搭建,以此来实现算法开发,增强用户为自身需求而随意搭建人工智能算法构型,灵活性增强的同时实现了所需即所得的人工智能应用搭建,不再受限于代码知识、人工智能算法以及数学表示等专业知识的缺失。Through this exemplary embodiment, an artificial intelligence algorithm configuration is built for the currently built artificial intelligence application, so as to realize algorithm development, enhance users to build artificial intelligence algorithm configurations at will for their own needs, and at the same time increase flexibility Achieved the required artificial intelligence application building, which is no longer limited by the lack of professional knowledge such as code knowledge, artificial intelligence algorithms and mathematical representation.
图5是根据图3对应实施例示出的对步骤350进行描述的流程图。在一个示例性实施例中,如图5所示,该步骤350包括:FIG. 5 is a flowchart illustrating step 350 according to the embodiment corresponding to FIG. 3. In an exemplary embodiment, as shown in FIG. 5, the step 350 includes:
在步骤351中,对人工智能算法构型中包含的组块,获取组块所对应数学基元标识以及核心参数。In step 351, for the blocks included in the configuration of the artificial intelligence algorithm, the mathematical primitive identification and core parameters corresponding to the blocks are obtained.
其中,人工智能算法构型是对所搭建人工智能应用中采用的模型和数据进行算法逻辑描述,即所引入数学基元构成的算法逻辑,并且正如前述描述所指出的,人工智能算法构型是由所多个组块构成的网络拓扑。Among them, the artificial intelligence algorithm configuration is an algorithm logic description of the models and data used in the built artificial intelligence application, that is, the algorithm logic composed of the introduced mathematical primitives, and as pointed out in the foregoing description, the artificial intelligence algorithm configuration is The network topology composed of all the multiple blocks.
在用户通过对组块的操控而完成搭建区中组块的添加以及链接之后,搭建区所分布的组块以及相互之间的关系,便构成了人工智能应用的组块架构,即指示了人工智能应用搭建所使用的数学基元以及数学基元之间的链接关系。After the user completes the addition and linking of the blocks in the building area by manipulating the blocks, the blocks distributed in the building area and the relationship between them form the block architecture of the artificial intelligence application, which indicates that the artificial Mathematical primitives used in intelligent application building and the linking relationship between mathematical primitives.
每一数学基元为实现所对应数学操作的执行,都有着对应的代码描述,即包含了核心参数的代码信息,以通过所对应代码描述的执行而达成所对应数学操作的执行。由组块所构成的人工智能算法构型,所对应数学基元的存在将指示了在此人工智能算法构型下执行一系列数学操作的代码描述信息,即由数学基元标识对应且包含了核心参数的代码信息构成的可执行文本。In order to realize the execution of the corresponding mathematical operation, each mathematical primitive has a corresponding code description, that is, code information including core parameters, so as to achieve the execution of the corresponding mathematical operation through the execution of the corresponding code description. The configuration of artificial intelligence algorithms composed of blocks, the existence of corresponding mathematical primitives will indicate the code description information for performing a series of mathematical operations under this artificial intelligence algorithm configuration, that is, the corresponding and containing The executable text composed of the code information of the core parameters.
基于此,对于完成了组块添加和链接的搭建区,相应完成了人工智能算法构型的搭建。在此人工智能算法构型下,通过获取每一组块所对应数学基元标识以及核心参数来为所搭建人工智能应用生成字典。Based on this, for the building area where the addition of blocks and links have been completed, the construction of the artificial intelligence algorithm configuration has been completed accordingly. Under this artificial intelligence algorithm configuration, a dictionary is generated for the artificial intelligence application built by acquiring the mathematical primitive identification and core parameters corresponding to each block.
应当理解,所生成的字典用于向服务端传递用户所自适应搭建的人工智能算法构型,以此来获得运行于服务端的人工智能应用。It should be understood that the generated dictionary is used to deliver the artificial intelligence algorithm configuration adaptively constructed by the user to the server, so as to obtain the artificial intelligence application running on the server.
每一组块,都有着所对应的数学基元,即组块是所对应数学基元的图形表示,因此,对于人工智能算法构架下的组块,都能够获取得到所对应的数学基元标识,并且随着前述对组块所进行的核心参数配置而获得核心参数。对于一组块而言,所获得的核心参数是对应于数学基元标识的。Each block has a corresponding mathematical primitive, that is, the block is a graphical representation of the corresponding mathematical primitive. Therefore, for the block under the artificial intelligence algorithm framework, the corresponding mathematical primitive identifier can be obtained , And the core parameters are obtained along with the core parameter configuration of the chunks described above. For a group of blocks, the obtained core parameters correspond to the identification of mathematical primitives.
在步骤353中,以数学基元标识为索引项,核心参数为索引值构建人工智能应用的字典。In step 353, a dictionary of artificial intelligence applications is constructed with the mathematical primitive identifier as the index item and the core parameter as the index value.
其中,对人工智能算法构型下的每一组块构建字典数据,即以其所对应数学基元标识为索引项,以核心参数为索引值来构建得到组块的字典数据,以此类推,人工智能算法构型下所有组块的字典数据便形成人工智能应用的字典。Among them, the dictionary data is constructed for each block under the configuration of the artificial intelligence algorithm, that is, the corresponding mathematical primitive identification is used as the index item, and the core parameter is used as the index value to construct the dictionary data for the block, and so on, The dictionary data of all the blocks under the configuration of artificial intelligence algorithm will form the dictionary of artificial intelligence application.
在字典的作用下,将组块这一图像信息转换为存在于服务端的代码,即获得人工智能应用的可执行文本,以此来解决人工智能算法复杂而难以适应于用户开发的困境。Under the function of the dictionary, the image information of the chunk is converted into code that exists on the server side, that is, the executable text of the artificial intelligence application is obtained, so as to solve the dilemma of the artificial intelligence algorithm is complex and difficult to adapt to user development.
除此之外,通过生成字典的方式,也将为用户所搭建的人工智能应用进行着核心参数的传递,以向服务端提供用户个性化配置的核心参数,保证了人工智能应用的搭建能够精准适应于用户的人工智能应用需求。In addition, by generating a dictionary, the core parameters of the artificial intelligence application built by the user will also be passed to provide the server with the core parameters of the user's personalized configuration, ensuring the accuracy of the construction of the artificial intelligence application Adapt to the user's artificial intelligence application needs.
图6是根据图3对应实施例示出的对步骤370进行描述的流程图。在一个示例性实施例中,如图6所示,该步骤370至少包括:FIG. 6 is a flowchart illustrating step 370 according to the corresponding embodiment of FIG. 3. In an exemplary embodiment, as shown in FIG. 6, the step 370 includes at least:
在步骤371中,对字典中数学基元标识以及索引的核心参数进行字符串转换。In step 371, character string conversion is performed on the mathematical primitive identification and indexed core parameters in the dictionary.
其中,通过前述示例性实施例为用户搭建的人工智能应用生成字典之后,便需要对字典而进行字符串转换,以便于字典的携带数学基元标识以及核心参数在用户终端向服务端的传输。After generating the dictionary for the artificial intelligence application built by the user through the foregoing exemplary embodiment, the dictionary needs to be converted into a string, so that the dictionary carries the mathematical primitive identification and core parameters from the user terminal to the server.
在一个示例性实施例中,将字典中的数学基元标识以及索引的核心参数,转换为JSON字符串,字典将以JSON字符串的形式向服务端传输。In an exemplary embodiment, the mathematical primitive identification in the dictionary and the core parameters of the index are converted into JSON strings, and the dictionary will be transmitted to the server in the form of JSON strings.
在步骤373中,为用户所构建的人工智能应用向服务端传输字符串,通过字符串的传输发起服务端对字符串的解码获得人工智能应用的可执行文本,以运行于服务端。In step 373, the artificial intelligence application built for the user transmits a character string to the server, and initiates decoding of the character string by the server through transmission of the character string to obtain executable text of the artificial intelligence application to run on the server.
其中,服务端在接收到用户终端对所搭建人工智能应用而发送的字符串之后,将字符串解码转换回字典的形式,然后再通过图论的数学语言表示进行解码得到可执行文本。After receiving the character string sent by the user terminal to the built artificial intelligence application, the server converts the character string decoding back into the form of a dictionary, and then decodes the mathematical language representation of graph theory to obtain executable text.
可执行文本是用户所搭建人工智能应用的代码描述。可执行文本的执行,便执行了用户为实现人工智能应用所配置的一系列操作,此过程即为人工智能应用的运行过程。The executable text is the code description of the artificial intelligence application built by the user. The execution of executable text executes a series of operations configured by the user to realize the artificial intelligence application. This process is the running process of the artificial intelligence application.
通过此示例性实施例,所搭建人工智能应用能够存在于服务端,进而通过服务端优秀的硬件条件得以充分实现人工智能应用中配置的功能。Through this exemplary embodiment, the built artificial intelligence application can exist on the server side, and then the functions configured in the artificial intelligence application can be fully realized through excellent hardware conditions on the server side.
图7是根据另一示例性实施例示出的一种人工智能应用的搭建方法的流程图。在一个示例性实施例中,如图7所示,该人工智能应用的搭建方法还包括以下步骤:Fig. 7 is a flowchart illustrating a method for building an artificial intelligence application according to another exemplary embodiment. In an exemplary embodiment, as shown in FIG. 7, the method for building an artificial intelligence application further includes the following steps:
在步骤410中,对搭建区配置的组块,接收用户的新增组块选择指令,该新增组块选择指令作用于搭建区配置的至少一个组块。In step 410, the block configured in the building area receives a user's new block selection instruction, and the new block selection instruction acts on at least one block configured in the building area.
其中,在用户操控下搭建区进行着至少一个组块的添加,这一用户操控而向搭建区添加组块的过程,可以是人工智能应用的搭建过程,也可以是为后续的人工智能应用搭建所进行的组块新增过程。Among them, the building area is under the control of the user to add at least one block. This user-controlled process of adding blocks to the building area can be the process of building an artificial intelligence application, or it can be built for subsequent artificial intelligence applications. The process of adding blocks.
无论是在人工智能应用的搭建中,还是其它情况下,都能够新增组块,以使得图形界面初始化配置的组块根据用户需求而新增,进而方便后续所进行的人工智能应用搭建。Whether it is in the construction of artificial intelligence applications, or in other cases, new blocks can be added, so that the initial configuration of the graphical interface block is added according to user needs, which is convenient for the subsequent construction of artificial intelligence applications.
在用户所进行的人工智能应用搭建中,存在着几个组块常常需要组合在一起的情况,对于这些组块,可组合在一起而构建一新增组块。新增组块所对应的数学基元便是这些组块所对应数学基元的组合。In the construction of artificial intelligence applications by users, there are situations where several blocks often need to be combined together. For these blocks, they can be combined together to build a new block. The mathematical primitives corresponding to the newly added blocks are the combination of the mathematical primitives corresponding to these blocks.
在搭建区,随着用户对至少一个组块的选取即可对所选取的至少一个组块发起组块新增,进而生成新增组块选择指令。新增组块选择指令是作用于用户在搭建区所选取的至少一组块的。In the construction area, as the user selects at least one block, a new block can be added to the selected at least one block, and a new block selection instruction can be generated. The newly added block selection instruction is applied to at least one block selected by the user in the building area.
在步骤430中,根据新增组块选择指令作用的组块对应生成字典,字典包括组块对应的数学基元标识以及核心参数。In step 430, a dictionary corresponding to the block corresponding to the newly added block selection instruction is generated, and the dictionary includes a mathematical primitive identifier corresponding to the block and core parameters.
其中,在接收得到用户所触发生成的新增组块选择指令之后,对新增组块选择指令作用的组块生成字典。After receiving the new block selection instruction triggered by the user, a dictionary is generated for the block acting on the new block selection instruction.
与搭建人工智能应用相类似的,新增组块的进行仍然需要为此而生成字典。为新增组块而生成的字典对组合在一起的组块进行所对应数学基元标识以及核心信息的描述。对于新增组块,以及所对应新增的数学基元而言,生成的字典为此而通过数据而进行描述。Similar to building artificial intelligence applications, the addition of new blocks still requires the generation of a dictionary for this. The dictionary generated for adding new blocks describes the corresponding mathematical primitive identification and core information of the combined blocks. For the newly added chunks and the corresponding newly added mathematical primitives, the generated dictionary is described by data for this purpose.
组合在一起构成新增组块的至少一个组块中,为新增组块所生成的字典中,数学基元 标识唯一标识了所对应的组块,而组块所对应的核心参数,由于是包含了数学操作所对应输入维度以及输出维度的,所以将指示着组块之间的链接关系。In at least one of the blocks that are combined to form a new block, in the dictionary generated for the new block, the mathematical primitive identifier uniquely identifies the corresponding block, and the core parameters corresponding to the block are Contains the input dimension and output dimension corresponding to the mathematical operation, so it will indicate the link relationship between the chunks.
具体的,为组块,即数学基元指定了输入维度和输出维度的核心参数,将用于确定组块之间的链接。一组块所对应数学基元的输出维度如果作为另一组块所对应数学基元的输入维度,则指示这两个组块之间是相互链接的。Specifically, the core parameters of the input dimension and the output dimension are specified for the chunks, that is, the mathematical primitives, which will be used to determine the links between chunks. If the output dimension of the mathematical primitive corresponding to one group of blocks is the input dimension of the mathematical primitive corresponding to another group of blocks, it indicates that the two groups of blocks are linked to each other.
因此,通过所生成的字典,能够精准获知所组合在一起的组块以及组块之间的链接关系,而并不需要耗费过多的存储空间以及较多的计算成本。Therefore, through the generated dictionary, the grouped blocks and the link relationship between the blocks can be accurately known without consuming excessive storage space and more calculation cost.
在步骤450中,对字典中的数学基元标识以及核心参数通过图论的数学语言表示组合封装为新增的数学基元。In step 450, the mathematical primitive identification and core parameters in the dictionary are combined and added into the newly added mathematical primitives through the mathematical language representation of graph theory.
其中,字典作为新增数学基元的数据描述,将在字典所进行的数据描述中根据数学基元标识及其对应的核心参数表示为图论的数学语言,以此来获得几个组块组合封装在一起所形成的新增数学基元。Among them, the dictionary is used as the data description of the newly added mathematical primitives. The data description in the dictionary is represented as a mathematical language of graph theory according to the mathematical primitive identification and its corresponding core parameters, so as to obtain several block combinations New mathematical primitives formed by encapsulation.
首先应当说明的是,图论的数学语言表示,是跟踪基本的数学基元中输入值、输入值上所做的数学操作,以及输出值,以此来对数学基元进行重构和表征。无论输入值、数学操作还是输出值,都将以节点的形式重构,进而形成数学基元在图论上的数学语言表示。通过图论的数学语言表示,将得以准确快速的重构新增的数学基元。First of all, it should be noted that the mathematical language representation of graph theory is to track the input values in the basic mathematical primitives, the mathematical operations done on the input values, and the output values, in order to reconstruct and characterize the mathematical primitives. No matter the input value, mathematical operation or output value, they will be reconstructed in the form of nodes, and then form the mathematical language representation of mathematical primitives in graph theory. Through the mathematical language representation of graph theory, the newly added mathematical primitives can be reconstructed accurately and quickly.
可以理解的,对于搭建的人工智能应用,服务端在获得字符串并解码转换回字典之后,便基于字典进行着每一数学基元在图论上数学语言表示的重构,以此来快速重构人工智能应用所执行的数学操作以及所执行数学操作的输入和输出维度。Understandably, for the artificial intelligence application built, after the server obtains the character string and decodes it and converts it back into a dictionary, it reconstructs the mathematical language representation of each mathematical primitive on the graph theory based on the dictionary, in order to quickly repeat Construct mathematical operations performed by artificial intelligence applications and the input and output dimensions of the performed mathematical operations.
多个组块搭建所得到的人工智能应用是由若干数学基元所构成的,所新增的组块构成了一段可执行的程序,与之相类似,也是由至少一个以上的组块所搭建得到的,因此,新增的组块,其数学基元的重构也是基于字典进行的每一数学基元在图论上数学语言表示的重构。The artificial intelligence application obtained by the construction of multiple blocks is composed of several mathematical primitives. The newly added blocks constitute an executable program, similar to it, which is also built by at least one or more blocks As a result, the reconstruction of the mathematical primitives of the newly added blocks is also based on the reconstruction of the mathematical language representation of each mathematical primitive in the graph theory based on the dictionary.
在步骤470中,向图形界面和服务端进行新增数学基元的更新。In step 470, the new mathematical primitives are updated to the graphical interface and the server.
其中,在通过步骤450的执行重构得到新增组块对应的数学基元之后,需要进行图形界面上以及服务端的更新。一方面使得图形界面所能够提供给用户选用的众多组块中存在着新增组块,以便于用户能够向搭建区添加新增组块,另一方面,也将使得服务器能够在为图形界面所进行的组块初始化中配置新增组块,并且在接收的字典中识别所新增组块所相关的数据,使得新增组块对应的数学基元得以在服务端运行。After obtaining the mathematical primitives corresponding to the newly added chunks through the execution and reconstruction of step 450, it is necessary to update the graphical interface and the server. On the one hand, there are new blocks among the many blocks that the graphical interface can provide to users, so that users can add new blocks to the building area. On the other hand, it will also enable the server to be used by the graphical interface. The newly added chunks are configured during the initialization of the chunks, and the data related to the newly added chunks are identified in the received dictionary, so that the mathematical primitives corresponding to the newly added chunks can be run on the server.
所进行的新增数学基元更新,包括着组块所相关图像信息的更新,此外,在对新增数学基元进行唯一标识且对构成新增数学基元的所有数学基元存储数学基元标识以及核心参数,因此,新增数学基元的更新还包括了数学基元标识、核心参数等数学基元定义信息的更新。The new mathematical primitives are updated, including the image information related to the block. In addition, the new mathematical primitives are uniquely identified and the mathematical primitives are stored for all mathematical primitives that constitute the new mathematical primitives. Identification and core parameters. Therefore, the update of the newly added mathematical primitives also includes the update of mathematical primitive definition information such as mathematical primitive identification and core parameters.
在用户终端和服务端,都进行关数学基元定义信息的更新,通过所更新的数学基元定义信息,即可获知新增数学基元所执行的数学操作以及与此相关的其它信息。更新的数学基元定义信息对新增数学基元以及新增数学基元中数学操作的执行都进行了描述。Both the user terminal and the service end update the mathematical primitive definition information, and through the updated mathematical primitive definition information, the mathematical operations performed by the newly added mathematical primitives and other information related to this can be known. The updated mathematical primitive definition information describes the newly added mathematical primitives and the execution of mathematical operations in the newly added mathematical primitives.
通过此示例性实施例,为所进行的人工智能应用搭建提供了新增组块的功能,以此来使得用户能够根据自身的应用搭建需求以及习惯个性化的配置组块,图形界面上除了存在原始配置的组块之外,还将存在着用户自定义配置的组块,人工智能应用搭建的便利性以及自由性得到增强。Through this exemplary embodiment, the function of adding new blocks is provided for the construction of artificial intelligence applications, so that users can build configuration blocks according to their own application requirements and habits, in addition to the existence of the graphical interface In addition to the original configuration blocks, there will also be user-defined configuration blocks, and the convenience and freedom of building artificial intelligence applications will be enhanced.
在此示例性实施例中,将频繁组合在一起进行人工智能应用搭建的组块,打包封装在一起而构成新的组块。换而言之,是将原本较为细化的数学操作组合在一块构成新的数学操作,以此来为用户所进行的人工智能应用搭建新建操作,增强人工智能应用搭建的执行性能。In this exemplary embodiment, the blocks that are frequently combined for artificial intelligence application building are packaged and packaged together to form a new block. In other words, it is to combine the original more detailed mathematical operations into a new mathematical operation, in order to build a new operation for the artificial intelligence application performed by the user, and enhance the execution performance of the artificial intelligence application.
在一个示例性实施例中,步骤470包括:为新增数学基元按照所配置的组块名称向图形界面添加新增组块,以在图形界面初始化配置的若干组块中更新所添加的新增组块。In an exemplary embodiment, step 470 includes: adding a new block to the graphical interface for the newly added mathematical primitive according to the configured block name, so as to update the added new block among the several blocks of the initial configuration of the graphical interface Add chunks.
其中,对于新增数学基元,其在图形界面上必然有着所对应的新增组块,也就是说, 必然会在图形界面以新增组块的形式表示新增数学基元。图形界面中,表征数学基元的组块,也称之为图块,是用户为搭建人工智能应用所操控的目标。Among them, the newly added mathematical primitives must have corresponding newly added blocks on the graphical interface, that is to say, the newly added mathematical primitives must be represented in the form of newly added blocks on the graphical interface. In the graphical interface, the blocks that represent mathematical primitives, also called tiles, are the targets that users manipulate to build artificial intelligence applications.
应当理解,为便于用户识别,将为图形界面上对应于新增数学基元配置所新增的组块,新增组块上标记了所对应于组块名字,以区分于其它组块,进而方便用户选取。It should be understood that, in order to facilitate user identification, the newly added blocks corresponding to the newly added mathematical primitive configuration on the graphical interface are marked with the names of the corresponding blocks to distinguish them from other blocks. It is convenient for users to choose.
图8是根据图7对应实施例在另一个示例性实施例中示出的对步骤470进行描述的流程图。在另一个示例性实施例中,如图8所示,该步骤470至少包括:FIG. 8 is a flowchart illustrating step 470 shown in another exemplary embodiment according to the corresponding embodiment of FIG. 7. In another exemplary embodiment, as shown in FIG. 8, this step 470 includes at least:
在步骤471中,为新增数学基元生成新增数学基元标识。In step 471, a new mathematical primitive identifier is generated for the new mathematical primitive.
其中,新增数学基元标识,与前述所指的数学基元标识相类似,都用于唯一标识所对应的数学基元以及组块。Among them, the newly added mathematical primitive logo is similar to the aforementioned mathematical primitive logo, and is used to uniquely identify the corresponding mathematical primitive and block.
在为新增数学基元通过新增组块而进行的核心参数配置中,所配置的核心参数对应于生成的新增数学基元标识。In the configuration of core parameters for adding new mathematical primitives by adding new blocks, the configured core parameters correspond to the generated new mathematical primitive identifiers.
在步骤473中,在新增数学基元标识下对新增数学基元打包的数学基元标识以及核心参数生成数学基元定义信息。In step 473, the mathematical primitive definition information and the core parameter of the newly added mathematical primitive package are generated under the newly added mathematical primitive identifier.
其中,新增组块是由至少一个组块所构成的,与此相对应的,新增组块所对应的新增数学基元也是由至少一个数学基元打包封装所形成的,对此,为新增数学基元所生成的新增数学标识之下对应着至少一组数学基元标识以及核心参数。Among them, the newly added chunks are composed of at least one chunk. Correspondingly, the newly added mathematical primitives corresponding to the newly added chunks are also formed by packaging and packaging at least one mathematical primitive. The new mathematical identifier generated for the new mathematical primitive corresponds to at least one set of mathematical primitive identifiers and core parameters.
用于描述所对应组块的数字基元的一组数学基元标识以及核心参数,与其它组数学基元标识以及核心参数一起,描述新增数学基元,即为新增数学基元生成数学基元定义信息。A set of mathematical primitive identifiers and core parameters used to describe the digital primitives of the corresponding block. Together with other sets of mathematical primitive identifiers and core parameters, describe the new mathematical primitives, that is, generate math for the new mathematical primitives Primitive definition information.
应当理解,对于存在于图形界面可供用户选用的组块,都有着对应的数学基元定义信息,以便于以此为依据而为用户搭建的人工智能应用提供相应的算法实现。It should be understood that there are corresponding mathematical primitive definition information for the blocks that are available for users to choose from in the graphical interface, so as to provide corresponding algorithms for artificial intelligence applications built by users based on this.
在步骤475中,将数学基元定义信息更新至服务端,数学基元定义信息在服务端的更新使新增数学基元能够在服务端对图形界面的初始化中新增所对应的组块。In step 475, the mathematical primitive definition information is updated to the server. The updating of the mathematical primitive definition information on the server enables the newly added mathematical primitive to add the corresponding block in the initialization of the graphical interface by the server.
其中,数学基元定义信息在服务端的存在,便意味着所对应新增数学基元以及组块的被部署于后续所进行的人工智能应用搭建中,后续通过图形界面而供用户进行的人工智能应用搭建,都可选用所新增的组块,进而在所搭建的人工智能应用中配置新增的数学基元。Among them, the existence of mathematical primitive definition information on the server means that the corresponding newly added mathematical primitives and blocks are deployed in the subsequent artificial intelligence application building, and the subsequent artificial intelligence for the user through the graphical interface Application building, you can use the newly added blocks, and then configure the newly added mathematical primitives in the built artificial intelligence applications.
图9是根据图7对应实施例示出的对步骤430进行描述的流程图。在一个示例性实施例中,如图9所示,该步骤430至少包括:FIG. 9 is a flowchart illustrating step 430 according to the embodiment corresponding to FIG. 7. In an exemplary embodiment, as shown in FIG. 9, the step 430 includes at least:
在步骤431中,根据新增组块选择指令作用的所有组块分别获取对应的数学基元标识以及核心参数。In step 431, the corresponding mathematical primitive identification and core parameters are obtained respectively according to all the blocks acting on the newly added block selection instruction.
其中,如前所述的,新增组块是对应于用户所选取的至少一个组块实现的,是将组块所对应的至少一个数学基元组合在一起,并为此而形成新的组块。用户一旦选用新增组块,则相当于选用了所对应的至少一个组块,由此将得以增强人工智能应用搭建的便利性以及效率,能够快速搭建人工智能应用。Among them, as mentioned above, the newly added chunks are implemented corresponding to at least one chunk selected by the user, which is to combine at least one mathematical primitive corresponding to the chunks and form a new group for this purpose Piece. Once the user chooses to add a new block, it is equivalent to selecting at least one corresponding block, which will enhance the convenience and efficiency of artificial intelligence application building, and can quickly build artificial intelligence applications.
面对于搭建区被选择进行组块新增的至少一个组块,组块之间相互连接形成了能够完成至少一个数学操作的网络拓扑,此时,由于组块之间是相互链接的,因此,组块所对应核心参数中输入维度和输出维度已经按照当前所构建的链接关系配置,可针对于每一组块都进行所对应数学基元标识以及核心参数的获取,以便用于为每一组块生成字典数据,字典数据相对于所链接的其它组块,指示了所在组块与其的链接关系。For at least one block selected for building block addition in the building area, the block interconnections form a network topology capable of performing at least one mathematical operation. At this time, since the block blocks are linked to each other, The input and output dimensions of the core parameters corresponding to the chunks have been configured according to the currently constructed link relationship, and the corresponding mathematical primitive identification and core parameters can be obtained for each chunk to be used for each group The block generates dictionary data, and the dictionary data indicates the link relationship between the located block and the other linked blocks.
在步骤433中,对每一组块都以对应的数学基元标识为索引项,核心参数为索引值构建字典数据,以生成新增组块对应的字典。In step 433, for each group of blocks, a corresponding mathematical primitive identifier is used as an index item, and core parameters are index values to construct dictionary data to generate a dictionary corresponding to the newly added group of blocks.
其中,通过键值对的数据结构为每一组块构建字典数据,在此键值对的数据结构是以数学基元为索引项,核心参数为索引值。Among them, dictionary data is constructed for each group of blocks through a key-value pair data structure, where the key-value pair data structure uses mathematical primitives as index items and core parameters as index values.
对组合构成新增组块的所有组块都分别构建字典数据,由所有字典数据来生成得到新增组块对应的字典。Dictionary data is constructed separately for all the blocks that make up the newly added blocks, and the dictionary corresponding to the newly added blocks is generated from all dictionary data.
此外,与前述所提供一种人工智能应用的搭建方法相对应的,下述为本发明在服务端中的方法实现,即应用于图1所示实施环境中服务器的人工智能应用搭建中的运行实现方法。图10是根据一示例性实施例示出的一种人工智能应用搭建中的运行实现方法的流程 图。在一个示例性实施例中,如图10所示,该人工智能应用搭建中的运行实现方法,至少包括以下步骤。In addition, corresponding to the method for building an artificial intelligence application provided above, the following is the method implementation of the present invention in the server, that is, the operation of the artificial intelligence application building applied to the server in the implementation environment shown in FIG. 1 Implementation. Fig. 10 is a flow chart showing a method for implementing operation in building an artificial intelligence application according to an exemplary embodiment. In an exemplary embodiment, as shown in FIG. 10, the operation implementation method in the construction of an artificial intelligence application includes at least the following steps.
在步骤510中,用户选择进行的人工智能应用搭建中,服务端接收字典所对应字符串,该字符串对应的字典用于描述为人工智能应用搭建所配置的组块。In step 510, when the user chooses to build an artificial intelligence application, the server receives the character string corresponding to the dictionary, and the dictionary corresponding to the character string is used to describe the building blocks configured for the artificial intelligence application.
其中,为实现用户终端中的人工智能应用搭建,所部署的服务端将响应用户终端的操控配合实现人工智能应用的搭建,为用户获得存在于服务端的人工智能应用。Among them, in order to realize the construction of the artificial intelligence application in the user terminal, the deployed server will respond to the manipulation of the user terminal and cooperate with the realization of the construction of the artificial intelligence application to obtain the artificial intelligence application existing on the server for the user.
人工智能应用的运行,是通过一系列数学操作的执行所实现的,即以数学基元为单位而实现用户所需要的运算。数学操作的执行必然有着所对应的代码信息支持,以此来控制服务端对此数学操作的执行。因此,服务端为所部署的组块都相应进行着代码所相关信息的存储,需要用户为所搭建人工智能应用生成的字典控制下分别调取,以获得能够实现人工智能应用运行的可执行文本。The operation of artificial intelligence applications is achieved through the execution of a series of mathematical operations, that is, the operations required by users are realized in units of mathematical primitives. The execution of mathematical operations must be supported by the corresponding code information to control the execution of the mathematical operations on the server side. Therefore, the server side stores the information related to the code for the deployed blocks accordingly, which requires users to retrieve them separately under the control of the dictionary generated by the built artificial intelligence application to obtain executable text that can realize the operation of the artificial intelligence application. .
基于此,随着用户在用户终端所进行的人工智能应用搭建完成,为所搭建人工智能应用而生成的字典将被转换为字符串,并发送至服务端,以使得服务端能够获得用户所进行的人工智能应用搭建。此时,服务端将会接收得到用户终端所发送的字符串。转换为此字符串的字典通过一条条字典数据为相应组块描述和定义了所对应的数学基元。Based on this, as the user builds the artificial intelligence application on the user terminal, the dictionary generated for the built artificial intelligence application will be converted into a string and sent to the server, so that the server can obtain the user's Built artificial intelligence applications. At this time, the server will receive the character string sent by the user terminal. The dictionary converted to this character string describes and defines the corresponding mathematical primitives for the corresponding chunks through a piece of dictionary data.
应当理解,数学基元是在面向于用户所实现的人工智能应用搭建中,用于实现人工智能应用的操作单元,能够根据需要而在不同层面划分操作单元,进而为此而配置数学基元以及相应的组块。It should be understood that the mathematical primitives are the operation units for implementing artificial intelligence applications in the construction of artificial intelligence applications for users. They can divide the operation units at different levels according to needs, and then configure the mathematical primitives and The corresponding chunk.
例如,可以根据人工智能算法而神经网络操作、点乘操作以及矩阵乘法操作等都作为操作单元而配置相应的,某些神经网络操作中包含着点乘操作,,因此,可以看到,二者是不同层面上的操作单元划分,但是,并不影响其所对应数学基元以及组块的配置。For example, according to artificial intelligence algorithms, neural network operations, dot product operations, and matrix multiplication operations are all configured as operating units. Some neural network operations include dot product operations. Therefore, you can see that both It is the division of operating units at different levels, but it does not affect the configuration of the corresponding mathematical primitives and chunks.
因此,也可将细分的操作单元组合在一起形成在上一层面上形成新的操作单元,即数学基元和组块,此即为前述示例性实施例所指的组块新增过程。Therefore, the subdivided operation units can also be combined to form a new operation unit on the upper layer, that is, mathematical primitives and chunks. This is the process of adding chunks referred to in the foregoing exemplary embodiments.
在步骤530中,解码字符串获得人工智能应用的可执行文本。In step 530, the character string is decoded to obtain the executable text of the artificial intelligence application.
其中,对字典转换而获得的字符串,解码字符串即可获得所搭建人工智能应用中涉及的数学基元标识以及核心参数,在此基础之上通过图论的数学语言表示而不断以DAG数据结构重构每一数学基元,并为此而构建此数学基元与其它数学基元之间的链接关系,进而最终形成所搭建人工智能应用对应的可执行文本。可执行文本包含了所搭建人工智能应用的所有可执行语句,由所有数学基元的代码信息构成。Among them, the character string obtained by the dictionary conversion can be decoded to obtain the mathematical primitive identification and core parameters involved in the built artificial intelligence application. On this basis, the DAG data is continuously expressed by the mathematical language of graph theory. The structure reconstructs each mathematical primitive, and constructs the link relationship between this mathematical primitive and other mathematical primitives for this purpose, and finally forms the executable text corresponding to the built artificial intelligence application. The executable text contains all the executable sentences of the built artificial intelligence application, which is composed of the code information of all mathematical primitives.
在步骤550中,通过可执行文本的执行,使用户选择搭建的人工智能应用运行服务端。In step 550, through execution of the executable text, the user is allowed to choose to build the artificial intelligence application to run the server.
其中,在获得人工智能应用的可执行文本之后,即可触发人工智能应用的运行,此时,将通过可执行文本中语句的执行而实现人工智能应用所部署的功能,以此来满足用户的人工智能需求。Among them, after the executable text of the artificial intelligence application is obtained, the operation of the artificial intelligence application can be triggered. At this time, the functions deployed by the artificial intelligence application will be realized through the execution of the sentences in the executable text to satisfy the user’s Artificial intelligence needs.
对于用户而言,一方面,其通过图形界面快速自由的进行了人工智能应用的搭建,另一方面,由于所搭建人工智能应用是存在且运行于服务端的,因此,能够使得自身所搭建的人工智能应用获得了优秀的硬件性能以及强大的计算能力,增强了所搭建人工智能应用的性能。For users, on the one hand, they quickly and freely build artificial intelligence applications through a graphical interface. On the other hand, because the built artificial intelligence applications exist and run on the server side, they can make the artificial Intelligent applications have obtained excellent hardware performance and powerful computing capabilities, enhancing the performance of artificial intelligence applications built.
图11是根据图10对应实施例示出的对步骤530进行描述的流程图。在一个示例性实施例中,如图11所示,该步骤530至少包括以下步骤:FIG. 11 is a flowchart illustrating step 530 according to the embodiment corresponding to FIG. 10. In an exemplary embodiment, as shown in FIG. 11, the step 530 includes at least the following steps:
在步骤531中,将字符串解码转换为字典,字典包含了为人工智能应用所配置组块对应的数学基元标识以及核心参数。In step 531, the character string is decoded and converted into a dictionary, which contains the mathematical primitive identification and core parameters corresponding to the chunks configured for artificial intelligence applications.
在步骤533中,通过字典中包含的数学基元标识以及核心参数重建执行对应数学操作的代码信息,获得人工智能应用的可执行文本。In step 533, the code information for performing the corresponding mathematical operation is reconstructed through the mathematical primitive identifier and core parameters contained in the dictionary to obtain the executable text of the artificial intelligence application.
其中,解码转换字符串而获得字典之后,即可由所得到的字典从中获取对应于每一数学基元的一组数学基元标识以及核心参数。After decoding the converted character string to obtain a dictionary, a set of mathematical primitive identifiers and core parameters corresponding to each mathematical primitive can be obtained from the obtained dictionary.
如前所述的,数学基元标识以及核心参数这一组字典数据指示着所对应的数学基元以及链接于此数学基元的其它数学基元,即输入维度是核心参数中输出维度的数学基元即为 当前数学基元所链接的。As mentioned before, the set of dictionary data of the mathematical primitive identification and core parameters indicate the corresponding mathematical primitives and other mathematical primitives linked to this mathematical primitive, ie the input dimension is the math of the output dimension in the core parameters The primitive is the link to the current mathematical primitive.
因此,能够通过字典所包含的一条条字典数据来进行数学基元的重建,所重建的数学基元在程序执行方面将以代码信息的形式表示,通过重建来获得代码信息,此代码信息是执行数学基元所对应数学操作的程序语言。以此类推,所有代码信息便构成了人工智能应用的可执行文本。Therefore, it is possible to reconstruct the mathematical primitives through the dictionary data contained in the dictionary. The reconstructed mathematical primitives will be expressed in the form of code information in terms of program execution, and the code information is obtained through reconstruction. This code information is the execution The programming language for mathematical operations corresponding to mathematical primitives. By analogy, all code information constitutes executable text for artificial intelligence applications.
图12是根据图11对应实施例示出的对步骤533进行描述的流程图。在一个示例性实施例中,该步骤533如图12所示,至少包括以下步骤。FIG. 12 is a flowchart describing step 533 according to the embodiment corresponding to FIG. 11. In an exemplary embodiment, this step 533 is shown in FIG. 12 and includes at least the following steps.
在步骤601中,根据字典中的数学基元标识获得所对应数学操作的数据缺失代码。In step 601, the data missing code of the corresponding mathematical operation is obtained according to the mathematical primitive identification in the dictionary.
其中,服务端受控于用户终端所进行的人工智能应用搭建而获得面向于所搭建人工智能应用的字典,该字典记录着所搭建人工智能应用所使用的每一数学基元对应的数学基元标识以及核心参数。Among them, the server is controlled by the artificial intelligence applications built by the user terminal to obtain a dictionary for the built artificial intelligence applications, the dictionary records the mathematical primitives corresponding to each mathematical primitive used by the built artificial intelligence applications Logo and core parameters.
除此之外,服务端还为所需要执行的数学操作进行着代码所相关信息的存储。为每一数学操作的执行所存储的代码相关信息,是缺失了核心参数的数据缺失代码。数据缺失代码是以数学基元标识为索引相应进行存储的。缺失了核心参数的数据缺失代码,能够随着不同人工智能应用的实现而相适应填充不同核心参数,实现所执行数学操作的不同配置,以此来充分适应人工智能应用的实现。In addition, the server also stores the information related to the code for the mathematical operations that need to be performed. The code-related information stored for the execution of each mathematical operation is the data-missing code with missing core parameters. The data missing codes are stored correspondingly with the index of the mathematical primitive as the index. The data missing code with missing core parameters can be adapted to fill different core parameters with the realization of different artificial intelligence applications, and realize different configurations of the mathematical operations performed, so as to fully adapt to the realization of artificial intelligence applications.
在服务端所存储数据缺失代码的作用下,使得服务端一方面在数据缺失代码的支持下为用户提供了人工智能应用算法,使得用户能够通过组块而简单直观的搭建人工智能应用,另一方面也将在数据缺失代码的支持下获得灵活自由的算法实现,增强了人工智能应用搭建的灵活性。Under the effect of the data missing code stored on the server side, on the one hand, the server side provides users with artificial intelligence application algorithms supported by the data missing code, allowing users to build artificial intelligence applications simply and intuitively through the block, and the other The aspect will also obtain flexible and free algorithm implementation with the support of data missing code, which enhances the flexibility of artificial intelligence application construction.
在步骤603中,将数学基元标识对应的核心参数填充至获得的数据缺失代码,得到执行所对应数学操作的代码信息。In step 603, the core parameters corresponding to the mathematical primitive identification are filled into the obtained data missing code to obtain code information for performing the corresponding mathematical operation.
其中,如前所述的,字典中的核心参数是对应于数学基元标识的,因此,在由数学基元标识获得数据缺失代码之后,也将由此数学基元标识获取对应的核心参数,将所获取的核心参数填充至数据缺失代码中,以获得执行所对应数学操作的完整代码信息。Among them, as mentioned above, the core parameters in the dictionary are corresponding to the mathematical primitive identification. Therefore, after the data missing code is obtained from the mathematical primitive identification, the corresponding core parameters will also be obtained from the mathematical primitive identification. The acquired core parameters are filled into the data-missing code to obtain complete code information for performing the corresponding mathematical operation.
所填充核心参数而获得的代码信息,是在代码层面上的数学基元描述。在数据缺失代码以及代码信息的作用下,使得用户即便不具备编程智能以及编程技能也能够根据自己的需求搭建人工智能应用。The code information obtained by filling in the core parameters is a mathematical primitive description at the code level. Under the effect of missing data codes and code information, users can build artificial intelligence applications according to their own needs even without programming intelligence and programming skills.
在步骤605中,根据数学基元标识所对应核心参数中指示的输入维度和输出维度,对代码信息从输出到输入顺次通过图论的数学语言表示重构人工智能应用的可执行文本。In step 605, according to the input dimension and output dimension indicated in the core parameter corresponding to the mathematical primitive identification, the executable information of the artificial intelligence application is reconstructed from the output of the code information to the input through the mathematical language of graph theory.
其中,正如前述描述所指出的,核心参数为所对应执行的数学操作,也为其通过代码信息所进行的人工智能算法实现指示了输入维度以及输出维度,因此,能够与此为依据而与其它数学基元对接。Among them, as pointed out in the foregoing description, the core parameters are the corresponding mathematical operations performed, and also indicate the input and output dimensions for the implementation of the artificial intelligence algorithm through the code information. Therefore, it can be based on this and other Mathematical primitive docking.
在此应当说明的是,图论的数学语言表示是针对于数学基元而言的,也是针对于执行所对应数学操作的代码信息而言的。图论的数学语言表示是借助于DAG结构来快速准确的重建数学基元所对应的输入、输出以及数学操作,进而在此基础上按照输出到输入的顺序不断进行着数学基元所对应DAG结构的重建,直至完成字典对应的所有数学基元重建。It should be noted here that the mathematical language representation of graph theory is for mathematical primitives, and also for code information that performs corresponding mathematical operations. The mathematical language representation of graph theory is to use the DAG structure to quickly and accurately reconstruct the input, output, and mathematical operations corresponding to the mathematical primitives, and then on the basis of this, the DAG structure corresponding to the mathematical primitives is continuously carried out in the order of output to input. Until the completion of the reconstruction of all mathematical primitives corresponding to the dictionary.
在字典所对应所有数学基元都重建得到了图论的数学语言表示之后,对于所对应的代码信息,按照图论的数学语言表示进行拼接即可重构得到人工智能应用的可执行文本。After all the mathematical primitives corresponding to the dictionary are reconstructed to obtain the mathematical language representation of graph theory, the corresponding code information can be reconstructed according to the mathematical language representation of graph theory to obtain the executable text of the artificial intelligence application.
例如,图13是根据一示例性实施例示出的一简单数学基元所对应DAG结构的示意图。这一简单数学基元为“I+W=O”,即以“I”为输入,“O”为输出,对输入数据执行加法操作,而“W”则是所需要训练所得到的参数。For example, Fig. 13 is a schematic diagram of a DAG structure corresponding to a simple mathematical primitive according to an exemplary embodiment. This simple mathematical primitive is "I+W=O", that is, "I" is used as the input, and "O" is used as the output, and the addition operation is performed on the input data, and "W" is the parameter obtained by the required training.
下表即为用户在图形界面中对组块Add配置的“I”和“O”数据表,组块Add指示了所对应的数学基元将对输入数据执行加法操作,具体如下表所示,即:The following table shows the "I" and "O" data tables configured by the user on the block Add in the graphical interface. The block add indicates that the corresponding mathematical primitive will perform an addition operation on the input data, as shown in the following table. which is:
II OO
11 77
22 88
33 99
44 1010
55 1111
表1Table 1
通过此示例性实施例中,借助于DAG结构使得人工智能应用的搭建即便涉及复杂的人工智能算法也能够快速实现。With this exemplary embodiment, the construction of artificial intelligence applications can be quickly realized even if complex artificial intelligence algorithms are involved by means of the DAG structure.
图14是根据图10对应实施例示出的对步骤550进行描述的流程图。在一个示例性实施例中,如图14所示,该步骤550至少包括以下步骤。FIG. 14 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10. In an exemplary embodiment, as shown in FIG. 14, this step 550 includes at least the following steps.
在步骤551a中,在训练模式下,获取适用于人工智能应用的样本数据,训练模式是在图形界面被用户所选择的模式。In step 551a, in the training mode, sample data suitable for artificial intelligence applications is obtained, and the training mode is the mode selected by the user on the graphical interface.
在步骤553a中,通过可执行文本的执行在服务端运行人工智能应用,在人工智能应用的运行中通过样本数据进行参数的训练。In step 553a, an artificial intelligence application is run on the server through execution of executable text, and parameter training is performed through sample data during the operation of the artificial intelligence application.
此示例性实施例为用户搭建的人工智能应用提供了人工智能应用的训练过程,以为用户搭建的人工智能应用通过设置的样本参数而完成参数的迭代训练,进而方可正常使用搭建的人工智能应用。This exemplary embodiment provides the training process of the artificial intelligence application for the artificial intelligence application built by the user, so that the artificial intelligence application built by the user completes the iterative training of the parameters through the set sample parameters, and then the built artificial intelligence application can be used normally .
适用人工智能应用的样本数据,在一个示例性实施例中,是用户所配置的,例如,用户通过图形界面所设置的工具栏进行着样本数据导入,此外,也可通过操作界面上与数据相关的组块对所搭建人工智能应用实现样本数据的设置,还可通过工具栏中设置的选取框实现样本数据的选取。The sample data suitable for artificial intelligence applications is configured by the user in an exemplary embodiment, for example, the user imports sample data through the toolbar set by the graphical interface, and can also be related to the data through the operation interface The set of blocks can be used to set the sample data for the artificial intelligence applications built, and the sample data can also be selected through the check box set in the toolbar.
也就是说,样本数据是用户所收集的,也可以是存储于服务端其他用户所分享的,还可以是服务端根据各类人工智能应用的搭建需要所预配置的,在此不进行限定。In other words, the sample data is collected by the user, it can also be stored on the server and shared by other users, or it can be pre-configured by the server according to the needs of various artificial intelligence applications. It is not limited here.
在完成了人工智能应用的搭建之后,即实现人工智能应用的所有组块都已经在搭建区添加完成且相互链接,在此之后便可选取训练模式,以对搭建的人工智能应用进行参数的迭代训练。After the construction of the artificial intelligence application is completed, all the blocks that implement the artificial intelligence application have been added and linked to the construction area, after which the training mode can be selected to iterate the parameters of the constructed artificial intelligence application training.
也就是说,对于完成搭建的人工智能应用,通过用户操控可置于训练模式,也可置于运行决策模式,以此来对人工智能应用的运行进行控制。That is to say, for the artificial intelligence application that has been built, it can be placed in training mode or operation decision mode through user control, so as to control the operation of the artificial intelligence application.
例如,其可在图形界面设置训练模式或者决策模式开启的开关,用户仅需要对开关进行操控即可选择进入相应的模式。For example, it can set a switch that is turned on in the training mode or decision mode on the graphical interface. The user only needs to manipulate the switch to select the corresponding mode.
在训练模式下,根据用户所进行的样本数据配置而获取得到适用于人工智能应用的样本数据,例如,获取服务端所推荐的样本数据,获取其他用户分享的样本数据,自己在图形界面中导入所需要的样本数据等。In training mode, obtain sample data suitable for artificial intelligence applications according to the sample data configuration performed by the user, for example, obtain sample data recommended by the server, obtain sample data shared by other users, and import it in the graphical interface The required sample data, etc.
人工智能应用是基于机器学习所实现的,是通过机器学习的算法而为用户解决特定问题。例如,机器学习算法可以是神经网络算法。因此,搭建完成的人工智能应用必然涉及到训练的实现,通过迭代训练方可获得人工智能应用正常运行所需要的参数。The application of artificial intelligence is based on machine learning, and solves specific problems for users through machine learning algorithms. For example, the machine learning algorithm may be a neural network algorithm. Therefore, the completed artificial intelligence application must involve the realization of training, and the parameters required for the normal operation of the artificial intelligence application can be obtained through iterative training.
通过此示例性实施例,为搭建的人工智能应用实现了样本数据获取的入口,即便用户受限于各种情况而无法获得数据量庞大的样本数据,也能够借助于服务器获得,进而保证所搭建人工智能应用的训练以及后续的使用,在此基础上,用户也能够适应于自身需求准备样本数据,以保证所搭建人工智能应用后续决策的精准性。Through this exemplary embodiment, the entrance of sample data acquisition is realized for the built artificial intelligence application. Even if the user is limited to various situations and cannot obtain a large amount of sample data, it can be obtained by means of the server, thereby ensuring that the built Based on the training and subsequent use of artificial intelligence applications, users can also adapt to their own needs to prepare sample data to ensure the accuracy of subsequent decisions of the artificial intelligence applications built.
此外,对于用户提交到服务端的样本数据,根据自身选择,可隐藏,即作为自己的隐私数据存储,但也可将其状态设置为公开状态,以在服务端分享。In addition, the sample data submitted by the user to the server can be hidden according to their own choices, that is, stored as their own private data, but they can also be set to the public state for sharing on the server.
而对于服务端,除了所预先配置的样本数据以及用户所分享的样本数据之外,也可以众包的方式获取样本数据,在此不进行限定。For the server, in addition to the pre-configured sample data and the sample data shared by the user, the sample data can also be obtained by crowdsourcing, which is not limited here.
图15是根据图10所对应实施例在另一个示例性实施例示出的对步骤550进行描述的流程图。在一个示例性实施例中,如图15所示,该步骤550包括:FIG. 15 is a flowchart illustrating step 550 according to the embodiment corresponding to FIG. 10 in another exemplary embodiment. In an exemplary embodiment, as shown in FIG. 15, this step 550 includes:
在步骤551b中,获取用户选择输入的数据,该数据包括用户所搭建人工智能应用处理的目标数据。In step 551b, data selected by the user for input is acquired, and the data includes target data processed by the artificial intelligence application built by the user.
在步骤553b中,通过执行完成参数训练的可执行文件,在决策模式下运行训练的人 工智能应用完成用户选择输入数据的处理。In step 553b, by executing an executable file that completes parameter training, running the trained artificial intelligence application in the decision mode completes the user's selection of input data.
此示例性实施例,实现了用户使用自已搭建的人工智能应用进行数据决策,搭建的人工智能应用真正解决了用户的数据处理需求。This exemplary embodiment realizes that the user uses the self-built artificial intelligence application to make data decisions, and the built artificial intelligence application truly solves the user's data processing needs.
用户选择输入的数据即为用户需要借助于搭建的人工智能应用处理的数据,应当理解,用户正是为此这些数据的处理需求而进行的人工智能应用搭建。The data that the user chooses to input is the data that the user needs to process with the help of the built artificial intelligence application. It should be understood that the user is building the artificial intelligence application for this data processing requirement.
与训练模式相类似的,在用户操控下仅需要开启决策模式即可进行用户选择输入数据的处理。Similar to the training mode, only the decision mode needs to be turned on under the user's control to process the user's selection of input data.
图16是根据图15对应实施例示出的对步骤551b进行描述的流程图。在一个示例性实施例中,该步骤551b,如图16所示,至少包括以下步骤。FIG. 16 is a flowchart illustrating step 551b according to the corresponding embodiment of FIG. 15. In an exemplary embodiment, this step 551b, as shown in FIG. 16, includes at least the following steps.
在步骤601中,接收用户在图形界面向自身所搭建人工智能应用上传的数据。In step 601, the data uploaded by the user to the artificial intelligence application built by the user on the graphical interface is received.
其中,人工智能应用搭建和训练完成之后,用户将在图形界面上传所需要人工智能应用处理的数据,根据人工智能应用的不同,其数据内容以及数据类型均不相同,例如,所上传请求人工智能应用处理的数据,可以是文本数据,视频数据甚至于音频数据等。Among them, after the artificial intelligence application is built and trained, the user will upload the data processed by the artificial intelligence application on the graphical interface. According to the different artificial intelligence applications, the data content and data types are different. For example, the uploaded request artificial intelligence The data processed by the application can be text data, video data or even audio data.
在步骤603中,根据数据中携带的用户标识确定用户搭建的人工智能应用。In step 603, the artificial intelligence application built by the user is determined according to the user identifier carried in the data.
其中,服务端配合诸多用户终端实现了每一用户终端上的人工智能应用搭建,因此,不同的用户,其所搭建的人工智能应用各不相同。因此,对于服务端而言,将以用户标识为索引进行着字典的存储,以此来记录不同用户对应的人工智能应用。Among them, the server cooperates with many user terminals to implement the construction of artificial intelligence applications on each user terminal. Therefore, different users have different artificial intelligence applications. Therefore, for the server, the user identification is used as an index to store the dictionary to record the artificial intelligence applications corresponding to different users.
完成了搭建和训练的人工智能应用,其字典存储于服务端,以供用户随时调用。也就是说,用户可在需要时随着访问服务端而调用搭建且训练完成的人工智能应用,并且在人工智能应用的使用中借助于决策结果而不断迭代优化人工智能应用中的参数,以此来不断提高决策的准确性。The artificial intelligence application that has been built and trained is completed, and its dictionary is stored on the server for users to call at any time. In other words, the user can call the built and trained artificial intelligence application when he needs to access the server, and in the use of the artificial intelligence application, iteratively optimizes the parameters in the artificial intelligence application by means of decision-making results. To continuously improve the accuracy of decisions.
用户标识用于唯一标示用户,因此,用户可通过用户标识实现其在服务端的登录,进而调用所搭建的人工智能应用。The user ID is used to uniquely identify the user. Therefore, the user can log in to the server through the user ID, and then call the built artificial intelligence application.
在步骤605中,对数据中请求自身所搭建人工智能应用处理的目标数据触发运行确定的人工智能应用。In step 605, the target data requested by the artificial intelligence application built by itself to be processed in the data is triggered to run the determined artificial intelligence application.
其中,通过前述步骤的执行,在完成所需要处理数据的上传之后,请求用户标识所对应的人工智能进行所上传数据的处理,以此来以所上传的数据为输入运行人工智能应用。Wherein, through the execution of the foregoing steps, after the upload of the required processing data is completed, the artificial intelligence corresponding to the user identification is requested to process the uploaded data, in order to run the artificial intelligence application with the uploaded data as input.
图17是在另一示例性实施例示出的一种人工智能应用搭建中的运行实现方法的流程图。在另一个示例性实施例中,如图17所示,该人工智能应用搭建中的运行实现方法,至少包括以下步骤。Fig. 17 is a flowchart of a method for implementing operation in building an artificial intelligence application shown in another exemplary embodiment. In another exemplary embodiment, as shown in FIG. 17, the operation implementation method in the construction of artificial intelligence applications includes at least the following steps.
在步骤710中,接收用户对新增数学基元的更新,获得数字基元定义信息,数学基元定义信息包括新增数学基元标识以及在新增数学基元标识下被新增数学基元封装所对应的至少一数学基标识、核心参数。In step 710, the user's update of the newly added mathematical primitive is received to obtain digital primitive definition information. The mathematical primitive definition information includes the newly added mathematical primitive identifier and the newly added mathematical primitive under the newly added mathematical primitive identifier At least one mathematical base identifier and core parameters corresponding to the package.
在步骤730中,进行数学基元定义信息的保存,使图形界面初始化配置新增组块。In step 730, the mathematical primitive definition information is saved, and the graphical interface is initialized and configured with new blocks.
其中,正如用户终端图形界面所进行的组块新增,即图7对应实施例所描述的,受控于用户终端的服务端必然会接收到用户终端发送的数学基元定义信息,此时,将为用户进行数学基元定义信息的保存,以供用户在后续的人工智能应用搭建中调用。Among them, as the block addition in the graphical interface of the user terminal is described, that is, as described in the embodiment corresponding to FIG. 7, the server controlled by the user terminal will necessarily receive the mathematical primitive definition information sent by the user terminal. The user will save the mathematical primitive definition information for the user to call in the subsequent artificial intelligence application construction.
当然,用户所新增的组块,也可分享给其他用户,以在其他用户的人工智能应用搭建中使用,在此不进行限定。Of course, the newly added blocks of the user can also be shared with other users for use in the construction of artificial intelligence applications of other users, which is not limited here.
用户的人工智能应用需求为短视频的动作识别,以此为例,结合上述方法实现进行阐The user's artificial intelligence application needs to be short-video action recognition. Take this as an example and explain in combination with the above method. 述。Narrate.
用户需通过本发明的人工智能应用搭建实现视频动作识别。具体的,对于描述一动作的短视频,能够通过用户所搭建的人工智能应用实现此动作的识别,输出动作分类结果。The user needs to realize the video action recognition through the artificial intelligence application of the present invention. Specifically, for a short video describing an action, the action can be recognized by an artificial intelligence application built by the user, and the action classification result can be output.
在此,正如图1对应实施环境所描述的,在用户终端,用户可在图形界面的操作组件选取栏进行着所需要组块的拖拽,以将所需要的组块拖拽至操作界面,并在组块之间通过连线构建链接关系,直至完成人工智能算法构型的搭建。Here, as described in the corresponding implementation environment of FIG. 1, on the user terminal, the user can drag and drop the required blocks in the operation component selection bar of the graphical interface to drag the required blocks to the operation interface, And build a link relationship through the connection between the blocks until the construction of the artificial intelligence algorithm configuration is completed.
所搭建的人工智能算法构型中采用的神经网络操作即为用户所实现人工智能应用采 用的数学操作。The neural network operation adopted in the constructed artificial intelligence algorithm configuration is the mathematical operation adopted by the user for the artificial intelligence application.
图18是根据一示例性实施例示出的图形界面示意图。在一示例性实施例中,如图18所示,操作组件选取栏810设置了众多操作组件,即与数据、模型相关的组块;操作界面830则是用户拖拽所需要组块的停留区域,通过拖拽图标,即组件来完成数据和模型搭建。Fig. 18 is a schematic diagram of a graphical interface according to an exemplary embodiment. In an exemplary embodiment, as shown in FIG. 18, the operation component selection bar 810 is provided with a number of operation components, that is, blocks related to data and models; the operation interface 830 is a stay area where users need to drag and drop the blocks , Complete the data and model building by dragging and dropping the icon, that is, the component.
在所进行的数据和模型搭建中,还将通过右侧的工具栏850进行数据和模型的微调。In the construction of data and models, fine-tuning of data and models will also be performed through the toolbar 850 on the right.
通过此过程来完成人工智能应用的搭建,并进行参数的迭代训练。迭代训练过程所相关信息,例如迭代次数,以及相关的迭代训练结果,将通过操作结果显示区870进行显示,在此,也将进行数据和模型的训练准确度显示,以保证用户能够掌握人工智能真实的性能。Through this process to complete the construction of artificial intelligence applications, and iterative training of parameters. The information related to the iterative training process, such as the number of iterations and the related iterative training results, will be displayed through the operation result display area 870, where the accuracy of the data and model training will also be displayed to ensure that the user can master artificial intelligence Real performance.
用户所搭建能够实现视频动作视频的人工智能应用,可通过不断进行的组块拖拽而尝试不同的人工智能算法构型,以从中找到可用的人工智能算法构型。The artificial intelligence application built by the user that can realize the video action video can try different artificial intelligence algorithm configurations through continuous block dragging to find available artificial intelligence algorithm configurations.
例如,可从操作组件选取栏810将卷积神经网络操作对应组块拖拽至操作界面,一构建第一层卷积神经网络,图19是根据一示例性实施例示出的一卷积神经网络操作所对应组块在操作界面上的示意图,组块I表示输入,组块Dense表示深度学习神经网络中的卷积神经网络操作,组块O表示输出,在此基础之上,再向操作界面拖拽两个对应于卷积神经网络操作的组块,构建三层卷积神经网络,以此来实现所搭建人工智能应用中的卷积特征提取,图20是根据图19对应实施例示出的三层卷积神经网络在操作界面上的组块分布以及链接示意图。For example, you can drag the corresponding block of the convolutional neural network operation from the operation component selection bar 810 to the operation interface to construct a first layer of convolutional neural network. FIG. 19 is a convolutional neural network according to an exemplary embodiment. Schematic diagram of the block corresponding to the operation on the operation interface. Block I represents the input, block Dense represents the operation of the convolutional neural network in the deep learning neural network, and block O represents the output. On this basis, then to the operation interface Drag two blocks corresponding to the operation of the convolutional neural network to construct a three-layer convolutional neural network to achieve the extraction of convolutional features in the built artificial intelligence application. FIG. 20 is shown according to the corresponding embodiment of FIG. 19 Schematic diagram of block distribution and links on the operation interface of the three-layer convolutional neural network.
通过用户终端与服务端之间的交互,用户可不断尝试进行人工智能应用的搭建,并且不断验证效果,操作简单且成本低。Through the interaction between the user terminal and the server, users can continuously try to build artificial intelligence applications, and constantly verify the effect, simple operation and low cost.
通过本发明的实现,帮助用户快捷地实现自身所需要的人工智能应用,且能够在需要的时候随意调用。Through the implementation of the present invention, it helps users quickly realize the artificial intelligence applications they need, and can call them at will when needed.
对于一个人工智能所相关知识零基础的人而言,要实现一个人工智能应用的自主开发,所经历的过程大致是:首先完整地学习代码知识,具备一定的代码开发能力,然后完整地学习人工智能专业知识,最后,需要作为一个开发者根据当前具体的需要,选择合适的编程语言在编译器中进行算法开发,此过程所需要耗费的时间周期至少在7年以上。For a person with zero basic knowledge related to artificial intelligence, to realize the independent development of an artificial intelligence application, the process is roughly as follows: first, learn the code knowledge completely, have a certain code development ability, and then learn the manual Intelligent expertise, in the end, as a developer, according to the current specific needs, choose the appropriate programming language to carry out algorithm development in the compiler, the time period required for this process is at least 7 years.
应当理解的,代码知识、机器学习所相关的深度学习算法以及数学表示、人工智能的整体知识等,很难普及大众,并且代码的学习门槛也是大众所难以逾越的。It should be understood that code knowledge, deep learning algorithms related to machine learning, mathematical representation, and overall knowledge of artificial intelligence are difficult to popularize, and the code learning threshold is also insurmountable by the public.
而为了克服上述所指的诸多困难,通过本发明的实现开发,首先对于大众而言,提供了用户友好的界面,并对通过组块,以及数学基元的形式封装诸多技术细节,实现标准化的人工智能模型搭建流程,从而真正帮助大众使用人工智能技术。In order to overcome many of the difficulties mentioned above, the implementation and development of the present invention first provides a user-friendly interface for the public, and encapsulates many technical details in the form of blocks and mathematical primitives to achieve standardized Artificial intelligence model building process, so as to really help the public to use artificial intelligence technology.
人工智能算法不同于类似于儿童编程所涉及的简单算法逻辑,其是一种复杂的自然表达,是难以借助于图形用户编程来实现。The artificial intelligence algorithm is different from the simple algorithm logic similar to that involved in children's programming. It is a complex natural expression and is difficult to implement with the help of graphical user programming.
而本发明,通过数学基元实现代码封装,以此来实现所需要的数学操作,并且在图形界面上定义图形组块来表示。In the present invention, code encapsulation is implemented through mathematical primitives to achieve the required mathematical operations, and graphical blocks are defined on the graphical interface to represent them.
图21是根据一示例性实施例示出的本发明所涉及前端与后端之间的交互示意图。在此示例性实施例中,用户侧所实现的是一网站图形界面,也就是说,对于用户而言,将通过一网络应用来实现所需要的人工智能应用搭,仅需要获知后台所对应的访问地址即可通过浏览器实现网络应用的运行。Fig. 21 is a schematic diagram of interaction between a front end and a back end involved in the present invention according to an exemplary embodiment. In this exemplary embodiment, the user side implements a website graphical interface, that is to say, for the user, the artificial intelligence application needed to be implemented through a web application only needs to know the corresponding background Visit the address to run the web application through the browser.
当然也并不限于此,也可通过发布终端程序等诸多方式实现。Of course, it is not limited to this, and it can also be implemented by issuing terminal programs and many other methods.
如图21所示的,通过用户在网站图形界面的操控,后台的服务器将按照用户所配置的组块,即图形转换为代码,以此来获得搭建的人工智能应用,并借助于服务器所提供的云计算能力向用户返回结果,或者人工智能算法构型图。在网站图形界面上,用户以图论的数学语言表示构建AI(Artificial Intelligence,人工智能)算法,即前述所指的数学基元,其所涉及的算法信息存储于JavaScript语言实现的字典中。一方面,用户在网站图形界面上选择对算法进行训练,在此之后,即可将字典以JSON字符串的形式提交到后台的服务器,服务器在接收到该JSON字符串后,将其从输出端到输入端解码为可运行的AI代码语言,服务器将依据AI代码语言完成训练,并将结果返回网站图形界面,并显示。As shown in Figure 21, through the user's manipulation on the website's graphical interface, the back-end server will convert the graphics into code according to the user-configured block, that is, to obtain the built artificial intelligence application, and rely on the server to provide Cloud computing capabilities return results to users, or artificial intelligence algorithm configuration diagrams. On the graphical interface of the website, the user constructs an AI (Artificial Intelligence) algorithm in the mathematical language of graph theory, that is, the mathematical primitive referred to above, and the algorithm information involved is stored in a dictionary implemented in JavaScript language. On the one hand, the user chooses to train the algorithm on the graphical interface of the website. After that, the dictionary can be submitted to the server in the background in the form of a JSON string. After receiving the JSON string, the server sends it to the output end When the input terminal is decoded into a runnable AI code language, the server will complete the training according to the AI code language and return the results to the website graphical interface and display it.
应当说明的是,数学基元是对应于数学操作的,此数学操作可包括加法、减法、乘法、除法等基本数学操作(BMO,Basic Mathematical Operations),还包括各种复杂的数学操作,例如,神经网络操作等、数学基元在图论上的数学语言表达,是用来表达数学操作的一种DAG结构,亦称之为MNG(Mathematical Network Graph)。DAG(Directed Acyclic Graph)结构,用于描述以节点的形式代表表达式应用逻辑。It should be noted that mathematical primitives correspond to mathematical operations, which can include basic mathematical operations (BMO, Basic, Mathematical Operations) such as addition, subtraction, multiplication, and division, as well as various complex mathematical operations, such as, The mathematical language expression of mathematical primitives in graph theory, such as neural network operations, is a DAG structure used to express mathematical operations, also known as MNG (Mathematical Network Graph). DAG (Directed Acyclic Graph) structure is used to describe application logic that represents expressions in the form of nodes.
图22示出了一示例性实施例中本发明整体方案的实现示意图。在一个示例性实施例中,如图22所示的,对于用户所自主开发的人工智能应用而言,其包括四大阶段,即:构建期、发送图阶段、翻译词典为MNG阶段以及并回送结果阶段。22 shows a schematic diagram of the implementation of the overall solution of the present invention in an exemplary embodiment. In an exemplary embodiment, as shown in FIG. 22, for an artificial intelligence application independently developed by a user, it includes four major stages, namely: a construction stage, a stage for sending pictures, a stage for translating a dictionary to MNG, and a loopback Results stage.
构建期即为用户对所需要的人工智能应用进行搭建的阶段,在此阶段,用户通过组块可进行人工智能算法以及新的MNG图块的构建,无论是人工智能算法的构建还是新的MNG图块的构建,其所对应的数学基元索引以及核心参数都被标记并存储在字典中。The construction period is the stage for the user to build the required artificial intelligence application. At this stage, the user can build the artificial intelligence algorithm and the new MNG block through the block, whether it is the artificial intelligence algorithm or the new MNG. The construction of tiles, their corresponding mathematical primitive indexes and core parameters are marked and stored in the dictionary.
由构建期进行发送图阶段。发送图阶段是为所构建的人工智能算法或者新的MNG图块发送字典的阶段,而之所以称之为发送图阶段,是指字典所对应的人工智能算法或者MNG图块,在都是对应于一网络拓扑图的。The phase of sending the diagram is carried out by the construction period. The send map stage is the stage where the dictionary is sent for the constructed artificial intelligence algorithm or new MNG block. The reason why it is called the send map stage refers to the artificial intelligence algorithm or MNG block corresponding to the dictionary. In a network topology diagram.
在发送图阶段实现了服务器所接收字符串的类型转换,以消除字符串并解码转换回字典。In the stage of sending pictures, the type conversion of the character string received by the server is realized to eliminate the character string and decode and convert it back to the dictionary.
由发送图阶段便进入了翻译词典为MNG阶段,在此阶段上,服务器将进行MNG,即数学基元的识别,以通过DAG结构来生成代码,获得可执行的AI代码语言,从而进行训练并返回结果。From the stage of sending the picture, the translation dictionary is entered into the MNG stage. At this stage, the server will identify the MNG, that is, the mathematical primitive, to generate code through the DAG structure, obtain the executable AI code language, and train and Return the result.
训练的AI代码语言即可用于对数据实现决策。对数据实现决策阶段,仍然是运行并回送结果。在此过程中,服务器完成了人工智能应用的方法构建之后,即获得AI代码语言,此时,将识别模型并检查其是否已经被训练,如果已被训练并包含要运行的数据,则用该数据运行AI代码语言,并返回结果。The trained AI code language can be used to make decisions on the data. The decision-making phase for data is still running and returning results. In this process, after the server completes the construction of the artificial intelligence application method, it obtains the AI code language. At this time, it will recognize the model and check whether it has been trained. If it has been trained and contains the data to be run, use this The data runs AI code language and returns the result.
可选的,在对数据实现决策之前,还将通过向用户展示人工智能算法构型图的方式,确认其是用户想要的,在此基础之上方可运行以前训练过的AI代码语言。Optionally, before the decision is made on the data, it will also be confirmed to the user by showing the artificial intelligence algorithm configuration diagram to the user, and the previously trained AI code language can be run on top of this basis.
此人工智能算法构型图,在用户搭建人工智能应用之时,便已经通过组块所构建得到。所获得AI代码的过程就是从人工智能算法构型图中提取重要信息并解析为代码的过程,以此来进行封装,即封装为每一数据基元,实现了net-to-gate,即由网络结构至单一的数学操作。至此,可以理解的,任何的数学操作或数学方程都是BMO的复合体,BMO链接在一起就形成了一种DAG结构,将此表达为MNG。每一个MNG都有着各自的输入和输出,并且不同MNG之间的输入和输出可相互链接,形成完整的逻辑网络,因此,可借助于此而作为组块和代码之间的等价过渡形式,以此来将组块所对应的信息准确传递给代码,实现图形界面与文本编程语言的转换。This artificial intelligence algorithm configuration diagram has been constructed by building blocks when users build artificial intelligence applications. The process of obtaining the AI code is the process of extracting important information from the artificial intelligence algorithm configuration diagram and parsing it into code, which is used to encapsulate, that is, encapsulate for each data primitive, and realize net-to-gate, that is, by Network structure to a single mathematical operation. So far, it can be understood that any mathematical operation or mathematical equation is a complex of BMO. BMOs are linked together to form a DAG structure, which is expressed as MNG. Each MNG has its own input and output, and the input and output between different MNGs can be linked to each other to form a complete logical network. Therefore, it can be used as an equivalent transition between block and code. In this way, the information corresponding to the block is accurately transferred to the code, and the conversion between the graphical interface and the text programming language is realized.
应当理解的,每个数学基元都是在一开始就实现的,同时,他们也是用户操控的基础,用户通过组块而构建的网络结构将像之前一样转换成字典。然后将字典转换成DAG格式并进行解析。然后,网络结构变成一个数学基元,然后作为一个新的数学基元添加到服务器。新形成的数学基元可以和其他基元一样用作构建其他网络。随着这个循环的重复,可以在不增加图形基础程序设计语言开发难度的情况下开发更复杂的算法。It should be understood that each mathematical primitive is realized at the beginning, and at the same time, they are also the basis for user control. The network structure built by users through blocks will be converted into a dictionary as before. Then convert the dictionary to DAG format and parse it. Then, the network structure becomes a mathematical primitive, which is then added to the server as a new mathematical primitive. The newly formed mathematical primitives can be used as other primitives to construct other networks. As this cycle repeats, more complex algorithms can be developed without increasing the difficulty of developing graphics-based programming languages.
下述为本发明装置实施例,用于执行本发明上述人工智能应用的搭建装置实施例。对于本发明装置实施例中未披露的细节,请参照本发明人工智能应用的搭建方法实施例。The following is a device embodiment of the present invention, which is an embodiment of a building device for executing the above artificial intelligence application of the present invention. For details not disclosed in the device embodiment of the present invention, please refer to the embodiment of the method for building an artificial intelligence application of the present invention.
图23是根据一示例性实施例示出的一种人工智能应用的搭建装置的框图。在一个示例性实施例中,如图23所示,该人工智能应用的搭建装置包括但不限于:指令接收模块1010、构造模块1030、转换模块1050以及解码发起模块1070。Fig. 23 is a block diagram of a device for building an artificial intelligence application according to an exemplary embodiment. In an exemplary embodiment, as shown in FIG. 23, the artificial intelligence application building device includes but is not limited to: an instruction receiving module 1010, a construction module 1030, a conversion module 1050, and a decoding initiation module 1070.
指令接收模块1010,用于接收对图形界面上组块的选取指令,所述组块是所对应数学基元的图形表示。The instruction receiving module 1010 is configured to receive an instruction for selecting a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive.
构造模块1030,用于通过所述选取指令在所述图形界面的搭建区为人工智能应用的搭建配置组块,且将组块之间相互链接形成用户操控下所搭建人工智能应用的人工智能算 法构型。 Constructing module 1030, configured to configure blocks for building artificial intelligence applications in the building area of the graphical interface through the selection instruction, and link the blocks to form an artificial intelligence algorithm for artificial intelligence applications built under user control structure.
转换模块1050,用于根据所述人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数学基元标识以及核心参数构成的字典,所述核心参数是对应于所述组块配置的。The conversion module 1050 is configured to convert the included chunks into a dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters, the core parameters corresponding to the group Block configuration.
解码发起模块1070,用于通过所述字典向服务端发起用户所搭建人工智能应用的解码,触发所述人工智能应用在服务端运行。The decoding initiation module 1070 is used to initiate decoding of the artificial intelligence application built by the user to the server through the dictionary, and trigger the artificial intelligence application to run on the server.
图24是根据一示例性实施例示出的一种人工智能应用搭建中的运行实现装置的框图。在一个示例性实施例中,如图24所示的,该人工和智能应用搭建中的运行实现装置,包括但不限于:字符接收模块1110、解码模块1130以及执行模块1150。Fig. 24 is a block diagram of a device for implementing operation in building an artificial intelligence application according to an exemplary embodiment. In an exemplary embodiment, as shown in FIG. 24, the operation implementation device in the manual and intelligent application building includes, but is not limited to: a character receiving module 1110, a decoding module 1130, and an execution module 1150.
字符接收模块1110,用于用户选择进行的人工智能应用搭建中,服务端接收字典所对应字符串,所述字符串对应的字典用于描述为所述人工智能应用搭建所配置的组块。The character receiving module 1110 is used for building an artificial intelligence application selected by the user, and the server receives a character string corresponding to a dictionary, and the dictionary corresponding to the character string is used to describe a block configured for building the artificial intelligence application.
解码模块1130,用于解码所述字符串获得所述人工智能应用的可执行文本。The decoding module 1130 is configured to decode the character string to obtain the executable text of the artificial intelligence application.
执行模块1150,用于通过所述可执行文本的执行,使用户选择搭建的所述人工智能应用运行于所述服务端。The execution module 1150 is configured to enable the artificial intelligence application selected by the user to run on the server through execution of the executable text.
可选的,本发明还提供一种电子设备,该电子设备可以用于图1所示实施环境中,执行图3至图17任一所示的方法的全部或者部分步骤。所述装置包括:处理器;用于存储处理器可执行指令的存储器;Optionally, the present invention also provides an electronic device, which can be used in the implementation environment shown in FIG. 1 to perform all or part of the steps of any of the methods shown in FIGS. 3 to 17. The device includes: a processor; a memory for storing processor executable instructions;
其中,所述处理器被配置为执行实现前述所指的方法。Wherein, the processor is configured to perform the method mentioned above.
该实施例中的装置的处理器执行操作的具体方式已经在有关前述实施例中执行了详细描述,此处将不做详细阐述说明。The specific manner in which the processor of the device in this embodiment performs operations has been described in detail in the foregoing embodiments, and will not be described in detail here.
在示例性实施例中,还提供了一种存储介质,该存储介质为计算机可读存储介质,例如可以为包括指令的临时性和非临时性计算机可读存储介质。该存储介质例如包括指令的存储器204,上述指令可由装置200的处理器218执行以完成上述方法。In an exemplary embodiment, a storage medium is also provided. The storage medium is a computer-readable storage medium, for example, it may be a temporary and non-transitory computer-readable storage medium including instructions. The storage medium includes, for example, a memory 204 of instructions that can be executed by the processor 218 of the device 200 to complete the above method.
应当理解的是,本发明并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围执行各种修改和改变。本发明的范围仅由所附的权利要求来限制。It should be understood that the present invention is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be performed without departing from the scope thereof. The scope of the invention is only limited by the appended claims.

Claims (15)

  1. 一种人工智能应用的搭建方法,其特征在于,所述方法包括:An artificial intelligence application building method, characterized in that the method includes:
    接收对图形界面上组块的选取指令,所述组块是所对应数学基元的图形表示;Receiving a selection instruction for a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive;
    通过所述选取指令在所述图形界面的搭建区为人工智能应用的搭建配置组块,且将组块之间相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型;Configuring the building blocks of the artificial intelligence application in the building area of the graphical interface through the selection instruction, and linking the blocks to each other to form the artificial intelligence algorithm configuration of the artificial intelligence application built under user control;
    根据所述人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数学基元标识以及核心参数构成的字典,所述核心参数是对应于所述组块配置的;Convert the included chunks into a dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identifier corresponding to the chunk and the core parameters, the core parameters corresponding to the chunk configuration;
    通过所述字典向服务端发起用户所搭建人工智能应用的解码,触发所述人工智能应用在服务端运行。Initiating decoding of the artificial intelligence application built by the user to the server through the dictionary, triggering the artificial intelligence application to run on the server.
  2. 根据权利要求1所述的方法,其特征在于,所述接收对图形界面上组块的用户选择指令,包括:The method of claim 1, wherein the receiving a user selection instruction for a block on a graphical interface includes:
    在所述图形界面初始化配置的若干组块中,通过施加于所述组块上的用户操作接收得到对所述图形界面上组块的选取指令,直至实现所述人工智能应用的组块被全部选取。Among the blocks configured in the initial configuration of the graphical interface, the user's operation applied to the block receives a selection instruction for the block on the graphical interface until the blocks implementing the artificial intelligence application are all Select.
  3. 根据权利要求1所述的方法,其特征在于,所述通过所述用户选择指令在所述图形界面的搭建区为人工智能应用的搭建配置组块,且将组块之间相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型,包括:The method according to claim 1, wherein the configuration block for the artificial intelligence application is configured in the construction area of the graphical interface by the user selection instruction, and the blocks are linked to each other to form a user control The artificial intelligence algorithm configuration of artificial intelligence applications built below includes:
    配置所述选取指令指示的组块于所述图形界面的搭建区;Configuring the block indicated by the selection instruction in the construction area of the graphical interface;
    对置于所述搭建区的组块获取所对应的核心参数;Obtain the corresponding core parameters for the blocks placed in the construction area;
    随着所述搭建区中两个以上组块的配置,进行所述组块之间的相互链接形成所述用户操控下所搭建人工智能应用的人工智能算法构型。With the configuration of more than two blocks in the building area, interconnecting the blocks to form an artificial intelligence algorithm configuration for artificial intelligence applications built under the control of the user.
  4. 根据权利要求3所述的方法,其特征在于,所述对置于所述搭建区的组块获取所对应的核心参数,包括:The method according to claim 3, wherein the acquiring the corresponding core parameters of the blocks placed in the building area includes:
    为所述图形界面搭建区所选定的组块,根据用户对所述组块进行的核心参数配置,获取得到所述组块对应的核心参数。The block selected for the graphical interface building area is obtained according to the core parameter configuration of the block by the user to obtain the core parameter corresponding to the block.
  5. 根据权利要求1所述的方法,其特征在于,所述根据所述人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数据基元标识以及核心参数构成的字典,包括:The method according to claim 1, wherein the conversion of the included chunks into a dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of data primitive identifiers and core parameters corresponding to the chunks includes :
    对所述人工智能算法构型中包含的组块,获取组块所对应数学基元标识以及核心参数;For the blocks included in the configuration of the artificial intelligence algorithm, obtain the mathematical primitive identification and core parameters corresponding to the blocks;
    以所述数学基元标识为索引项,所述核心参数为索引值构建所述人工智能应用的字典。Using the mathematical primitive identifier as an index item and the core parameter as an index value, construct a dictionary of the artificial intelligence application.
  6. 根据权利要求1所述的方法,其特征在于,所述通过所述字典向服务端发起用户所搭建人工智能应用的解码,触发所述人工智能应用在服务端运行,包括:The method according to claim 1, wherein the initiating decoding of the artificial intelligence application built by the user to the server through the dictionary to trigger the artificial intelligence application to run on the server includes:
    对所述字典中数学基元标识以及索引的核心参数进行字符串转换;Perform character string conversion on the mathematical primitive identification and index core parameters in the dictionary;
    为用户所构建的人工智能应用向所述服务端传输所述字符串,通过所述字符串的传输发起所述服务端对所述字符串的解码获得所述人工智能应用的可执行文本,以运行于所述服务端。The artificial intelligence application built for the user transmits the character string to the server, and initiates decoding of the character string by the server through the transmission of the character string to obtain the executable text of the artificial intelligence application, to Run on the server.
  7. 一种人工智能应用搭建中的运行实现方法,其特征在于,所述方法包括:An operation implementation method in the construction of artificial intelligence applications, characterized in that the method includes:
    用户选择进行的人工智能应用搭建中,服务端接收字典所对应字符串,所述字符串对应的字典用于描述为所述人工智能应用搭建所配置的组块;In the construction of the artificial intelligence application selected by the user, the server receives the character string corresponding to the dictionary, and the dictionary corresponding to the character string is used to describe the block configured for the construction of the artificial intelligence application;
    解码所述字符串获得所述人工智能应用的可执行文本;Decoding the character string to obtain the executable text of the artificial intelligence application;
    通过所述可执行文本的执行,使用户选择搭建的所述人工智能应用运行于所述服务端。Through the execution of the executable text, the artificial intelligence application that the user chooses to build runs on the server.
  8. 根据权利要求7所述的方法,其特征在于,所述解码所述字符串获得所述人工智能应用的可执行文本,包括:The method according to claim 7, wherein the decoding of the character string to obtain executable text of the artificial intelligence application includes:
    将所述字符串解码转换为字典,所述字典包含了为人工智能应用所配置组块对应的数学基元标识以及核心参数;Decode the character string into a dictionary, the dictionary contains the mathematical primitive identification and core parameters corresponding to the blocks configured for artificial intelligence applications;
    通过所述字典中包含的数学基元标识以及核心参数重建执行所对应数学操作的代码信息,获得所述人工智能应用的可执行文本。The executable text of the artificial intelligence application is obtained through the mathematical primitive identifier contained in the dictionary and the core parameter to reconstruct the code information for performing the corresponding mathematical operation.
  9. 根据权利要求8所述的方法,其特征在于,所述通过所述字典中包含的数学基元标识以及核心参数重建执行所对应数学操作的代码信息,获得所述人工智能应用的可执行文本,包括:The method according to claim 8, wherein the code information of the mathematical operation corresponding to the reconstruction and execution of the mathematical operation corresponding to the mathematical primitive identifier and the core parameters contained in the dictionary are obtained to obtain the executable text of the artificial intelligence application, include:
    根据所述字典中的数学基元标识获得所对应数学操作的数据缺失代码;Obtaining the data missing code of the corresponding mathematical operation according to the mathematical primitive identification in the dictionary;
    将所述数学基元标识对应的核心参数填充至获得的所述数据缺失代码,得到执行所对应数学操作的代码信息;Filling the core parameters corresponding to the mathematical primitive identifier into the obtained data missing code to obtain code information for performing the corresponding mathematical operation;
    根据所述数学基元标识所对应核心参数中指示的输入维度和输出维度,对所述代码信息从输出到输入顺次通过图论的数学语言表示重构所述人工智能应用的可执行文本。According to the input dimension and the output dimension indicated in the core parameter corresponding to the mathematical primitive identification, the executable text of the artificial intelligence application is reconstructed from the output of the code information to the input through the mathematical language representation of graph theory.
  10. 根据权利要求7所述的方法,其特征在于,所述通过所述可执行文本的执行,使用户选择搭建的所述人工智能应用运行于所述服务端,包括:The method according to claim 7, wherein the execution of the executable text to enable the artificial intelligence application selected by the user to run on the server includes:
    在训练模式下,获取适用于所述人工智能应用的样本数据,所述训练模式是在图形界面被用户所选择的模式;In the training mode, obtaining sample data suitable for the artificial intelligence application, the training mode is a mode selected by a user on a graphical interface;
    通过所述可执行文本的执行在所述服务端运行所述人工智能应用,在所述人工智能应用的运行中通过所述样本数据进行参数的训练。Run the artificial intelligence application on the server side through execution of the executable text, and perform parameter training through the sample data during the operation of the artificial intelligence application.
  11. 根据权利要求17所述的方法,其特征在于,所述通过所述可执行文本的执行,使用户选择搭建的所述人工智能应用运行于服务端,包括:The method according to claim 17, wherein the execution of the executable text to enable the artificial intelligence application selected by the user to run on the server includes:
    获取用户选择输入的数据,所述数据包括用户所搭建人工智能应用处理的目标数据;Obtain data selected by the user, including the target data processed by the artificial intelligence application built by the user;
    通过执行完成参数训练的所述可执行文件,在决策模式下运行训练的所述人工智能应用完成用户选择输入数据的处理。By executing the executable file that completes the parameter training, running the trained artificial intelligence application in a decision mode completes the processing of user-selected input data.
  12. 根据权利要求11所述的方法,其特征在于,所述获取用户选择输入的数据,包括:The method according to claim 11, wherein the acquiring the data selected by the user includes:
    接收用户在所述图形界面向自身所搭建人工智能应用上传的数据;Receiving data uploaded by the user to the artificial intelligence application built by himself on the graphical interface;
    根据所述数据中携带的用户标识确定所述用户搭建的人工智能应用;Determine the artificial intelligence application built by the user according to the user identifier carried in the data;
    对所述数据中请求自身所搭建人工智能应用处理的目标数据触发运行确定的所述人工智能应用。The target data requested by the artificial intelligence application built by itself to be processed in the data is triggered to run the determined artificial intelligence application.
  13. 一种人工智能应用的搭建装置,其特征在于,包括:An artificial intelligence application building device, which is characterized by including:
    指令接收模块,用于接收对图形界面上组块的选取指令,所述组块是所对应数学基元的图形表示。The instruction receiving module is used to receive a selection instruction of a block on the graphical interface, the block is a graphical representation of the corresponding mathematical primitive.
    构造模块,用于通过所述用户选取指令在所述图形界面的搭建区为人工智能应用的搭建配置组块,且将组块之间相互链接形成用户操控下所搭建人工智能应用的人工智能算法构型。Construction module, configured to configure blocks for building artificial intelligence applications in the building area of the graphical interface through the user selection instruction, and link the blocks to form an artificial intelligence algorithm for artificial intelligence applications built under user control structure.
    转换模块,用于根据所述人工智能算法构型进行所包含组块向字典的转换,获得组块所对应数学基元标识以及核心参数构成的字典,所述核心参数是对应于所述组块配置的。The conversion module is used to convert the included chunks to the dictionary according to the configuration of the artificial intelligence algorithm to obtain a dictionary composed of the mathematical primitive identification corresponding to the chunk and the core parameters, the core parameters corresponding to the chunks Configured.
    解码发起模块,用于通过所述字典向服务端发起用户所搭建人工智能应用的解码,触发所述人工智能应用在服务端运行。The decoding initiation module is used to initiate decoding of the artificial intelligence application built by the user to the server through the dictionary, and trigger the artificial intelligence application to run on the server.
  14. 一种人工和智能应用搭建中的运行实现装置,其特征在于,包括:An operation realization device in the construction of manual and intelligent applications, which is characterized by comprising:
    字符接收模块,用于用户选择进行的人工智能应用搭建中,服务端接收字典所对应字符串,所述字符串对应的字典用于描述为所述人工智能应用搭建所配置的组块。The character receiving module is used for building an artificial intelligence application selected by the user, and the server receives a character string corresponding to a dictionary, and the dictionary corresponding to the character string is used to describe a block configured for building the artificial intelligence application.
    解码模块,用于解码所述字符串获得所述人工智能应用的可执行文本。The decoding module is used for decoding the character string to obtain the executable text of the artificial intelligence application.
    执行模块,用于通过所述可执行文本的执行,使用户选择搭建的所述人工智能应用运行于所述服务端。An execution module is configured to enable the artificial intelligence application selected by the user to run on the server through execution of the executable text.
  15. 一种机器设备,其特征在于,包括:A machine equipment, characterized in that it includes:
    处理器;以及Processor; and
    存储器,所述存储器上存储有计算机可读指令,所述计算机可读指令被所述处理器执行时实现根据权利要求1至10中任一项所述的方法。A memory, on which computer readable instructions are stored, which when executed by the processor implements the method according to any one of claims 1 to 10.
PCT/CN2018/125255 2018-12-29 2018-12-29 Methods and apparatuses for artificial intelligence application building and operational implementation, and machine device WO2020133324A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/125255 WO2020133324A1 (en) 2018-12-29 2018-12-29 Methods and apparatuses for artificial intelligence application building and operational implementation, and machine device
CN201880002692.XA CN111819536A (en) 2018-12-29 2018-12-29 Method, device and machine equipment for realizing construction and operation of artificial intelligence application

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/125255 WO2020133324A1 (en) 2018-12-29 2018-12-29 Methods and apparatuses for artificial intelligence application building and operational implementation, and machine device

Publications (1)

Publication Number Publication Date
WO2020133324A1 true WO2020133324A1 (en) 2020-07-02

Family

ID=71127389

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/125255 WO2020133324A1 (en) 2018-12-29 2018-12-29 Methods and apparatuses for artificial intelligence application building and operational implementation, and machine device

Country Status (2)

Country Link
CN (1) CN111819536A (en)
WO (1) WO2020133324A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074107B1 (en) 2020-11-04 2021-07-27 RazorThink, Inc. Data processing system and method for managing AI solutions development lifecycle

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101110021A (en) * 2002-03-25 2008-01-23 数据质量解决公司 Method for visually programming instruction set for process
US20160140452A1 (en) * 2014-11-17 2016-05-19 Optimitive S.L.U. Methods and systems using a composition of autonomous self-learning software components for performing complex real time data-processing tasks
CN107861721A (en) * 2017-11-03 2018-03-30 上海宽全智能科技有限公司 Reverse graphical intelligence programming method and apparatus, equipment and storage medium
CN108898229A (en) * 2018-06-26 2018-11-27 第四范式(北京)技术有限公司 For constructing the method and system of machine learning modeling process

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106959851A (en) * 2017-03-03 2017-07-18 同济大学 A kind of Modular programmable distributed interactive system towards artificial intelligence study
CN108737324B (en) * 2017-04-13 2021-03-02 腾讯科技(深圳)有限公司 Method and device for generating artificial intelligence service assembly and related equipment and system
CN107807814B (en) * 2017-09-27 2021-10-26 百度在线网络技术(北京)有限公司 Application component construction method, device, equipment and computer readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101110021A (en) * 2002-03-25 2008-01-23 数据质量解决公司 Method for visually programming instruction set for process
US20160140452A1 (en) * 2014-11-17 2016-05-19 Optimitive S.L.U. Methods and systems using a composition of autonomous self-learning software components for performing complex real time data-processing tasks
CN107861721A (en) * 2017-11-03 2018-03-30 上海宽全智能科技有限公司 Reverse graphical intelligence programming method and apparatus, equipment and storage medium
CN108898229A (en) * 2018-06-26 2018-11-27 第四范式(北京)技术有限公司 For constructing the method and system of machine learning modeling process

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074107B1 (en) 2020-11-04 2021-07-27 RazorThink, Inc. Data processing system and method for managing AI solutions development lifecycle

Also Published As

Publication number Publication date
CN111819536A (en) 2020-10-23

Similar Documents

Publication Publication Date Title
CN107632987B (en) A kind of dialogue generation method and device
JP7208952B2 (en) Method and apparatus for generating interaction models
US20200175416A1 (en) Methods for sharing machine learning based web service models
US20180307978A1 (en) Multi-Modal Construction of Deep Learning Networks
US10515119B2 (en) Sequential recommender system for virtualized network services
CN110023963A (en) Use Processing with Neural Network text sequence
CN105593844B (en) Infrastructure is customized when operation
JP2023539532A (en) Text classification model training method, text classification method, device, equipment, storage medium and computer program
US11195098B2 (en) Method for generating neural network and electronic device
CN109918607A (en) Page building method and device, medium and calculating equipment
KR20150143473A (en) Signal capture controls in recalculation user interface
JP2020520504A (en) Deep Adaptive Semantic Logic Network
CN108351796A (en) Unified interface specification for interacting and executing model with model in various runtime environments
US11900263B2 (en) Augmenting neural networks
US20190080232A1 (en) Deep neural network perforance analysis on shared memory accelerator systems
US20220147323A1 (en) System and method for using a graphical user interface to develop a virtual programmable logic controller
US20210343051A1 (en) Generating procedural materials from digital images
CN109725980A (en) Generate method, equipment and the computer-readable medium of mirror image label
EP2748711A1 (en) Data infrastructure for providing interconnectivity between platforms, devices, and operating systems
US20230206420A1 (en) Method for detecting defect and method for training model
CN110162766A (en) Term vector update method and device
CN106371931B (en) A kind of high-performance geoscience computing service system based on Web frame
WO2020133324A1 (en) Methods and apparatuses for artificial intelligence application building and operational implementation, and machine device
Gore et al. Django: Web development simple & fast
CN114237582A (en) Project construction method, device, medium and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18944659

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18944659

Country of ref document: EP

Kind code of ref document: A1