CN114547382A

CN114547382A - Panorama checking method, device, equipment and storage medium

Info

Publication number: CN114547382A
Application number: CN202210152984.XA
Authority: CN
Inventors: 杨凯; 吴立威; 李韡; 徐子豪; 高原
Original assignee: Shenzhen Sensetime Technology Co Ltd
Current assignee: Shenzhen Sensetime Technology Co Ltd
Priority date: 2022-02-18
Filing date: 2022-02-18
Publication date: 2022-05-27

Abstract

The embodiment of the application discloses a method, a device, equipment and a storage medium for checking a panoramic image, wherein the method comprises the following steps: in response to receiving an instruction for saving a panoramic image created on a front-end interactive interface, checking connection logic in the panoramic image; saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification; in response to receiving an instruction for operating the panoramic image, acquiring the stored input-output relationship of an operation unit in the panoramic image; and checking whether the panoramic image is a directed acyclic image or not according to the input-output relationship of the operation unit in the panoramic image.

Description

Panorama checking method, device, equipment and storage medium

Technical Field

The application relates to the field of computer vision, in particular to a method, a device, equipment and a storage medium for checking a panoramic image.

Background

The panorama can meet the AI requirement of high-precision and complex computation flow in the AI industry landing by one-stop interactive computation flow/service flow panorama and the same-platform cooperation of industry experts and Artificial Intelligence (AI) algorithm experts, and by realizing the interconnection and intercommunication of multiple data sets, multiple training modules and multiple inference operators. The panorama is composed of data nodes (nodes) and Operation units (Operation, Op), and flows through a Directed Acyclic Graph (DAG).

When the directed acyclic graph is constructed, the connection relation between the data nodes and the operation units needs to be automatically checked, and the legality of the directed acyclic graph is ensured.

Disclosure of Invention

The embodiment of the application provides a method, a device, equipment, a storage medium and a program product for checking a panoramic image.

The technical scheme of the embodiment of the application is realized as follows:

in a first aspect, an embodiment of the present application provides a method for checking a panorama, including:

in response to receiving an instruction for saving a panoramic image created on a front-end interactive interface, checking connection logic in the panoramic image;

saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification;

in response to receiving an instruction for operating the panoramic image, acquiring the stored input-output relationship of an operation unit in the panoramic image;

and checking whether the panoramic image is a directed acyclic image or not according to the input-output relationship of the operation unit in the panoramic image.

In some possible embodiments, the method further comprises: in the process of creating the panoramic image on the front-end interactive interface, checking a basic connection rule between the operation units and the data nodes related to the corresponding operation units in the panoramic image; and under the condition that the basic connection rule passes the verification, finishing the creation of the panoramic image.

Therefore, whether the basic connection rule is correct or not is detected in real time in the process of creating the panoramic image, some basic error operations can be avoided, and a more perfect verification mode is established.

In some possible embodiments, the basic connection rule includes at least one of: repeated connection, input data nodes can not be connected with input data nodes, output data nodes can not be connected with output data nodes, the data nodes can only be connected with the operation unit, and the output data nodes of the operation unit can not be changed; the method further comprises the following steps: and under the condition that the basic connection rule is failed to verify, highlighting the wrong connection line and prompting a user of the reason of the error.

Therefore, when the basic connection rule check fails, the wrong connection is highlighted, and the user is prompted about the reason of the error, so that the cost of the user on the hand is reduced by giving an error operation prompt.

In some possible embodiments, the method further comprises: and automatically deleting the wrong connecting line after highlighting the wrong connecting line and spacing for a preset time.

In this way, by deleting wrong connecting lines at regular time, the connecting lines are not added for incorrect connection, and the correctness of the created panoramic image is ensured.

In some possible embodiments, the checking the connection logic in the panorama includes: checking whether the data node exists in the panoramic image or the operation unit is not connected; and/or checking whether the resource configuration information of the data nodes in the panoramic image is complete; and/or checking whether the connection relation between the data nodes and the operation units in the panoramic image is correct or not.

In this way, when clicking to save, the operation units or data nodes which are not connected in the panoramic image, the resource configuration information of the data nodes and the connection relation between the data nodes and the operation units are checked, so that the connection validity of the panoramic image is ensured.

In some possible implementations, the checking whether the resource configuration information of the data node in the panorama is complete includes: if the data node is an input node of the operation unit, checking whether the data node selects a resource and a resource version; and in the case that the data node is an output node of the operation unit, checking whether the data node selects a resource.

In this way, whether the reference resources of the input nodes and the output nodes of the operation units are complete or not is respectively checked, and the accuracy of the panoramic image in operation is ensured.

In some possible implementations, the method further includes: under the condition that the connection logic in the panoramic image is not verified, highlighting wrong data nodes or connecting lines in the panoramic image and prompting a user of a wrong reason; and in response to the fact that the wrong data nodes or connecting lines in the panoramic image are modified correctly, restoring the panoramic image.

Therefore, when the connection logic in the panoramic image fails to be checked, the error part is highlighted, and the error reason of the user is prompted at the same time, so that the user can modify the panoramic image conveniently, the cost of the user is reduced, and the accuracy of the operation of the directed acyclic image corresponding to the finally stored panoramic image is ensured.

In some possible implementations, the obtaining, in response to receiving an instruction to execute the panorama, the stored input-output relationship of the operation unit in the panorama includes: analyzing the stored data corresponding to the panoramic image in response to receiving an instruction for operating the panoramic image; and taking the connection relation between the operation units in the panoramic image as the input-output relation of the operation units based on the analysis result.

Therefore, when the panoramic image is clicked to operate, the rear end analyzes the data corresponding to the stored panoramic image and converts the connection relation between the operation units so as to judge whether the panoramic image is a directed acyclic image, the reasonable connection relation between the operation units is ensured, and the checking efficiency is improved.

In some possible implementations, the method further includes: running the panoramic image under the condition of checking that the panoramic image is a directed acyclic image; or prompting a user that the operation of the panoramic image fails under the condition that the panoramic image is not checked to be the directed acyclic image.

In this way, when the panorama is operated, whether the panorama is a directed acyclic graph is checked, and when the panorama passes the check, the panorama starts to operate; otherwise, the operation is stopped, the user is prompted about the reason of the failure, the error waiting time is reduced, and the rapid verification of the legality of the panoramic image is realized.

In a second aspect, an embodiment of the present application provides an apparatus for checking a panorama, where the apparatus includes a first checking module, a first saving module, an obtaining module, and a second checking module, where:

the first checking module is used for responding to a received instruction for storing the panoramic image created on the front-end interactive interface and checking the connection logic in the panoramic image;

the first saving module is used for saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification;

the acquisition module is used for responding to a received instruction for operating the panoramic image and acquiring the stored input and output relation of the operation unit in the panoramic image;

and the second checking module is used for checking whether the panorama is a directed acyclic graph or not according to the input-output relation of the operation unit in the panorama.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a memory and a processor, where the memory stores a computer program that is executable on the processor, and the processor implements the steps in the panorama verification method when executing the program.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the panorama verification method described above.

The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:

in the embodiment of the application, firstly, in response to receiving an instruction for storing a panoramic image created on a front-end interactive interface, connection logic in the panoramic image is verified; then saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification; responding to a received instruction for operating the panoramic image, and acquiring the stored input-output relationship of an operation unit in the panoramic image; finally, checking whether the panoramic image is a directed acyclic image or not according to the input-output relationship of an operation unit in the panoramic image; therefore, the connection logic in the panoramic image is verified through the front end in the storage stage, and the directed acyclic check is performed on the data corresponding to the stored panoramic image through the rear end in the operation stage, so that the rapid verification of the panoramic image is realized, and the accuracy of the directed acyclic operation corresponding to the panoramic image is ensured.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without inventive efforts, wherein:

fig. 1 is a schematic flowchart of a panorama verification method according to an embodiment of the present disclosure;

fig. 2A is a schematic flowchart of a panorama verification method according to an embodiment of the present disclosure;

fig. 2B is a schematic diagram of a basic connection rule checking error according to an embodiment of the present disclosure;

fig. 3A is a schematic flowchart of a panorama verification method according to an embodiment of the present disclosure;

FIG. 3B is a schematic diagram illustrating a connection logic checking error according to an embodiment of the present disclosure;

fig. 4 is a schematic flowchart of a panorama verification method according to an embodiment of the present application;

fig. 5A is a logic flow diagram of a panorama verification method according to an embodiment of the present disclosure;

fig. 5B is a verification flowchart in the process of creating a panorama according to the embodiment of the present application;

fig. 5C is a flowchart of verification in the process of saving a panorama according to the embodiment of the present application;

fig. 5D is a verification flowchart in the process of running the panorama according to the embodiment of the present application;

fig. 6 is a schematic structural diagram of a verification apparatus for a panoramic image provided in an embodiment of the present application;

fig. 7 is a hardware entity diagram of an electronic device according to an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

It should be noted that the terms "first \ second \ third" referred to in the embodiments of the present application are only used for distinguishing similar objects and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may be interchanged under predetermined orders or sequences where possible, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which embodiments of the present application belong. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

The scheme provided by the embodiment of the application relates to the technical field of deep learning, and for facilitating understanding of the scheme of the embodiment of the application, terms related to the related technology are briefly explained at first:

artificial Intelligence (AI) is a theory, method, technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and expand human Intelligence, perceive the environment, acquire knowledge and use the knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technique of computer science, attempting to understand the essence of intelligence and producing a new intelligent machine that can react in a manner similar to human intelligence. Artificial intelligence is the research of the design principle and the realization method of various intelligent machines, so that the machines have the functions of perception, reasoning and decision making.

The artificial intelligence technology is a comprehensive subject and relates to the field of extensive technology, namely the technology of a hardware level and the technology of a software level. The artificial intelligence infrastructure generally includes technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and the like. The embodiment of the application relates to a machine learning technology.

Machine Learning (ML) is a multi-domain cross discipline, and relates to a plurality of disciplines such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory and the like. The special research on how a computer simulates or realizes the learning behavior of human beings so as to acquire new knowledge or skills and reorganize the existing knowledge structure to continuously improve the performance of the computer. Machine learning is the core of artificial intelligence, is the fundamental approach for computers to have intelligence, and is applied to all fields of artificial intelligence. Machine learning and deep learning generally include techniques such as artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and formal education learning.

In recent years, deep learning models break through in the field of computer vision, performance indexes of various basic tasks greatly exceed those of traditional algorithms, and the problem that how to apply deep learning technology to a real scene brings value is very important.

The embodiment of the application provides a method for checking a panorama, which is applied to electronic equipment. An end-to-end visual model generation platform, an embedded object detection and image classification common artificial intelligence model general training framework in the visual field are deployed on the electronic equipment. The electronic devices include, but are not limited to, mobile phones, laptops, tablet computers and web-enabled devices, multimedia devices, streaming media devices, mobile internet devices, wearable devices, or other types of devices. The functions implemented by the method can be implemented by calling program code by a processor in an electronic device, and the program code can be stored in a computer storage medium. The processor may be configured to perform a process for generating distillation data, and the memory may be configured to store intermediate data required in generating distillation data and target distillation data generated.

Fig. 1 is a schematic flowchart of a panorama verification method provided in an embodiment of the present application, where as shown in fig. 1, the method at least includes the following steps:

step S110, in response to receiving an instruction for storing a panoramic image created on a front-end interactive interface, checking connection logic in the panoramic image;

here, when the front end clicks and saves the panorama, the validity of all the connection logics in the panorama is checked, and the accuracy of the subsequent operation of the panorama is ensured.

The panorama (Raw Graph) is a complete solution generated by an artificial intelligence model constructed on a canvas of a front-end interactive interface by a user, and comprises the functions of model training, evaluation, inference logic series connection and the like. The canvas is a layout block for constructing the whole process of model production by dragging different components by a user on the artificial intelligence training platform.

The panorama comprises at least two Operation units (OP) and a data node corresponding to each Operation unit. Each operation unit is a virtualized node after an algorithm module of a task to be processed is packaged; each data Node is a virtualized Node in which one data processing module of a task to be processed is encapsulated, and the data processing module provides input data for a certain algorithm module or processes output data of another algorithm module.

The task to be processed may be set by the user or may be obtained from the background. Exemplarily, if the task to be processed is a part defect identification task, an algorithm module required for realizing the task to be processed is realized, that is, the operation unit includes an operation unit for detecting an image and an operation unit for classifying the image; the corresponding data nodes are the specific data involved in the detection and classification process.

In some embodiments, the connection logic in the panoramic view includes the validity of the connection between the data nodes and the operation units in the panoramic view, for example, the classified data nodes can only connect the classified operation units, and for example, there should be no unconnected data nodes or operation units in the panoramic view; in other embodiments, the connection logic of the panorama includes whether the referenced resources of the data nodes in the panorama are complete, e.g., a data node must configure a resource and a resource version as an input node in the panorama.

Step S120, saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification;

here, checking whether the connection relationship between each operation unit and each data node in the panorama and the reference resource of the data node are complete to obtain a first checking result; and under the condition that the first verification result shows that the connection logic in the panoramic image passes verification, the panoramic image created on the front-end interactive interface is successfully stored.

Step S130, responding to the received instruction for operating the panoramic image, and acquiring the stored input-output relationship of the operation unit in the panoramic image;

here, the input-output relationship of the operation units in the panorama, that is, the connection relationship between the operation units.

Usually, the output of the previous operation unit in the panorama is the input of the next operation unit, and the last operation unit generates the processing result of the task to be processed. For example, at least an inspection operation unit and a classification operation unit are included in the panorama, wherein the input-output relationship of the operation units, i.e., the output of the detection operation unit, is used as the input of the classification operation unit.

And after the panorama is successfully stored, when the panorama is operated in response to the front end click, the back end performs conversion analysis on the stored data corresponding to the panorama, and acquires the connection relation between the operation units in the panorama according to all the connecting lines in the panorama.

And step S140, checking whether the panorama is a directed acyclic graph or not according to the input-output relation of the operation unit in the panorama.

Here, whether the corresponding panorama is a directed acyclic graph is checked through a topological algorithm according to the input-output relationship of the operation unit in the acquired panorama.

It should be noted that, when the panorama is a directed acyclic graph, it indicates that all the operation units in the panorama each complete a part of the entire task to be processed, and the constraint of a specific execution order is satisfied between the operation units, where the start of some operation units must be after the execution of other operation units is completed. In this way, it can be determined that the task composed of all the operation units can be smoothly performed in the effective time.

In the embodiment of the application, firstly, in response to receiving an instruction for storing a panoramic image created on a front-end interactive interface, connection logic in the panoramic image is checked; then saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification; responding to a received instruction for operating the panoramic image, and acquiring the stored input-output relationship of an operation unit in the panoramic image; finally, checking whether the panoramic image is a directed acyclic image or not according to the input-output relationship of an operation unit in the panoramic image; therefore, the connection logic in the panoramic image is verified through the front end in the storage stage, and the directed acyclic check is performed on the data corresponding to the stored panoramic image through the rear end in the operation stage, so that the rapid verification of the panoramic image is realized, and the accuracy of the directed acyclic operation corresponding to the panoramic image is ensured.

Fig. 2A is a schematic flowchart of a panorama verification method provided in an embodiment of the present application, and as shown in fig. 2A, the method at least includes the following steps:

step S210, in the process of creating the panoramic image on the front-end interactive interface, checking a basic connection rule between the operation units and the data nodes related to the corresponding operation units in the panoramic image;

when the panorama is drawn at the front end, the basic connection rule is verified, so that some basic error operations can be avoided, and the cost of the user is reduced.

The process of creating the panorama can be as follows: in response to the fact that a deep learning task to be processed, namely the task to be processed, is received, displaying canvas for constructing a model generation full process on a front-end interactive interface of a model training platform; the user creates at least one data node and at least one operation unit on the canvas through a dragging component based on the task to be processed; and connecting each operation unit with the data nodes having input and output relations with the corresponding operation unit to complete the creation of the panoramic image.

Illustratively, under the condition that the task to be processed is a part defect identification task, the data nodes used by the detection operation unit and the detection operation unit are connected according to a data stream, the data nodes used by the classification operation unit and the classification operation unit are connected according to the data stream, and finally, the plurality of operation units and the plurality of data nodes are connected together in the sequence of each operation unit in the process of processing the task to be processed to form a panoramic image for realizing the part defect identification task.

Step S220, under the condition that the basic connection rule passes verification, the creation of the panoramic image is completed;

here, the basic connection rule is a preset verification rule when a connection is established, and the basic connection rule is automatically verified when a connection of the panorama is drawn on a canvas of a front-end interaction page. Meanwhile, in the basic connection rule checking process, no connection line is added for incorrect connection, so that the connection line in the finally created panoramic image can be ensured to be correct under the condition that the basic connection rule is checked to pass.

In some embodiments, the basic wiring rules include at least one of: repeated connection lines are formed, the input data nodes cannot be connected with the input data nodes, the output data nodes cannot be connected with the output data nodes, the data nodes can only be connected with the operation unit, and the output data nodes of the operation unit cannot be changed.

In some embodiments, in the case that the basic connection rule fails to verify, highlighting the wrong connection and prompting the user for the reason for the error. Therefore, when the basic connection rule check fails, the wrong connection is highlighted, and the user is prompted about the reason of the error, so that the cost of the user on the hand is reduced by giving an error operation prompt.

In some embodiments, for the case of repeated connection lines in the panorama drawing, the popup prompts "incorrect connection lines, repeated connection lines"; in some embodiments, for the case that a data node or an operation unit is connected to itself, a popup prompts that "connection is incorrect and cannot be connected to its own node"; in some embodiments, for the case that the data node is not connected to the operation unit, as shown in fig. 2B, both the "original data set _ 1" 21 and the "data set _ image classification _ 1" 22 are data nodes, and cannot be directly connected, otherwise, the "incorrect connection is highlighted and pops up" and the data node can only be connected to the operation unit "23.

In some embodiments, for the case where the output data nodes of the operation unit do not match, the popup prompts "connect incorrectly, output data nodes of the operation unit may not be changed"; in some embodiments, a pop-up prompt "connect incorrect, please reconnect" is presented for the case where an input data node is connected to an input data node, or an output data node is connected to an output data node.

In some embodiments, the erroneous link is automatically deleted after highlighting the erroneous link and a predetermined time interval. Here, the predetermined period of time is an empirical value, and may be set to, for example, two seconds. In this way, by deleting wrong connecting lines at regular time, the connecting lines are not added for incorrect connection, and the correctness of the created panoramic image is ensured.

Step S230, in response to receiving an instruction for saving the panoramic image created on the front-end interactive interface, checking connection logic in the panoramic image;

step S240, saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification;

step S250, responding to the received instruction of operating the panoramic image, and acquiring the stored input and output relationship of the operation unit in the panoramic image;

and step S260, checking whether the panoramic image is a directed acyclic image or not according to the input and output relation of the operation unit in the panoramic image.

The implementation details of the steps S230 to S260 are similar to the implementation of the steps S110 to S140, and in the implementation, reference may be made to the corresponding description above.

In the embodiment of the application, whether the basic connection rule is correct or not is detected in real time in the process of creating the panoramic image, so that some basic error operations can be avoided; then, when the created panoramic image is stored, the connection logic in the panoramic image is automatically checked, and the connection validity of the data nodes and the operation unit is ensured; and finally, judging whether the panoramic image is directed acyclic when the panoramic image is operated, and ensuring that the connection relation between the operation units is reasonable. Therefore, a more perfect verification mode is established by automatically verifying the connection relation of the panoramic image in the creating and storing stages and judging whether the legality of the whole panoramic image is determined in a directed and acyclic manner in the operating stage.

Fig. 3A is a schematic flowchart of a panorama verification method provided in an embodiment of the present application, and as shown in fig. 3A, the method at least includes the following steps:

step S310, in response to receiving an instruction for saving a panoramic image created on a front-end interactive interface, checking connection logic in the panoramic image;

here, the connection logic in the panoramic view includes validity of connection between the data node and the operation unit in the panoramic view and whether a reference resource of the data node in the panoramic view is complete.

The legality of the connection of the data node and the operation unit comprises that no independent unconnected data node and operation unit exist, and the connection relation between the operation unit and the data node.

In some embodiments, one data node is an input to at least one operating unit; in some embodiments, one data node is the output of one operational unit; in some embodiments, one data node is both the output of the previous operating unit and the input of the next operating unit; in some embodiments, the type of the operation unit and the type of the data node having input and output relationship with the operation unit should be consistent, for example, the object detection data node can only connect with the object detection operation unit, and the like.

The reference resource of the data node refers to a general name of data such as texts, pictures and models used in the artificial intelligence model training platform.

Exemplarily, a data node serving as an input in a panorama constructed in a training scene should be configured with resources as a labeled data set and a corresponding resource version, and a data node serving as an output should be configured with resources as a model; the data nodes serving as inputs in the panorama constructed in the inference scene should be configured with trained models, corresponding resource versions and the like.

In some embodiments, the checking the join logic in the panorama comprises: checking whether the data node exists in the panoramic image or the operation unit is not connected; and/or checking whether the resource configuration information of the data nodes in the panoramic image is complete; and/or checking whether the connection relation between the data nodes and the operation units in the panoramic image is correct or not. Here, the resource configuration information is a name, a resource version, and the like of a resource referred by the data node. In this way, when clicking to save, the operation units or data nodes which are not connected in the panoramic image, the resource configuration information of the data nodes and the connection relation between the data nodes and the operation units are checked, so that the connection validity of the panoramic image is ensured.

In some embodiments, the checking whether the resource configuration information of the data node in the panorama is complete includes: if the data node is an input node of the operation unit, checking whether the data node selects a resource and a resource version; and in the case that the data node is an output node of the operation unit, checking whether the data node selects a resource. In this way, whether the reference resources of the input nodes and the output nodes of the operation units are complete or not is respectively checked, and the accuracy of the panoramic image in operation is ensured.

Step S320, under the condition that the connection logic in the panoramic image is not verified, highlighting wrong data nodes or connecting lines in the panoramic image and prompting a user of a wrong reason;

here, for connection logic verification under different conditions, when the verification content fails, on one hand, an error part in the panoramic image, such as a certain data node or a certain section of connecting line, can be highlighted, and on the other hand, a corresponding error reason can be prompted quickly and easily. The prompting form includes but is not limited to pop-up windows, light flashing, voice broadcasting and the like.

In some embodiments, if the input data node of an operation unit fails to check, a pop-up window may be used to indicate that "the connection is incorrect and cannot be run", please check the node and the operation setting "and highlight the operation unit and the connection between the operation unit and the corresponding input data node, as shown in fig. 3B, since the type of the data node" data set _ object detection _1 "31 does not match the type of the operation unit" model training _ object classification _1 "32, the data node 31 cannot be used as the input node of the operation unit 32, and thus the operation unit 32 and the connection 33 are highlighted.

In some embodiments, if there are unconnected data nodes in the panorama, a popup may prompt "the data nodes are highlighted while the connection setting is checked" if the nodes are not connected and cannot operate; in some embodiments, if the input data node of an operation unit does not select a resource and a resource version, the popup prompts that the starting point node must specify a resource identifier and a version identifier and the input data node is highlighted at the same time; in some embodiments, if the output data node of an operation unit does not specify an output resource, a popup prompts that the output node must specify a resource identifier while highlighting the output data node.

Step S330, in response to the fact that the wrong data nodes or connecting lines in the panoramic image are correctly modified, the panoramic image is saved again;

the user is prompted for the error reason by highlighting the wrong data node or connecting line and popping a window, so that the user's cost on the hand can be reduced, the connection error in the panoramic image can be quickly modified, and the legal panoramic image formed by connecting the data node and the operation unit can be saved.

Step S340, saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification;

step S350, responding to the received instruction for operating the panoramic image, and acquiring the stored input and output relation of the operation unit in the panoramic image;

and step S360, checking whether the panorama is a directed acyclic graph or not according to the input-output relation of the operation unit in the panorama.

In the embodiment of the application, all connection logics in the panoramic image are checked in the process of saving the panoramic image, and for the conditions that the connection relation between the operation unit and the data nodes is wrong, the unconnected data nodes exist or the resource configuration information of the data nodes is wrong, saving is stopped, the wrong position is highlighted, and the reason of the error is prompted to a user at the same time, so that the user can modify the panoramic image conveniently. Therefore, on one hand, the cost of the user is reduced, and on the other hand, the accuracy of the directed acyclic graph corresponding to the finally stored panoramic graph in running is guaranteed.

Fig. 4 is a schematic flowchart of a panorama verification method provided in an embodiment of the present application, and as shown in fig. 4, the method at least includes the following steps:

step S410, in response to receiving an instruction for storing a panoramic image created on a front-end interactive interface, checking connection logic in the panoramic image;

step S420, saving the panoramic image under the condition that the connection logic in the panoramic image passes the verification;

step S430, responding to the received instruction for operating the panoramic image, and analyzing the stored data corresponding to the panoramic image;

here, the back end performs conversion analysis by converting data corresponding to the stored panorama when the panorama is clicked. In implementation, the attribute of the data node related to each operation unit may be incorporated into the corresponding operation unit according to a connection line between the data node and the operation unit in the panorama, so as to directly connect the operation units, that is, convert the connection relationship between the data node and the operation unit into the connection relationship between the operation units.

Step S440, based on the analysis result, taking the connection relation between the operation units in the panoramic image as the input-output relation of the operation units;

here, the connection relationship between the operation units in the analyzed panorama is used as the input/output relationship of the operation units to determine whether the panorama is a directed acyclic graph, so that the connection relationship between the operation units can be ensured to be reasonable, and the checking efficiency can be improved.

Step S450, checking whether the panoramic image is a directed acyclic image according to the input-output relation of the operation unit in the panoramic image;

here, the input-output relationship of the operation unit in the panoramic image is verified through a topological algorithm, and a second verification result is obtained; in case the second check result indicates that the check is successful, performing step S460; in case the second check result indicates a check failure, step S470 is performed.

It should be noted that the topology ranking algorithm is mainly used to solve the Dependency Resolution (Dependency Resolution) problem in the directed graph. For any directed acyclic graph, topological sorting is carried out on the directed acyclic graph to obtain a linear arrangement result of all the operation units. The linear arrangement result satisfies the condition: for any two operation units u and v in the graph, if there is a directed edge pointing from u to v, then u must appear before v in the linear permutation result.

Step S460, running the panoramic image under the condition that the panoramic image is verified to be a directed acyclic image;

here, when the panorama is run, the panorama is directly started to run if the panorama is checked to be a directed acyclic graph.

And step S470, under the condition that the panoramic image is not checked to be a directed acyclic image, prompting a user that the panoramic image fails to operate.

When the panorama is operated, the verification panorama is not a directed acyclic graph, the operation is stopped, the user is prompted about the failure reason, the error waiting time is reduced, and the validity of the panorama can be quickly verified.

The method for checking the panorama described above is described below with reference to a specific embodiment, but it should be noted that the specific embodiment is only for better describing the present application and is not to be construed as a limitation to the present application.

Compared with the mode that whether directed acyclic graphs are constructed by most products in the market in a directed acyclic graph checking mode, the checking scheme provided by the embodiment of the application at least comprises the mode that whether front-end checking connection validity and rear-end checking are directed acyclic when the panoramic graphs are stored, the reason of operation failure is quickly and easily thrown out to a user, and the error waiting time is reduced.

When the directed acyclic graph is constructed in an operation, automatic verification needs to be carried out on the connecting line, and the legality of the directed acyclic graph is ensured; the verification contains at least two parts: when the front end clicks to store the panoramic image, the validity of the connection between the operation unit and the data node is checked; if the verification fails, a corresponding error prompt is returned, so that the user can modify the directed acyclic graph conveniently, the cost of the user is lowered to a certain extent, and the accuracy of the directed acyclic graph operation is ensured; and the back end performs conversion analysis on the data of the ringless image, firstly obtains the input-output relationship of the operation according to the connecting line, then verifies whether the operation is directed ringless according to the input-output relationship, if the verification fails, the user is prompted that the panoramic image is illegal, and if the verification passes, the panoramic image starts to run.

Fig. 5A is a logic flow diagram of a panorama verification method provided in an embodiment of the present application, where as shown in fig. 5A, the method at least includes the following steps:

step S510, automatically checking basic connection rules in the process of creating the panoramic image;

as shown in fig. 5B, the verification process includes the following steps: step S511, clicking a data node or an anchor point connection line of the operation unit; step S512, checking the basic connection rule; step S513, judging whether the verification is passed; when the verification is passed, executing step S514, and establishing a connection between the data node and the operation unit; otherwise, step S515 is executed, the error connection line is highlighted and automatically deleted, and an error message is prompted.

In step S512, basic connection rules, such as whether there is a repeated connection, an input data node is connected to an input data node, and an output data node is connected to an output data node, are checked.

In the checking process, if repeated connection exists, the input data node is connected with the input data node, the output data node is connected with the output data node, the operation of changing the output data node is carried out, and the like, the highlighted wrong connection simultaneously gives a prompt, and the corresponding wrong connection is automatically deleted after two seconds.

According to the embodiment of the application, when the directed acyclic graph is edited and drawn and the connection relation is established, some basic error operations are avoided in an automatic checking mode, and meanwhile, a user error operation prompt is given. The embodiment of the application effectively avoids the problem that no error prompt exists in the process of drawing the connection line of the panoramic image in the related technology, the anchor point can be connected by displaying simple input and output in a highlight mode, the connection logic between the data node and the operation unit in the panoramic image is not checked, and the failure can be caused during operation.

Step S520, checking the connection logic in the panoramic image in the process of storing the panoramic image;

as shown in fig. 5C, the verification process includes the following steps: step S521, clicking a save button; step S522, checking connection logic in the panoramic image; step S523, judging whether the verification is passed; if the verification is passed, step S524 is executed, and the storage is successful; otherwise, executing step S525, and prompting error reasons and highlighting error data nodes through a popup window; and step S526, the modified data is saved again.

In step S522, the front end checks whether the connection validity of the operation unit and the data node and the reference resource of the data node are complete for the panorama, for example, the individual data node has no connection relation, the data node is input without specifying the resource, the image classification data node is connected to the object detection operation unit, and the like.

In the checking process, if the operation output node type is wrong, the data nodes which are not connected are wrong, the storage is stopped, and meanwhile, the highlight connection line gives an error prompt at the same time.

Step S530, judging whether the panorama is a directed acyclic graph or not in the process of running the panorama.

As shown in fig. 5D, the process includes the steps of: step S531, clicking an operation button; step S532, converting the connection relation between the operation units in the panorama; step S533, judging whether the directed acyclic graph exists or not by using topological sorting; if yes, executing step S534 to run the panorama; otherwise, step S535 is executed to prompt the user that the panoramic image operation fails.

When the front end clicks to operate the panoramic image, the rear end converts the storage data of the panoramic image, acquires the connection relation between the operation units, namely the input-output relation of the operation units, so as to judge whether the panoramic image is a directed acyclic image or not, and starts to operate the panoramic image if the panoramic image passes the check; and if the verification fails, throwing errors and terminating the operation. Therefore, the input and output relations of the operation units are obtained in real time, whether the operation units are directed acyclic or not is judged, the reasonable connection relation among the operation units is ensured, and the defect that the checking efficiency is low because the connection relation is converted before the panoramic image is really operated and whether the operation units are directed acyclic or not is judged through a topological algorithm is overcome.

In the related art, the validity of the panoramic image is mainly checked by judging whether a loop exists or not, and the checking on the connection relation is less; the method and the device mainly divide the verification of the panoramic image into the connection logic verification and the directed acyclic verification, automatically verify the connection rule and the connection logic for drawing the panoramic image, judge whether the whole panoramic image is legal or not in a directed acyclic manner, and realize quick automatic verification.

Compared with the simple verification modes such as establishing a connection relation through dragging and highlighting a connectable point in the process of creating the panoramic image in the prior art, the embodiment of the application establishes a more perfect relation verification mode; on one hand, basic connection rules are verified when the panoramic image is edited; on the other hand, when clicking and storing, the connection relation between the data nodes and the operation unit in the panoramic image and whether the resource information of the data nodes is selected or not are checked, so that the cost of the user is reduced, and the accuracy of the directed acyclic graph operation is ensured; on the other hand, when the click operation is carried out, whether the loop exists or not is judged, and the legality of the connection relation is ensured.

Based on the foregoing embodiments, an embodiment of the present application further provides an apparatus for checking a panorama, where the apparatus includes modules, sub-modules included in the modules, and units, and may be implemented by a processor in an electronic device; of course, the implementation can also be realized through a specific logic circuit; in implementation, the Processor may be a Central Processing Unit (CPU), a microprocessor Unit (MPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or the like.

Fig. 6 is a schematic structural diagram of a checking apparatus for a panorama according to an embodiment of the present application, and as shown in fig. 6, the apparatus 600 includes a first checking module 610, a first saving module 620, an obtaining module 630, and a second checking module 640, where:

the first checking module 610 is configured to check connection logic in a panoramic image created on a front-end interactive interface in response to receiving an instruction to store the panoramic image;

the first saving module 620 is configured to save the panorama if the connection logic in the panorama passes verification;

the obtaining module 630, configured to, in response to receiving an instruction to run the panorama, obtain a stored input/output relationship of an operation unit in the panorama;

the second checking module 640 is configured to check whether the panorama is a directed acyclic graph according to an input-output relationship of an operation unit in the panorama.

In some possible embodiments, the apparatus further includes a third checking module, configured to check, during the process of creating the panoramic view on the front-end interactive interface, basic connection rules between the operation units and the data nodes related to the corresponding operation units in the panoramic view; and the creating module is used for finishing the creation of the panoramic image under the condition that the basic connection rule passes the verification.

In some possible embodiments, the basic connection rule includes at least one of: repeated connection, input data nodes can not be connected with input data nodes, output data nodes can not be connected with output data nodes, the data nodes can only be connected with the operation unit, and the output data nodes of the operation unit can not be changed; the device also comprises a first prompting module which is used for highlighting the wrong connecting line and prompting the user of the error reason under the condition that the basic connecting line rule is failed to be checked.

In some possible embodiments, the first prompting module is further configured to automatically delete the wrong connecting line after highlighting the wrong connecting line and a predetermined time interval.

In some possible embodiments, the first checking module includes a first checking submodule, configured to check whether the data node exists in the panorama or the operation unit is not connected; and/or the second check submodule is used for checking whether the resource configuration information of the data nodes in the panoramic image is complete, and/or the third check submodule is used for checking whether the connection relation between the data nodes and the operation unit in the panoramic image is correct.

In some possible embodiments, the second check sub-module includes a first check unit configured to check whether the data node selects a resource and a resource version if the data node is an input node of the operation unit; and the second checking unit is used for checking whether the data node selects resources or not under the condition that the data node is the output node of the operation unit.

In some possible embodiments, the apparatus further includes a second prompting module, configured to highlight a wrong data node or connection line in the panoramic image and prompt a user of a reason for the error if the connection logic in the panoramic image is not verified; and the second storage module is used for responding to the fact that the wrong data nodes or connecting lines in the panoramic image are correctly modified and restoring the panoramic image.

In some possible embodiments, the obtaining module 630 includes a parsing sub-module, configured to, in response to receiving an instruction to execute the panorama, parse stored data corresponding to the panorama; and the determining submodule is used for taking the connection relation between the operation units in the panoramic image as the input-output relation of the operation units based on the analysis result.

In some possible embodiments, the apparatus further includes a running module, configured to run the panorama if the panorama is checked to be a directed acyclic graph; and the third prompting module is used for prompting the user that the panoramic image fails to operate under the condition that the panoramic image is not verified to be the directed acyclic image.

Here, it should be noted that: the above description of the apparatus embodiments, similar to the above description of the method embodiments, has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.

It should be noted that, in the embodiment of the present application, if the verification method of the panorama is implemented in the form of a software functional module and is sold or used as an independent product, the verification method may also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling an electronic device (which may be a smartphone with a camera, a tablet computer, etc.) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.

Correspondingly, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the panorama verification method described in any of the above embodiments. Correspondingly, in an embodiment of the present application, a chip is further provided, where the chip includes a programmable logic circuit and/or a program instruction, and when the chip runs, the chip is configured to implement the steps in the panorama verification method in any of the embodiments. Correspondingly, in an embodiment of the present application, a computer program product is further provided, and when the computer program product is executed by a processor of an electronic device, the computer program product is configured to implement the steps in the panorama verification method in any one of the above embodiments.

Based on the same technical concept, an embodiment of the present application provides an electronic device, which is used for implementing the method for checking a panorama described in the above method embodiment. Fig. 7 is a hardware entity diagram of an electronic device according to an embodiment of the present application, as shown in fig. 7, the electronic device 700 includes a memory 710 and a processor 720, the memory 710 stores a computer program that can be executed on the processor 720, and the processor 720 executes the computer program to implement steps in the panorama verification method according to any embodiment of the present application.

The Memory 710 is configured to store instructions and applications executable by the processor 720, and may also buffer data (e.g., image data, audio data, voice communication data, and video communication data) to be processed or already processed by the processor 720 and modules in the electronic device, and may be implemented by a FLASH Memory (FLASH) or a Random Access Memory (RAM).

The processor 720, when executing the program, performs the steps of any of the above-described panorama verification methods. The processor 720 generally controls the overall operation of the electronic device 700.

The Processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic device implementing the above-mentioned processor function may be other electronic devices, and the embodiments of the present application are not particularly limited.

The computer storage medium/Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic Random Access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM), and the like; and may be various electronic devices such as mobile phones, computers, tablet devices, personal digital assistants, etc., including one or any combination of the above-mentioned memories.

Here, it should be noted that: the above description of the storage medium and device embodiments is similar to the description of the method embodiments above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium and apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiments of the present application.

In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing an automatic test line of a device to perform all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code. The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments. The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.

The above description is only for the embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for checking a panorama, the method comprising:

2. The method of claim 1, wherein the method further comprises:

in the process of creating the panoramic image on the front-end interactive interface, checking a basic connection rule between the operation units and the data nodes related to the corresponding operation units in the panoramic image;

and under the condition that the basic connection rule passes the verification, finishing the creation of the panoramic image.

3. The method of claim 2, wherein the basic wiring rules include at least one of: repeated connection, input data nodes can not be connected with input data nodes, output data nodes can not be connected with output data nodes, the data nodes can only be connected with the operation unit, and the output data nodes of the operation unit can not be changed;

the method further comprises the following steps:

and under the condition that the basic connection rule is failed to verify, highlighting the wrong connection line and prompting a user of the reason of the error.

4. The method of claim 3, wherein the method further comprises:

and automatically deleting the wrong connecting line after highlighting the wrong connecting line and spacing for a preset time.

5. The method of any of claims 2 to 4, wherein the verifying the join logic in the panorama comprises:

checking whether the data node exists in the panoramic image or the operation unit is not connected; and/or the presence of a gas in the gas,

checking whether the resource configuration information of the data nodes in the panoramic image is complete or not; and/or the presence of a gas in the gas,

and checking whether the connection relation between the data nodes and the operation units in the panoramic image is correct or not.

6. The method of claim 5, wherein the checking whether the resource configuration information for the data nodes in the panorama is complete comprises:

if the data node is an input node of the operation unit, checking whether the data node selects a resource and a resource version;

and in the case that the data node is an output node of the operation unit, checking whether the data node selects a resource.

7. The method of any of claims 1 to 6, further comprising:

under the condition that the connection logic in the panoramic image is not verified, highlighting wrong data nodes or connecting lines in the panoramic image and prompting a user of a wrong reason;

and in response to the data nodes or connecting lines in the panorama which are wrong are modified correctly, restoring the panorama.

8. The method of any one of claims 1 to 7, wherein the obtaining the stored input-output relationship of the operation unit in the panorama in response to receiving an instruction to execute the panorama comprises:

analyzing the stored data corresponding to the panoramic image in response to receiving an instruction for operating the panoramic image;

and taking the connection relation between the operation units in the panoramic image as the input-output relation of the operation units based on the analysis result.

9. The method of any of claims 1 to 8, further comprising:

running the panoramic image under the condition of checking that the panoramic image is a directed acyclic image; alternatively, the first and second electrodes may be,

and prompting a user that the operation of the panoramic image fails under the condition that the panoramic image is not checked to be a directed acyclic image.

10. The device for checking the panoramic image is characterized by comprising a first checking module, a first saving module, an acquiring module and a second checking module, wherein:

and the second checking module is used for checking whether the panoramic image is a directed acyclic image or not according to the input-output relation of the operation unit in the panoramic image.

11. An electronic device comprising a memory and a processor, the memory storing a computer program operable on the processor, wherein the processor implements the steps of the method of any one of claims 1 to 9 when executing the program.

12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 9.