CN109690473B - Graphical programming method and device, computer storage medium and visual system - Google Patents
Graphical programming method and device, computer storage medium and visual system Download PDFInfo
- Publication number
- CN109690473B CN109690473B CN201780036109.2A CN201780036109A CN109690473B CN 109690473 B CN109690473 B CN 109690473B CN 201780036109 A CN201780036109 A CN 201780036109A CN 109690473 B CN109690473 B CN 109690473B
- Authority
- CN
- China
- Prior art keywords
- function
- displaying
- graphic element
- logic
- tabular
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
Abstract
The invention discloses a graphical programming method, which comprises the following steps: displaying a first graphical element on a programming interface; displaying tabular graphic elements on the programming interface, and displaying the connection relation between the tabular graphic elements and the first graphic elements; analyzing the operation result of the first function by using the second function, and displaying the analysis result on the list-type graphic element; displaying a second graphic element on the programming interface, and displaying a connection relation between the tabular graphic element and the second graphic element, wherein the second graphic element corresponds to a third function; and controlling the third function to execute a corresponding function by using the analysis result on the list-type graphic element. The invention also discloses a corresponding device, a computer storage medium and a vision system. The invention realizes the clear, intuitive and concise operation visualization.
Description
Technical Field
The invention relates to the technical field of industrial robots, in particular to a graphical programming method and device, a computer storage medium and a vision system.
Background
In the current industrial visual design, an interactive interface of the process design is generally realized in modes of graphical operation, electronic forms, design execution sequences or programming and the like, wherein the graphical operation mode is the simplest operation, but the graphical operation in the visual field cannot conveniently solve many common operation problems at present; the electronic forms are more complex to use when more complex programs are designed; the design execution sequence is simple, but is not easy to be used for complex programming, and is basically not used in robots and vision; the programming mode is complex and difficult to popularize.
Therefore, the operation of external input of the current industrial visual process design is inconvenient, the overall simplicity is poor, the expression of an interactive interface is not visual, the execution dependency relationship is not clear, and clear operation visualization cannot be realized.
Disclosure of Invention
The invention aims to provide a graphical programming method, a graphical programming device, a computer storage medium and a visual system, aiming at the problems that the operation of an interactive interface of an industrial visual process design in the prior art is not convenient and clear operation visualization cannot be realized.
The technical scheme adopted by the invention for solving the technical problems is to provide a graphical programming method, which comprises the following steps: displaying a first graphical element on a programming interface, wherein the first graphical element corresponds to a first function; displaying tabular graphic elements on the programming interface, and displaying a connection relation between the tabular graphic elements and the first graphic elements, wherein the tabular graphic elements correspond to a second function for analyzing the operation result of the first function; analyzing the operation result of the first function by using the second function, and displaying the analysis result on the list-type graphic element; displaying a second graphic element on the programming interface, and displaying a connection relation between the analysis result and the second graphic element, wherein the second graphic element corresponds to a third function; and controlling the third function to execute a corresponding function by using the analysis result.
Another technical solution adopted by the present invention to solve the above technical problem is to provide a graphical programming device, wherein the device includes a memory and a processor, wherein: the memory for storing program instructions configured to be executed by the processor; the processor executes the program instructions to implement the graphical programming method described above.
Another technical solution adopted by the present invention to solve the above technical problem is to provide a computer storage medium, wherein computer instructions executable by a processor are stored, and the computer instructions are used for executing the graphical programming method as described above.
Another technical solution adopted by the present invention to solve the above technical problem is to provide a vision system, wherein the system includes the graphical programming device as described above.
The invention has the following beneficial effects: the operation result of the first function corresponding to the first graphic element is analyzed through the second function corresponding to the list-type graphic element, the analysis result is displayed on the list-type graphic element, programming personnel can conveniently know input operation, then the connection relation between the second graphic element and the analysis result is realized, and then the third function corresponding to the second graphic element can be controlled to execute the corresponding function, so that the visualization operation is clear, visual and simple.
Drawings
The invention will be further described with reference to the accompanying drawings and embodiments, in which:
FIG. 1 is a flow chart of one embodiment of a graphical programming method of the present invention;
FIG. 2 is a schematic diagram of a first embodiment of tabular graphic elements in the above-described embodiments of the invention;
FIG. 3 is a schematic diagram of a second embodiment of tabular graphic elements in the above-described embodiments of the invention;
FIG. 4 is a diagram illustrating execution information of a third graphic element according to the above embodiment of the present invention;
FIG. 5 is a diagram illustrating a specific application scenario for implementing the method of the above embodiment of the present invention;
FIG. 6 is a schematic diagram of another specific application scenario for carrying out the method of the above-described embodiment of the present invention;
FIG. 7 is a schematic structural diagram of a graphical programming device according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution of the present invention is further described in detail below with reference to the accompanying drawings and the detailed description.
Fig. 1 is a flow chart of an embodiment of a graphical programming method of the present invention, which can be applied to an industrial visual design to realize operation visualization, but of course, the method can also be applied to other designs, for example, a management operation interface of a management system, and is within the understanding of those skilled in the art, and is not limited thereto. The method comprises the following steps:
step S102: displaying a first graphical element on the programming interface, wherein the first graphical element corresponds to a first function.
The programming interface can be of an industrial vision system or other visual control system. The first graphical element is preset by the programmer and may be in the shape of an ellipse, although in other embodiments, the shape may be a square, and may be set in a toolbar of the programming interface corresponding to a first function that is also preset by the system programmer to obtain information needed for programming, such as external information from an external input/output device. For another example, when the industrial vision system controls the robot and displays a first graphic element on the programming interface, the system calls a first function accordingly, outputs an operation result of the first function, and further obtains corresponding external information from the robot to perform subsequent programming processing.
Step S104: and displaying tabular graphic elements on the programming interface, and displaying the connection relation between the tabular graphic elements and the first graphic elements, wherein the tabular graphic elements correspond to a second function for analyzing the operation result of the first function.
The second function corresponding to the tabular graphic element is used for analyzing the operation result of the first function, and is also preset by a system programmer, and the rule of the analysis can be consistent with the development rule for setting the operation result of the first function, for example, in the development rule, the operation result of the first function represents to control a certain component action, and then the analysis of the operation result is followed by the relevant parameter for controlling the certain component action. The connection relationship established between the tabular graphic element and the first graphic element can be represented by a straight line on the programming interface. And the connection relation between the tabular graphic element and the first graphic element represents that the operation result of the first function is input into the tabular graphic element as the input quantity of the second function.
Step S106: and analyzing the operation result of the first function by using the second function, and displaying the analysis result on the list-type graphic element.
For example, when the connection relationship between the tabular graphic element and the first graphic element is displayed, the second function analyzes the operation result of the first function, for example, in the industrial vision system, the second function is called in the system, that is, the operation result of the first function is analyzed, and when the analysis is completed, the analysis result is displayed on the tabular graphic element.
Step S108: and displaying a second graphic element on the programming interface, and displaying a connection relation between the analysis result and the second graphic element, wherein the second graphic element corresponds to the third function.
The third function corresponding to the second graphic element is preset by a system programmer, and a plurality of third functions can be preset in the system for subsequent different execution commands. And displaying the analysis result on the tabular graphic element, and displaying the connection relation between the analysis result and the second graphic element, namely establishing the connection relation between the tabular graphic element and the second graphic element. The connection relationship established between the second graphic element and the tabular graphic element can also be represented by a straight line on the programming interface. And after the connection relation between the second graphic element and the tabular graphic element is established, representing the analysis result on the tabular graphic element to control the corresponding second graphic element so as to enable the second graphic element to execute the corresponding function.
Step S110: and controlling a third function to execute a corresponding function by using the analysis result on the tabular graphic element.
For example, when the connection relationship between the second graphic element and the tabular graphic element is established, the third function is controlled to execute the corresponding function, for example, in the industrial vision system, when the second graphic element is displayed on the programming interface, the third function is called in the system, and the corresponding function is executed, for example, the camera is turned on, the corresponding program is selected, and the like.
It should be noted that the first graphic element, the tabular graphic element, and the second graphic element may be preset, have different shapes or have the same shape, and may be set on a toolbar of a programming interface, and when the first graphic element, the tabular graphic element, and the second graphic element are required to be used, they are directly dragged to the programming interface and displayed, and at the same time, when the first graphic element is operated on the programming interface, for example, by clicking or double clicking, the parameters of the corresponding function may be displayed on the programming interface, and if the user needs to modify the parameters of the function, the function may be performed on the programming interface, which is convenient and simple.
In this embodiment, on the programming interface, the second function corresponding to the tabular graphic element analyzes the operation result of the first function corresponding to the first graphic element, and the analysis result is displayed on the tabular graphic element, so that a programmer can conveniently know the input operation.
Further, the information required for programming acquired by the first function includes a logic variable, and the logic variable correspondingly indicates whether the information required for programming includes a corresponding information item, so that the subsequent programming processing is expressed by the logic variable, so that the programming interface is intuitive and concise, wherein the logic variable may be represented by a boolean value, for example, 1 indicates that the acquired information required for programming includes a corresponding information item, and 0 indicates that the acquired information required for programming does not include a corresponding information item, i.e., does not include a corresponding information item, although the logic variable may also be represented by other values, such as a multi-bit binary number. Of course, in other embodiments, the information required for programming acquired by the first function may further include other expression variables, for example, an alphabetical variable, that is, whether the information required for programming includes a corresponding information item is indicated by an alphabetical letter. Further, the step S106 includes: and analyzing the logic variable in the operation result of the first function by using the second function, and displaying the logic variable on the list-type graphic element. In this embodiment, the logical variable is displayed on the tabular graphic element, so that information items required in graphical programming after the tabular graphic element can be visually understood on the tabular graphic element.
Specifically, in one embodiment, in the industrial vision system, the first function is used to acquire external information from the robot or the external input/output device, that is, the operation result of the first function is the acquired external information, and at this time, the logical variable in the operation result of the first function is parsed by the second function and displayed on the tabular graphic element, and the method includes: and analyzing the logic variable in the external information by using a second function, and displaying the logic variable on the tabular graphic element.
Specifically, if the information required for programming acquired by the first function includes a plurality of logic variables, where the plurality of logic variables are present, each logic variable corresponds to an information item to be processed subsequently, and at this time, the logic variables in the operation result of the first function are analyzed by using the second function, and the logic variables are displayed on the tabular graphic element, including: the user-specified logical variable is selected from the plurality of logical variables according to the user's specification, and the user-specified logical variable is displayed on the tabular graphic element. Therefore, when programming, a user can display the logic variable on the list-type graphic element according to the selection of the user, and the operation is convenient.
Specifically, in one embodiment, the tabular graphic element is a logical list, which may contain one or more logical variables, each logical variable corresponding to a column bit, i.e., a column of the logical list, each column bit containing one or more fields. At this time, the analyzing the logic variable in the operation result of the first function by using the second function, and displaying the logic variable on the tabular graphic element, includes: and analyzing the logic variable in the operation result of the first function by using the second function, and displaying the logic variable in the corresponding column of the logic list.
Further, after displaying the logical variable to the corresponding field of the logical list, the step S108 includes: and displaying the connection relation between the second graphic element and the corresponding column.
Further, on the basis that the tabular graphic element is a logical list, before the step S106, the method further includes: and setting the number of columns in the tabular graphic elements according to the designation of the user. The user can customize the number of columns of the tabular graphic element according to the programming habit of the user, for example, if the user specifies that the tabular graphic element includes 3 columns, the number is 3, as shown in fig. 2, wherein the first column represents the boolean value of the information item, that is, is used for displaying the logical variable, and at this time, displaying the logical variable in the corresponding column of the logical list includes: and displaying the logic variable in the corresponding first column according to the designation of the user. Further, the second column indicates the first graphic element from which the logical variable of the first column originates, and the third column indicates the user-defined description of the first graphic element from which the logical variable originates, at this time, displaying the logical variable in the corresponding column of the logical list includes: and displaying the first graphic element from which the logic variable is originated in the corresponding second column and/or displaying the user-defined description of the user in the corresponding third column according to the designation of the user.
Further, if the user-specified tabular graphic element includes 4 fields, the number of the fields is 4, as shown in fig. 3, the fourth field indicates a value obtained by operating different logic variables, and at this time, displaying the logic variables in the corresponding fields of the logic list further includes: and calculating different logic variables in the logic list according to the designation of the user, and displaying the calculation result to the corresponding fourth column.
It should be noted that, corresponding information is displayed in the corresponding column according to the designation of the user, and during the programming process, the user can write in the logic list by himself and display, for example, the first graphic element from which the logic variable displayed in the second column originates, or the user-defined description displayed in the third column, or, of course, the system can automatically write in the logic variable displayed in the first column when the second function is run.
As shown in fig. 3, on the basis of operating different logic variables in the logic list and displaying the operation result to the corresponding fourth field, in step S108, displaying the connection relationship between the analysis result and the second graphic element includes: and displaying the connection relation between the fourth field and the second graphic element. Accordingly, step S110 includes: and controlling the third function to execute the corresponding function by using the operation result.
Specifically, in an embodiment, the information required for programming acquired by the first function includes a logic variable, and at this time, the step S110 includes: and controlling the third function to execute corresponding control function or logic operation by using the logic variable. For example, if the logic variable of a certain information item is 1, it indicates that the camera is turned on, and at this time, the third function directly turns on the control function of the camera; if the logic variables of two information items need to be both 1, the method performs subsequent processing, at this time, the third function performs a logic operation, such as a logic and operation, on the logic variables of the two information items, and further performs subsequent processing when the logic variables of the two information items are both 1.
In another embodiment, the information required for programming acquired by the first function includes a plurality of logic variables, in this case, step S110 includes: and controlling the third function to execute corresponding control function, logic operation and/or logic judgment according to the logic variable. If the logic variable of a certain information item is 1, the program selection is indicated, at this time, the third function performs logic judgment, if the result of the logic judgment is 0, one program is selected to be executed, and if the result of the logic judgment is 1, the other program is selected to be executed. The third function is controlled to execute the corresponding control function and logic operation, which have been described above and will not be described again.
Specifically, in one embodiment, the same tabular graphic element connects at least two first graphic elements, where the first functions corresponding to the at least two first graphic elements are different. For example, in an industrial vision system, it is necessary to acquire external information of a robot and external information of an external input/output device at the same time, and in this case, it is necessary to acquire external information of the robot and external information of the external input/output device using two first graphic elements, which are connected to one tabular graphic element. Further, after parsing the logical variable in the operation result of the first function using the second function, displaying the logical variable on the tabular graphic element includes: and simultaneously displaying the logic variables analyzed by the first functions corresponding to the at least two first graphic elements on the list-type graphic elements.
Further, the method further comprises: displaying a third graphic element on the programming interface, and displaying a connection relationship between the third graphic element and the second graphic element, wherein the third graphic element corresponds to a fourth function, wherein the fourth function corresponds to a program required by programming, for example, when external information of the robot needs to be acquired in an industrial vision system, the external information of the robot is programmed and a certain program which needs to be selected is set as a certain tool box on the programming interface, and when the tool box is called, the program corresponding to the tool box is executed. Further, in this embodiment, the method includes: and responding to the operation of the user on the third graphic element, displaying a dialog box on the programming interface, and displaying the execution information corresponding to the fourth function in the dialog box. Therefore, the graphical programming is more visual and concise, and the user can conveniently check the execution result. In one embodiment, the user's operation on the third graphical element includes, but is not limited to, clicking the third graphical element, obtaining focus, and the like, and in other embodiments, the user's operation on the third graphical element includes double clicking the third graphical element, and the like. In this embodiment, the execution information includes at least one or a combination of a setting parameter, intermediate data, and an execution result of the fourth function, where a presentation form of the execution information includes any one or a combination of a text, a graphic, and a list. As shown in fig. 4, the diagram is a schematic diagram of a dialog box, where execution information is distributed in a vertical direction, where tune/False represents an execution result, Data represents intermediate Data, ROI and Para represent setting parameters, respectively, ROI represents a region to which the fourth function acts, and Para represents specific relevant parameters. Of course, the dialog box may have other layouts within the understanding of those skilled in the art. It should be noted that the third graphic element may also be disposed on a toolbar of the programming interface, and when the third graphic element is needed to be used, the third graphic element is directly dragged to the programming interface, and meanwhile, when the third graphic element is operated on the programming interface, for example, a single click or a double click may be performed to display the parameter of the function corresponding to the third graphic element on the programming interface.
If the execution information is multiple; the method further comprises the following steps: and selecting the execution information designated by the user from the plurality of execution information according to the designation of the user, closing the dialog box, and displaying the execution information designated by the user around the corresponding third graphic element. The user can check the execution result conveniently. For example, as shown in fig. 5, the intermediate data is displayed around the third graphic element.
The process of graphical programming resulting from the implementation of the above method is described in detail below with reference to a number of specific application scenarios.
First, taking an industrial vision system as an example, an input amount programmed by the method is described, and it is assumed that there are 2 input amounts, which are external information of the robot and external information of the external input/output device, and the tabular graphic elements are logical lists.
As shown in fig. 5, which is a first application scenario, first, two first graphic elements are displayed on a programming interface, wherein, the first function corresponding to the first graphic element message acquires the external information of the robot, the first function corresponding to the list type graphic element I/O acquires the external information of the external input/output device, when the tabular graphic elements are displayed, the connection relation between the first graphic element and the tabular graphic elements is displayed, namely, a straight line is respectively adopted to connect the first graphic element message and the tabular graphic element, and the connection between the first graphical element I/O and the tabular graphical element, while a different first function is run, and subsequently, and displaying the operation results of different first functions on the tabular graphic elements, wherein the operation results comprise logic variables, the first graphic elements from which the logic variables are derived and user-defined descriptions. Subsequently, a second graphic element is displayed according to the logical variable, for example, a second graphic element open camera is displayed according to the displayed custom description in the logical list as control camera; for another example, according to the self-definition description displayed in the logic list as program select, a corresponding second graphic element, that is, a logic judgment part select in the figure is displayed, which includes a straight line 0, a straight line 1 and black dots connected to both the straight line 0 and the straight line 1, and then, a connection relationship between each column of the tabular graphic element and the second graphic element is displayed, for example, a connection relationship between the column of the self-definition description as control camera and the second graphic element open camera is displayed by using a straight line, or for example, a connection relationship between the column of the self-definition description as program select and the black dots in the logic judgment part select is displayed by using two straight lines, at this time, different third functions corresponding to different second graphic elements are executed, as shown in fig. 5, that is to open the camera and execute the logic judgment. Finally, a third graphic element, for example, a third graphic element pattern and blob, which is a program required for programming information, i.e., a program pointed to by the program select, is displayed, and then, a connection relationship between the third graphic element and the second graphic element is displayed, for example, as shown in fig. 5, a straight line 0 points to the third graphic element pattern, a straight line 1 points to the third graphic element blob, and at this time, a fourth function corresponding to the third graphic element is executed. Meanwhile, as shown in fig. 4, when the third graphic element blob is clicked, the execution information corresponding to the fourth function is displayed, the dialog box is closed, and the execution information specified by the user is displayed around the corresponding third graphic element.
As shown in fig. 6, the second application scenario is different from the first application scenario in that, in the programming process, the list-type graphic element displays the operation result after different logic variables are operated, that is, the displayed custom descriptions in the logic list are the operation results after two logic variables corresponding to the program select are both subjected to logic and operation, and the operation results are displayed in the fourth column of the list-type graphic element, and further, the third function is controlled to execute corresponding logic judgment when the connection relationship between the fourth column and the second graphic element is displayed.
As can be seen from the graphical programming on the programming interfaces in fig. 5 and 6, the number of used straight lines is small, the processing executed by the programming can be intuitively understood, the operation visualization is realized, the expression is intuitive, the intersection of the connection relations does not exist between the straight lines and the straight lines, the execution dependency relation is clear, and compared with the graphical programming in fig. 5, the number of the connecting lines used by the graphical programming in fig. 6 is less, so that the execution relation can be simplified by using the logic list, the programming interface can be further intuitively expressed, and the clear operation visualization is realized.
Fig. 7 is a schematic structural diagram of a graphic programming device 700 according to an embodiment of the present invention, which can be applied to industrial vision design, and includes a memory 710, a processor 720 and a bus 730.
In this embodiment, processor 720, by invoking the computer instructions stored by memory 710, is configured to perform:
displaying a first graphical element on the programming interface, wherein the first graphical element corresponds to a first function;
displaying tabular graphic elements on a programming interface, and displaying a connection relation between the tabular graphic elements and the first graphic elements, wherein the tabular graphic elements correspond to a second function for analyzing the operation result of the first function;
analyzing the operation result of the first function by using the second function, and displaying the analysis result on the list-type graphic element;
and displaying a second graphic element on the programming interface, and displaying a connection relation between the analysis result and the second graphic element, wherein the second graphic element corresponds to the third function.
It should be noted that, for the processor 720 to be applied to execute each step in the above method embodiments, please refer to the description of the above method embodiments.
The processor 720 may also be referred to as a CPU (Central Processing Unit). Memory 710, which may include both read-only memory and random-access memory, provides instructions and data to processor 720. A portion of the memory 710 may also include non-volatile random access memory (NVRAM). In a specific application, the above components of the mobile terminal are coupled together by a bus 730, wherein the bus 730 may include a power bus, a control bus, a status signal bus, etc. in addition to a data bus. But for clarity of illustration the various busses are labeled in the figures as bus 730.
The method disclosed in the above embodiments of the present invention may be applied to the processor 720, or implemented by the processor 720. Processor 720 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 720. The processor 720 described above may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 710, and the processor 720 reads the information in the memory 710 and performs the steps of the method in combination with the hardware.
To this end, the present invention further provides a computer readable storage medium, which can be specifically used as the memory 710 shown in fig. 7, which stores computer instructions executable on the processor 720, specifically, in the present embodiment, the computer instructions can be executed to implement the graphical programming method in the above-described embodiments.
Note that the computer-readable storage medium storing computer instructions executable on processor 730 corresponds to the steps in the above-described method embodiments.
In this embodiment, on the programming interface, the second function corresponding to the tabular graphic element analyzes the operation result of the first function corresponding to the first graphic element, and the analysis result is displayed on the tabular graphic element, so that a programmer can conveniently know the input operation.
In addition, the invention can also provide a visual system, which can be applied to industrial visual design and comprises the graphical programming device described in the above embodiment to realize operation visualization. Of course, in other embodiments, the system further comprises an image acquisition device and an image processing device, wherein the image acquisition device and the image processing device respectively acquire and process relevant information of the robot in the industrial visual design.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (20)
1. A graphical programming method, the method comprising:
displaying a first graphical element on a programming interface, wherein the first graphical element corresponds to a first function;
displaying tabular graphic elements on the programming interface, and displaying a connection relation between the tabular graphic elements and the first graphic elements, wherein the tabular graphic elements correspond to a second function for analyzing the operation result of the first function;
analyzing the operation result of the first function by using the second function, and displaying the analysis result on the list-type graphic element;
displaying a second graphic element on the programming interface, and displaying a connection relation between the tabular graphic element and the second graphic element, wherein the second graphic element corresponds to a third function;
and controlling the third function to execute a corresponding function by using the analysis result on the list-type graphic element.
2. The method of claim 1, wherein the parsing the result of the first function operation using the second function and displaying the parsed result on the tabular graphical element comprises:
and analyzing the logic variable in the operation result of the first function by using the second function, and displaying the logic variable on the list-type graphic element.
3. The method of claim 2, wherein the first function is used to obtain external information from the robot or an external input/output device;
the analyzing the logic variable in the operation result of the first function by using the second function, and adding the logic variable to the second graphic element includes:
and analyzing the logic variable in the external information by using the second function, and adding the logic variable to the second graphic element.
4. The method of claim 2, wherein the logical variable is a plurality;
the analyzing the logic variable in the operation result of the first function by using the second function, and displaying the logic variable on the tabular graphic element comprises:
and selecting the logic variable appointed by the user from the plurality of logic variables according to the appointments of the user, and displaying the logic variable appointed by the user on the tabular graphic element.
5. The method of claim 2, wherein the tabular graphic element is a logical list, and the parsing the logical variable in the result of the operation of the first function using the second function and displaying the logical variable on the tabular graphic element comprises:
and analyzing the logic variable in the operation result of the first function by using the second function, and displaying the logic variable in a corresponding column of the logic list.
6. The method of claim 5, wherein displaying a second graphical element on the programming interface and displaying a connection relationship between the parsing result and the second graphical element comprises:
and displaying a second graphic element on the programming interface, and displaying the connection relation between the second graphic element and the corresponding field.
7. The method of claim 5, further comprising, prior to displaying the tabular graphic element on the programming interface:
and setting the number of columns in the list-type graphic elements according to the designation of a user.
8. The method of claim 5, wherein displaying the logical variable in the corresponding field of the logical list comprises:
and displaying the logic variable in the corresponding first column according to the designation of the user.
9. The method of claim 8, wherein displaying the logical variable in the corresponding field of the logical list further comprises:
and displaying the first graphic element from which the logic variable is originated in the corresponding second column and/or displaying the user-defined description of the user in the corresponding third column according to the designation of the user.
10. The method of claim 8, wherein displaying the logical variable in the corresponding field of the logical list further comprises:
and calculating different logic variables in the logic list according to the designation of the user, and displaying the calculation result to the corresponding fourth column.
11. The method of claim 10, wherein displaying the connection between the parsing result and the second graphic element comprises:
displaying a connection relation between the fourth field and the second graphic element;
the controlling the third function to execute the corresponding function by using the analysis result on the tabular graphic element comprises:
and controlling the third function to execute a corresponding function by using the operation result.
12. The method of claim 2, wherein said controlling the third function to perform the corresponding function using the parsed result on the tabular graphic element comprises:
and controlling the third function to execute a corresponding control function or logic operation by using the logic variable.
13. The method according to claim 2, wherein at least two of the first graphic elements are connected by the same tabular graphic element, and wherein the first functions corresponding to the at least two first graphic elements are different;
the displaying the logical variable on the tabular graphic element comprises:
and simultaneously displaying the logic variables analyzed by the first functions corresponding to the at least two first graphic elements on the tabular graphic elements.
14. The method of claim 2, wherein the controlling the third function to perform the corresponding function using the parsed result comprises:
and controlling the third function to execute corresponding control function, logic operation and/or logic judgment according to the logic variable.
15. The method of claim 3, further comprising:
displaying a third graphic element on the programming interface, and displaying a connection relationship between the third graphic element and the second graphic element, wherein the third graphic element corresponds to a fourth function.
16. The method as recited in claim 15, wherein said method further comprises:
responding to the operation of a user on the third graphic element, displaying a dialog box on the programming interface, and displaying the execution information corresponding to the fourth function in the dialog box;
wherein: the execution information comprises at least one or a combination of setting parameters, intermediate data and an execution result of the fourth function;
the presentation form of the execution information comprises any one or combination of characters, graphs and lists.
17. The method of claim 16, wherein the execution information is plural;
the method further comprises:
and selecting the execution information specified by the user from the plurality of execution information according to the specification of the user, closing the dialog box, and displaying the execution information specified by the user around the corresponding third graphic element.
18. A graphical programming apparatus, the apparatus comprising a memory and a processor, wherein:
the memory for storing program instructions configured to be executed by the processor;
the processor executes the program instructions to implement the graphical programming method of any of claims 1-17.
19. A computer storage medium having stored thereon computer instructions executable by a processor to perform a graphical programming method as claimed in any one of claims 1 to 17.
20. A vision system, characterized in that it comprises a graphical programming device according to claim 18.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/101252 WO2019047218A1 (en) | 2017-09-11 | 2017-09-11 | Graphic programming method, device, computer storage medium, and vision system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109690473A CN109690473A (en) | 2019-04-26 |
| CN109690473B true CN109690473B (en) | 2022-04-15 |
Family
ID=65634539
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780036109.2A Active CN109690473B (en) | 2017-09-11 | 2017-09-11 | Graphical programming method and device, computer storage medium and visual system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109690473B (en) |
| WO (1) | WO2019047218A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110262791B (en) * | 2019-06-05 | 2023-10-10 | 北京蓝亚盒子科技有限公司 | Visual programming method and device, operator and readable storage medium |
| CN112306462B (en) * | 2019-08-02 | 2024-04-23 | 苏州精易会信息技术有限公司 | Building block type object variable block construction method, device, storage medium and processor |
| CN110497412A (en) * | 2019-08-26 | 2019-11-26 | 中科新松有限公司 | Robot graphic programming interactive system based on webpage and mobile terminal |
| CN111522542B (en) * | 2020-03-16 | 2023-10-27 | 北京编程猫科技有限公司 | Programming method and device for perfecting graphical programming building block tool |
| CN112988316B (en) * | 2021-05-19 | 2021-10-26 | 北京创源微致软件有限公司 | Industrial vision system development method based on BS architecture and storage medium |
| CN113763497B (en) * | 2021-08-11 | 2024-02-27 | 中广核工程有限公司 | Link relation management method, device, computer equipment and storage medium |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AUPQ966400A0 (en) * | 2000-08-24 | 2000-09-21 | Xemplex Pty Ltd | Method of graphically defining a formula |
| US20040259066A1 (en) * | 2000-09-12 | 2004-12-23 | Mary Chase | System and method for aiding conceptual organization by children |
| US9298428B2 (en) * | 2013-02-27 | 2016-03-29 | Keysight Technologies, Inc. | Graphical user interface editor that displays live data during editing |
| CN101650651B (en) * | 2009-09-17 | 2012-09-05 | 浙江大学 | Visualizing method of source code level program structure |
| CN101968745A (en) * | 2010-10-27 | 2011-02-09 | 深圳市五巨科技有限公司 | Development system and development method for application programs of mobile terminal |
| US9342277B2 (en) * | 2013-03-14 | 2016-05-17 | Oracle International Corporation | Method of searching data associated with nodes of a graphical program |
| CN103197929B (en) * | 2013-03-25 | 2016-03-30 | 中国科学院软件研究所 | A kind of graphic programming system and method for children-oriented |
| CN103552071A (en) * | 2013-10-16 | 2014-02-05 | 无锡信捷电气股份有限公司 | Intelligent robot programming method |
| CN105843630B (en) * | 2016-06-08 | 2019-04-19 | 江西洪都航空工业集团有限责任公司 | A method of it is developed based on robot graphic programming |
| CN106997285A (en) * | 2016-09-20 | 2017-08-01 | 遨博（北京）智能科技有限公司 | A kind of method and device of control machine people |
| CN106775765B (en) * | 2017-01-12 | 2020-10-27 | 武汉图灵创客科技有限公司 | Graphical programming system |
-
2017
- 2017-09-11 WO PCT/CN2017/101252 patent/WO2019047218A1/en active Application Filing
- 2017-09-11 CN CN201780036109.2A patent/CN109690473B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019047218A1 (en) | 2019-03-14 |
| CN109690473A (en) | 2019-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109690473B (en) | Graphical programming method and device, computer storage medium and visual system | |
| US10628022B2 (en) | Method and system for prototyping graphic user interface | |
| CN107273104B (en) | Processing method and device for configuration data structure | |
| CN108038894B (en) | Animation creation method, animation creation device, electronic equipment and computer-readable storage medium | |
| CN107908604B (en) | Report form graph generation method and device, computer equipment and storage medium | |
| US8234591B1 (en) | Undo and redo using thumbnails generated from a specific area of the image | |
| US10459696B2 (en) | Composable action flows | |
| CN111542825A (en) | Method for applying generative design to configuration of mechanical component | |
| CN108170425B (en) | Program code modification method and device and terminal equipment | |
| CN103150456B (en) | Under a kind of MATLAB environment, gui system makes method and system | |
| CN113407254B (en) | Form generation method and device, electronic equipment and storage medium | |
| CN116301735B (en) | Method, device and storage medium for organizing software elements into software data links | |
| CN111309413A (en) | Interface display method and device, electronic equipment and storage medium | |
| WO2015161775A1 (en) | Gui display method and apparatus, and terminal device | |
| US20180101294A1 (en) | Information generating system, information generating device, information generating method, and information generating program | |
| CN112130951A (en) | AI-based RPA flow generation end flow generation method, equipment and storage medium | |
| CN111124393A (en) | Editing method and platform of algorithm logic, electronic equipment and storage medium | |
| CN113238746A (en) | Hybrid programming control method, device, equipment and storage medium | |
| US10042816B2 (en) | Table generating apparatus, table generating method and recording medium containing program | |
| CN113342413B (en) | Method, apparatus, device, medium, and article for processing components | |
| WO2021212386A1 (en) | Method and apparatus for creating custom report form, electronic device and storage medium | |
| CN116361156A (en) | Smoking test method, computer device and computer readable storage medium for test case | |
| US10901569B2 (en) | Integration of tools | |
| CN111008012A (en) | Prototype design method, prototype design device, electronic product and storage medium | |
| CN117421005A (en) | Object interaction method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |