CN118170362A - Module creation method and device based on visual programming, electronic equipment and medium - Google Patents

Module creation method and device based on visual programming, electronic equipment and medium Download PDF

Info

Publication number
CN118170362A
CN118170362A CN202211537481.0A CN202211537481A CN118170362A CN 118170362 A CN118170362 A CN 118170362A CN 202211537481 A CN202211537481 A CN 202211537481A CN 118170362 A CN118170362 A CN 118170362A
Authority
CN
China
Prior art keywords
module
creation
custom
function
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211537481.0A
Other languages
Chinese (zh)
Inventor
吕铁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Robot Technology Co ltd
Original Assignee
Beijing Xiaomi Robot Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Robot Technology Co ltd filed Critical Beijing Xiaomi Robot Technology Co ltd
Priority to CN202211537481.0A priority Critical patent/CN118170362A/en
Publication of CN118170362A publication Critical patent/CN118170362A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/30—Creation or generation of source code
    • G06F8/34—Graphical or visual programming
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/70—Software maintenance or management
    • G06F8/71—Version control; Configuration management
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Stored Programmes (AREA)

Abstract

The disclosure relates to a module creation method, a device, an electronic device and a medium based on visual programming. The method comprises the following steps: responding to a custom module creation operation, displaying a module creation page, wherein the module creation page comprises a first module display area and a module creation area; and sequentially moving the plurality of functional modules in the first module display area to the module creation area to create a custom module, wherein the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent equipment to execute corresponding actions. The method enriches the modules which can be used in the visual programming process by creating the custom modules, can directly use the custom modules in the visual programming process, does not need to combine a plurality of functional modules, and is more convenient and quicker to use.

Description

Module creation method and device based on visual programming, electronic equipment and medium
Technical Field
The disclosure relates to the field of computer technology, and in particular, to a module creation method, device, electronic equipment and medium based on visual programming.
Background
In the field of computer technology, visual programming refers to allowing a user to create a program from graphical operating program elements and control a smart device, which may be a robot, a robot dog, or other smart device, based on the created program.
In the related art, the electronic device provides some basic function modules for users, and the users can perform visual programming operation through moving the basic function modules, so as to control the intelligent device to realize the operation corresponding to the basic function modules. However, the basic functional modules are single, so that the intelligent device has limited operation and limitation.
Disclosure of Invention
In order to overcome the problems in the related art, the present disclosure provides a module creation method, apparatus, electronic device, and medium based on visual programming.
According to a first aspect of embodiments of the present disclosure, there is provided a module creation method based on visual programming, applied to an electronic device, the method including:
responding to a custom module creation operation, displaying a module creation page, wherein the module creation page comprises a first module display area and a module creation area;
And sequentially moving the plurality of functional modules in the first module display area to the module creation area to create a custom module, wherein the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent equipment to execute corresponding actions.
In some embodiments, the moving the plurality of functional modules in the first module display area to the module creation area sequentially creates a custom module, including:
Sequentially moving a plurality of functional modules in the first module display area to the module creation area to obtain a module combination, and operating the module combination;
And under the condition that the module combination is operable, storing the module combination to obtain the custom module.
In some embodiments, the first module display area includes a plurality of function types, each of the function types includes a plurality of function modules, and the sequentially moving the plurality of function modules in the first module display area to the module creation area, to obtain a module combination, includes:
responding to a selection operation of a target function type, and displaying a function module belonging to the target function type, wherein the target function type is any one of the function types;
and sequentially moving the plurality of function modules belonging to the target function type to the module creation area to obtain the module combination.
In some embodiments, the method further comprises:
And sequentially moving at least one function module belonging to the target function type to the task editing area, displaying the function modules belonging to other function types in response to the selection operation of the other function types except the target function type, and sequentially moving at least one function module belonging to the other function types to the task editing area to obtain the module combination.
In some embodiments, the first module display area includes a custom function type, and the moving the plurality of function modules in the first module display area to the module creation area sequentially creates a custom module, and after the creating the custom module, the method further includes:
and responding to the selection operation of the custom function type, and displaying the custom module.
In some embodiments, the method further comprises:
And responding to the editing operation of the custom module, editing the custom module, and obtaining the updated custom module.
In some embodiments, the method further comprises:
And responding to the sharing operation of the custom module, and sharing the custom module to a target page.
In some embodiments, the responding to the custom module creating operation, the display module creating the page includes:
Displaying a visual programming page;
Responding to the selection operation of the custom module configuration options in the visual programming page, and displaying the creation controls corresponding to the custom module configuration options;
and responding to the selection operation of the creation control, and displaying the module creation page.
In some embodiments, the displaying the module creation page in response to a selection operation of the creation control includes:
Responding to the selection operation of the creation control, and displaying a creation module window;
inputting the module name of the custom module to be created in the creation module window;
And responding to the determining operation of the module name, and displaying the module creation page.
In some embodiments, the method further includes, after sequentially moving the plurality of functional modules in the first module display area to the module creation area and creating the custom module:
creating a target task based on the custom module;
and controlling the intelligent equipment based on the target task so as to enable the intelligent equipment to execute corresponding actions according to the self-defining module in the target task.
In some embodiments, the creating the target task based on the custom module includes:
Displaying a task editing page, wherein the task editing page comprises a second module display area and a task editing area;
And moving the custom module in the second module display area to a task editing area to obtain a target task.
In some embodiments, the moving the custom module in the second module display area to the task editing area to obtain the target task includes:
And sequentially moving the plurality of functional modules and the custom module in the second module display area to a task editing area, and sequentially connecting the plurality of functional modules and the custom module to obtain the target task, wherein a first module is connected with a starting module in the task editing area, and the first module is the custom module or any one of the plurality of functional modules.
According to a second aspect of embodiments of the present disclosure, there is provided a module creation apparatus based on visual programming, applied to an electronic device, the apparatus including:
The page display module is configured to respond to a custom module creation operation, display a module creation page, and the module creation page comprises a first module display area and a module creation area;
The creation module is configured to sequentially move the plurality of functional modules in the first module display area to the module creation area to create a custom module, the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent device to execute corresponding actions.
In some embodiments, the creation module is configured to:
Sequentially moving a plurality of functional modules in the first module display area to the module creation area to obtain a module combination, and operating the module combination;
And under the condition that the module combination is operable, storing the module combination to obtain the custom module.
In some embodiments, the first module display area includes a plurality of function types, each of the function types including a plurality of function modules, the creation module configured to:
responding to a selection operation of a target function type, and displaying a function module belonging to the target function type, wherein the target function type is any one of the function types;
and sequentially moving the plurality of function modules belonging to the target function type to the module creation area to obtain the module combination.
In some embodiments, the creation module is configured to:
And sequentially moving at least one function module belonging to the target function type to the task editing area, displaying the function modules belonging to other function types in response to the selection operation of the other function types except the target function type, and sequentially moving at least one function module belonging to the other function types to the task editing area to obtain the module combination.
In some embodiments, the first module display area includes a custom function type, the apparatus further comprising:
And the custom module display module is configured to respond to the selection operation of the custom function type and display the custom module.
In some embodiments, the apparatus further comprises:
And the custom module updating module is configured to respond to the editing operation of the custom module, edit the custom module and obtain an updated custom module.
In some embodiments, the apparatus further comprises:
And the custom module sharing module is configured to share the custom module to a target page in response to the sharing operation of the custom module.
In some embodiments, the page display module is configured to:
Displaying a visual programming page;
Responding to the selection operation of the custom module configuration options in the visual programming page, and displaying the creation controls corresponding to the custom module configuration options;
and responding to the selection operation of the creation control, and displaying the module creation page.
In some embodiments, the page display module is configured to:
Responding to the selection operation of the creation control, and displaying a creation module window;
inputting the module name of the custom module to be created in the creation module window;
And responding to the determining operation of the module name, and displaying the module creation page.
In some embodiments, the apparatus further comprises:
the task creation module is configured to create a target task based on the customization module;
And the device control module is configured to control the intelligent device based on the target task so as to enable the intelligent device to execute corresponding actions according to the self-defining module in the target task.
In some embodiments, the task creation module is configured to:
Displaying a task editing page, wherein the task editing page comprises a second module display area and a task editing area;
And moving the custom module in the second module display area to a task editing area to obtain a target task.
In some embodiments, the task creation module is configured to:
And sequentially moving the plurality of functional modules and the custom module in the second module display area to a task editing area, and sequentially connecting the plurality of functional modules and the custom module to obtain the target task, wherein a first module is connected with a starting module in the task editing area, and the first module is the custom module or any one of the plurality of functional modules.
According to a third aspect of embodiments of the present disclosure, there is provided an electronic device, comprising:
A processor;
A memory for storing processor-executable instructions;
Wherein the processor is configured to perform the visualization programming based module creation method as described in any of the first aspects of the embodiments of the present disclosure.
According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer readable storage medium, which when executed by a processor of an electronic device, causes the electronic device to perform the method of module creation based on visual programming as in any of the first aspects of embodiments of the present disclosure.
The method has the following beneficial effects:
According to the module creation method based on the visual programming, the module creation page comprising the first module display area and the module creation area is displayed in response to the self-defined module creation operation, in the module creation page, a plurality of functional modules in the first module display area are sequentially moved to the module creation area to create the self-defined module, the plurality of functional modules in the self-defined module are sequentially connected, the self-defined module comprises the functions of the plurality of functional modules, namely, the self-defined module is used for controlling equipment to sequentially execute actions corresponding to the plurality of functional modules, and through the creation of the self-defined module, the modules which can be used in the visual programming process are enriched, and the self-defined module can be directly used in the visual programming process without combining the plurality of functional modules, so that the self-defined module can be repeatedly used, and is more convenient and quick in use.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a flow chart illustrating a method of module creation based on visual programming, according to an exemplary embodiment;
FIG. 2 is a flowchart illustrating a method of module creation based on visual programming, according to an exemplary embodiment;
FIG. 3 is a schematic diagram of a visual programming page shown in accordance with an exemplary embodiment;
FIG. 4 is a schematic diagram of a module creation page shown in accordance with an exemplary embodiment;
FIG. 5 is a schematic diagram of a module creation page shown in accordance with an exemplary embodiment;
FIG. 6 is a schematic diagram of a visual programming page shown in accordance with an exemplary embodiment;
FIG. 7 is a schematic diagram of a module creation page shown in accordance with an exemplary embodiment;
FIG. 8 is a flowchart illustrating a method of visually programming a control device in accordance with an exemplary embodiment;
FIG. 9 is a device block diagram illustrating a module creation device based on visual programming in accordance with an exemplary embodiment;
fig. 10 is a block diagram of an electronic device, according to an example embodiment.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
The module creation method based on the visual programming provided in the embodiments of the present disclosure is executed by an electronic device, where the electronic device is a terminal, for example, a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like, and the terminal may also be called a name of a user device, a portable terminal, a laptop terminal, a desktop terminal, and the like.
FIG. 1 is a flowchart illustrating a method of module creation based on visual programming, performed by an electronic device, see FIG. 1, according to an exemplary embodiment, the method comprising the steps of:
in step S101, in response to the custom module creation operation, a module creation page is displayed, the module creation page including a first module display area and a module creation area.
In an embodiment of the present disclosure, in order to create a custom module based on visual programming, a module creation page is provided, where the module creation page includes a first module display area and a module creation area, where the first module display area includes a plurality of function modules, each function module is configured to control an intelligent device to execute a corresponding action, and a function that can be implemented by each function module is a single function, for example, one function module can only control the intelligent device to execute one action, and the module creation area is configured to create the custom module based on the function module.
Step S102, sequentially moving a plurality of functional modules in the first module display area to a module creation area, creating a custom module, wherein the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent equipment to execute corresponding actions.
Because the function of the function module is single, for example, one function module can only control the intelligent device to execute the standing action, and the other function module can only control the intelligent device to execute the advancing action, if the continuous action of controlling the intelligent device to execute the standing and advancing is to be realized, the two function modules need to be combined, if the continuous action of controlling the intelligent device to execute a plurality of times is required, the function modules need to be combined a plurality of times, and the efficiency is low. In the embodiment of the disclosure, in order to reduce the number of times of combination and improve the efficiency, a plurality of functional modules in a first module display area are sequentially moved to a module creation area to create a custom module, where the custom module includes a plurality of functional modules, so when a series of actions corresponding to the plurality of functional modules that are sequentially connected need to be controlled by an intelligent device to execute, the custom module can be directly used without using the plurality of functional modules to perform combination. The moving refers to selecting a function module in the first module display area and moving the function module to the module creation area. The plurality of function modules are sequentially connected in the obtained custom module, and the plurality of function modules can be sequentially connected according to the sequence of moving to the module creation area, or the connection sequence among the plurality of function modules can be adjusted by moving the function modules in the module creation area after the plurality of function modules move to the module creation area.
According to the module creation method based on the visual programming, the module creation page comprising the first module display area and the module creation area is displayed in response to the self-defined module creation operation, in the module creation page, a plurality of functional modules in the first module display area are sequentially moved to the module creation area to create the self-defined module, the plurality of functional modules in the self-defined module are sequentially connected, the self-defined module comprises the functions of the plurality of functional modules, namely, the self-defined module is used for controlling equipment to sequentially execute actions corresponding to the plurality of functional modules, and through the creation of the self-defined module, the modules which can be used in the visual programming process are enriched, and the self-defined module can be directly used in the visual programming process without combining the plurality of functional modules, so that the self-defined module can be repeatedly used, and is more convenient and quick in use.
FIG. 2 is a flowchart illustrating a method of module creation based on visual programming, performed by an electronic device, see FIG. 2, according to an exemplary embodiment, the method comprising the steps of:
step S201, displaying a visual programming page.
The visual programming page is used for visual programming, and comprises an action execution configuration option, a custom module configuration option and a sequence action configuration option, wherein the three configuration options correspond to different editing operations, and in the embodiment of the disclosure, a custom module is created for description aiming at the custom module configuration option.
In some embodiments, a control application is installed in the electronic device, the control application is started in response to a start operation of the control application, an initial interface of the control application is displayed, and the visual programming page is displayed in response to a trigger operation of a visual programming button in the initial interface.
Step S202, responding to the selection operation of the custom module configuration options in the visual programming page, and displaying the creation controls corresponding to the custom module configuration options.
In order to create a new custom module, a user selects a custom module configuration option, a creation control corresponding to the custom module configuration option is displayed in a visual programming page, and the creation new control is used for triggering the creation custom module. For example, referring to the visual programming page 301 shown in fig. 3, the custom module configuration option is selected, and a creation control corresponding to the custom module configuration option is displayed on the visual programming page.
In step S203, the display module creates a page in response to a selection operation of the creation control.
Wherein the selection operation includes operations such as a single click operation, a double click operation, etc. on the creation control. After the user selects the create control, a module create page is displayed that includes a first module display area and a module create area. The first module display area is provided with a plurality of functional modules, and the module creation area is used for creating a custom module. For example, referring to the module creation page shown in fig. 4, a module list including various types of functional modules of movement, control, time, presentation, etc. is displayed on the left side of the module creation page, and a module creation area is displayed on the right side.
In some embodiments, the module display area includes a plurality of function types, each function type including a plurality of function modules. For example, referring to the module creation page shown in fig. 5, a motion type in the first module display area is selected, and a plurality of function modules belonging to the motion type are displayed: a module for setting forward or backward time length, a module for controlling a robot dog to stand or lie down, etc.
In some embodiments, a creation module window is displayed in response to a selection operation of a creation control; inputting the module name of the custom module to be created in the module creation window; in response to a determination of the module name, the display module creates a page. For example, referring to the visual programming page 601 shown in fig. 6, a creation module window is displayed in the visual programming page 601, and a user may input the name of a custom module in the name input area in the creation module window, click "confirm", and then display the subsequent module creation page.
In some embodiments, since it is further necessary to test whether the custom module is capable of running after the creation of the subsequent custom module, the module creation area further includes a start module, and the first function module in the custom module is connected to the start module, so that the custom module is capable of running. For example, see the start module "start running program" in the module creation page shown in fig. 4 or 5.
Step S204, sequentially moving the plurality of functional modules in the first module display area to the module creation area to obtain a module combination, and operating the module combination.
In the embodiment of the disclosure, when the custom module is created, the function modules in the first module display area are moved to the module creation area, and a plurality of function modules are combined in the module creation area to obtain a module combination. The moving the function module refers to that a user selects the function module and then moves the function module from the first module display area to the module creation area. For example, the user clicks the function module, and then performs a move operation to move the function module from the first module display area to the module creation area upon notification of the long press operation of the function module.
The plurality of functional modules in the module combination are sequentially connected, which means that the plurality of functional modules are connected together according to a preset sequence, and the preset sequence can be the sequence that the plurality of functional modules move to the module creation area or can be other preset sequences. For example, referring to the functional modules shown in fig. 5, each functional module has a recess on an upper side and a protrusion on a lower side, and the recess and the protrusion may be matched, and the protrusion of the previous functional module is matched with the recess of the next functional module when the connection is made, thereby connecting the two functional modules.
In some embodiments, since the first module display area includes a plurality of function types, each function type includes a plurality of function modules, the plurality of function modules for creating the custom module may be function modules belonging to the same function type, and then sequentially moving the plurality of function modules in the first module display area to the module creation area, to obtain a module combination, including: responding to the selection operation of the target function type, displaying the function module belonging to the target function type, wherein the target function type is any one of a plurality of function types; and sequentially moving the plurality of function modules belonging to the target function type to a module creation area to obtain a module combination.
In some embodiments, the plurality of functional modules used to create the target task may be functional modules belonging to different functional types, and then sequentially moving the plurality of functional modules in the first module display area to the module creation area, resulting in a module combination, includes: and sequentially moving at least one function module belonging to the target function type to a task editing area, displaying the function modules belonging to other function types in response to the selection operation of the other function types except the target function type, and sequentially moving at least one function module belonging to the other function types to the task editing area to obtain a module combination. Wherein, other function types can be one or more, and the selected function module in each function type can be one or more, this is not limited by the embodiment of the present disclosure.
In the embodiment of the present disclosure, the operation module combination refers to: and running the module combination to generate programming codes corresponding to the module combination, so that the intelligent equipment executes corresponding actions based on the programming codes. If the actions executed by the intelligent device are consistent with the actions corresponding to the plurality of functional modules in the module combination, the functional modules can normally operate, and if the actions executed by the intelligent device are inconsistent with the actions corresponding to the plurality of functional modules in the module combination, the functional modules cannot normally operate, and the module combination needs to be readjusted.
Optionally, the electronic device needs to run the module combination in case of a communication connection with the smart device, so that the smart device performs a corresponding action based on the generated programming code. For example, the electronic device and the intelligent device may be connected through bluetooth in a wireless communication manner, and of course, may also be connected in other manners.
Step S205, under the condition that the module combination is operable, the module combination is stored, and a self-defined module is obtained.
After the module combination is obtained, different functional modules may not be well connected, or other problems cause that the module combination cannot normally operate, and under the condition that the module combination cannot normally operate, the obtained custom module cannot normally operate, and the use of a subsequent custom module is affected. For example, the self-defining module includes a module for controlling standing up, a module for controlling forward movement and a module for controlling left turning, and the three modules are sequentially connected, so that the self-defining module can control the intelligent device to execute continuous actions: standing up, walking forward and turning left.
In some embodiments, saving the combination of modules includes: the plurality of functional modules and the connection order between the plurality of functional modules are stored.
In some embodiments, after the custom module is obtained, the first module display area may include custom function types, e.g., see the module creation page shown in FIG. 7, where there are more "custom" types in the first module display area than in FIG. 5. And then, responding to the selection operation of the custom function type, displaying the custom module, and enabling the user to create tasks by adopting the displayed custom module.
In some embodiments, after adding the created custom module to the custom function type, the custom module may also be edited in response to an editing operation on the custom module, resulting in an updated custom module. That is, the custom module may be changed after creation, for example, the connection order of the function modules in the custom module may be adjusted, or the function modules in the custom module may be deleted, or a new function module may be added to the custom module.
In some embodiments, in response to a sharing operation on a custom module, the custom module is shared to a target page, where the target page may be a page in a control application, and a user using the control application may view the custom module in the target page and use the custom module.
According to the module creation method based on the visual programming, the module creation page comprising the first module display area and the module creation area is displayed in response to the self-defined module creation operation, in the module creation page, a plurality of functional modules in the first module display area are sequentially moved to the module creation area to create the self-defined module, the plurality of functional modules in the self-defined module are sequentially connected, the self-defined module comprises the functions of the plurality of functional modules, namely, the self-defined module is used for controlling equipment to sequentially execute actions corresponding to the plurality of functional modules, and through the creation of the self-defined module, the modules which can be used in the visual programming process are enriched, and the self-defined module can be directly used in the visual programming process without combining the plurality of functional modules, so that the self-defined module can be repeatedly used, and is more convenient and quick in use.
In some embodiments, after the custom module is created, a target task may also be created based on the custom module, and then the intelligent device is controlled based on the target task, so that the intelligent device performs a corresponding action according to the custom module in the target task.
FIG. 8 is a flowchart illustrating a method for visually programming a control device, the method performed by an electronic device, the method comprising the steps of:
Step S801 displays a task editing page including a second module display area and a task editing area.
In an embodiment of the disclosure, in order to control an intelligent device based on visual programming, a task editing page is provided, where the task editing page includes a second module display area and a task editing area, the second module display area includes a plurality of functional modules and at least one custom module, each functional module and custom module are used to control the intelligent device to execute a corresponding action, the task editing area is used to create a task, and the task editing area includes a start module, where the start module is an initial module of a task and is used to instruct start of a task. .
In some embodiments, a visual programming page is displayed, a new control corresponding to the configuration option is displayed in response to a selection operation of the configuration option being performed on an action in the visual programming page, and a task editing page is displayed in response to a selection operation of the new control. The visual programming page is used for visual programming, and comprises an action execution configuration option, a custom module configuration option and a sequence action configuration option, wherein the three configuration options correspond to different editing operations, and in the embodiment of the disclosure, the target task is created to control the intelligent device for explanation aiming at the action execution configuration option.
Optionally, in order to create a new task, the user selects an action execution configuration option, and a new control corresponding to the action execution configuration option is displayed in the visual programming page, where the new control is used for triggering the new task. The selection operation refers to operations such as a single click operation, a double click operation and the like on the newly built control. After the user selects the new control, a task editing page is displayed.
Optionally, in response to a selection operation of the new control, displaying a new task window; in the newly-built task window, inputting the task name of the target task; and in response to the determination operation of the task name, displaying a task editing page.
Step S802, moving the user-defined module in the second module display area to the task editing area to obtain the target task.
In the embodiment of the disclosure, when the target task is created, the target task is obtained by moving the custom module in the second module display area to the task editing area. The moving the self-defining module refers to that a user selects the self-defining module and then moves the self-defining module from the second module display area to the task editing area. For example, the user clicks the custom module, and then performs a movement operation while operating the custom module for a long time, and moves the custom module from the second module display area to the task editing area.
In some embodiments, since the second module display area further includes other functional modules, the plurality of functional modules and the custom module in the second module display area may be sequentially moved to the task editing area, and the plurality of functional modules and the custom module may be sequentially connected to obtain the target task, where the first module is connected to the start module in the task editing area, and the first module is the custom module or any one of the plurality of functional modules. The step of sequentially connecting the plurality of functional modules and the custom module means that the plurality of functional modules and the custom module are connected together according to a preset sequence, wherein the preset sequence can be the sequence of the plurality of functional modules and the custom module moving to the task editing area or other preset sequences.
In some embodiments, after the target task is obtained, the connection sequence of the multiple functional modules and the custom module in the target task may be readjusted, or the functional modules or the custom modules in the target task may be deleted, or new functional modules or custom modules may be added to the target task, so as to obtain an updated target task.
Step 803, based on the target task, the intelligent device is controlled to execute the corresponding action according to the custom module in the target task.
In some embodiments, in response to a running operation on a target task, a programming code corresponding to the target task is generated, and the programming code is sent to the intelligent device, so that the intelligent device sequentially executes actions corresponding to each module in the target task based on the programming code.
For the operation on the target task, in some embodiments, the operation includes any one of an immediate operation, a periodic operation, and a timing operation, where the immediate operation is immediately sent to the smart device after the programming code is generated, the periodic operation is sent to the smart device according to a preset period after the programming code is generated, and the timing operation is sent to the smart device according to a preset point in time after the programming code is generated. Optionally, the execution mode includes, for example, immediate execution, timed execution and periodic execution, where the execution mode includes immediate execution, periodic execution, and where the subsequent execution is the immediate execution, where the periodic execution is selected, where the subsequent execution is the periodic execution, and where the timed execution is selected, where the subsequent execution is the timed execution.
In some embodiments, each function module has a corresponding programming code, and when the custom module needs to generate the programming code corresponding to the custom module, the programming code corresponding to each function module included in the custom module is obtained, and the programming codes corresponding to each function module are combined according to the connection sequence of each function module in the custom module, so as to obtain the programming code corresponding to the custom module. Thus, for a target task that only includes a custom module, generating programming code corresponding to the target task includes: and acquiring programming codes corresponding to each functional module included in the custom module, and combining the programming codes corresponding to each functional module according to the connection sequence of each functional module in the custom module to obtain the programming codes corresponding to the target tasks.
In some embodiments, for a target task including a plurality of functional modules and a custom module, generating programming code corresponding to the target task includes: determining programming codes corresponding to a plurality of functional modules in the target task and each functional module in the custom module, and combining the programming codes corresponding to the functional modules in the target task and each functional module in the custom module according to the connection sequence of the functional modules and the custom module to obtain the programming codes corresponding to the target task.
According to the visual programming mode provided by the embodiment of the disclosure, when each functional module is set, programming codes corresponding to each functional module are written, and then the programming codes corresponding to each functional module are reused.
For the intelligent device, the intelligent device needs to be controlled through programming codes, so that the electronic device sends the programming codes to the intelligent device, and the intelligent device runs the programming codes, so that actions corresponding to each functional module and the custom module in the target task are sequentially executed. For example, the multiple functional modules and the custom modules in the target task write a continuous action, such as standing up, making a way, going forward, turning left, generating programming codes corresponding to the target task, and transmitting the programming codes to the bottom layer of the machine dog, so that the machine dog can execute each action in the continuous action in turn.
In some embodiments, when the intelligent device sequentially executes the action corresponding to each function module in the target task, the function module or the custom module corresponding to the action currently executed by the intelligent device is highlighted in the task editing area. That is, the intelligent device can feed back the current running condition to the electronic device in the process of running the programming code, and the function module or the custom module corresponding to the current executing action of the intelligent device is highlighted in the electronic device, so that the current executing operation of the intelligent device is intuitively displayed in the task editing area, and the highlighted module and the action executed by the intelligent device can be compared, so that a user can know whether the intelligent device executes the action according to the current target task or not, and if not, the user can find in time. The highlighting of the functional module and the custom module refers to displaying the functional module and the custom module as preset colors, or displaying the functional module and the custom module as colors different from those of other modules which do not execute corresponding actions.
In some embodiments, the electronic device needs to control the smart device based on the target task in the case of a communication connection with the smart device. For example, the electronic device and the intelligent device may be connected through bluetooth in a wireless communication manner, and of course, may also be connected in other manners.
In addition, in some embodiments, a target task may be saved, after the target task is saved, the target task is displayed on the visual programming page, and when the target task needs to be run again, the target task may be directly selected on the visual programming page to be run. Optionally, the target task is saved in response to a trigger operation of a save control in the task edit page.
In the method based on the visual programming control device provided by the embodiment of the disclosure, in the task editing page including the second module display area and the task editing area, the user-defined module and the plurality of functional modules in the second module display area are moved to the task editing area to obtain the target task, the plurality of functional modules and the user-defined module in the target task are sequentially connected, that is, the target task is created, the plurality of functional modules and the user-defined module are combined, so that the intelligent device can be controlled based on the target task to sequentially execute corresponding actions according to the connection sequence of the plurality of functional modules and the user-defined module in the target task.
In addition, the embodiment of the disclosure provides a visual programming platform, and a user can perform visual programming control on the intelligent device based on the visual programming platform, and the visual programming platform has strong specialty, supports professional parameters and modules, and can perform professional test and operation. For users, the visual programming platform has very rich playability, and is beneficial to helping the users to carry out learning education of visual programming.
Fig. 9 is an apparatus block diagram of a module creation apparatus based on visual programming, according to an exemplary embodiment, applied to an electronic device, see fig. 9, the apparatus including:
A page display module 901 configured to display a module creation page including a first module display area and a module creation area in response to a custom module creation operation;
the creating module 902 is configured to sequentially move the plurality of functional modules in the first module display area to the module creating area, create a custom module, where the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used to control the intelligent device to execute corresponding actions.
According to the module creation device based on the visual programming, a module creation page comprising a first module display area and a module creation area is displayed in response to a user-defined module creation operation, in the module creation page, a plurality of functional modules in the first module display area are sequentially moved to the module creation area to create the user-defined module, the plurality of functional modules in the user-defined module are sequentially connected, the user-defined module comprises functions of the plurality of functional modules, namely, the user-defined module is used for controlling equipment to sequentially execute actions corresponding to the plurality of functional modules, and through the creation of the user-defined module, the modules which can be used in the visual programming process are enriched, and the user-defined module can be directly used in the visual programming process without combining the plurality of functional modules, so that the user-defined module can be repeatedly used, and is more convenient and quick in use.
In some embodiments, creation module 902 is configured to:
sequentially moving a plurality of functional modules in a first module display area to a module creation area to obtain a module combination, and operating the module combination;
And under the condition that the module combination is operable, storing the module combination to obtain the self-defined module.
In some embodiments, the first module display area includes a plurality of function types, each function type including a plurality of function modules, the creation module 902 configured to:
Responding to the selection operation of the target function type, displaying the function module belonging to the target function type, wherein the target function type is any one of a plurality of function types;
and sequentially moving the plurality of function modules belonging to the target function type to a module creation area to obtain a module combination.
In some embodiments, creation module 902 is configured to:
and sequentially moving at least one function module belonging to the target function type to a task editing area, displaying the function modules belonging to other function types in response to the selection operation of the other function types except the target function type, and sequentially moving at least one function module belonging to the other function types to the task editing area to obtain a module combination.
In some embodiments, the first module display region includes a custom function type, the apparatus further comprising:
and the custom module display module is configured to respond to the selection operation of the custom function type and display the custom module.
In some embodiments, the apparatus further comprises:
the self-defining module updating module is configured to respond to the editing operation of the self-defining module, edit the self-defining module and obtain the updated self-defining module.
In some embodiments, the apparatus further comprises:
and the custom module sharing module is configured to share the custom module to the target page in response to the sharing operation of the custom module.
In some embodiments, the page display module 901 is configured to:
Displaying a visual programming page;
Responding to the selection operation of the custom module configuration options in the visual programming page, and displaying the creation controls corresponding to the custom module configuration options;
In response to a selection operation of the creation control, the display module creates a page.
In some embodiments, the page display module 901 is configured to:
Responding to the selection operation of the creation control, and displaying a creation module window;
Inputting the module name of the custom module to be created in the module creation window;
In response to a determination of the module name, the display module creates a page.
In some embodiments, the apparatus further comprises:
The task creation module is configured to create a target task based on the custom module;
And the device control module is configured to control the intelligent device based on the target task so as to enable the intelligent device to execute corresponding actions according to the self-defining module in the target task.
In some embodiments, the task creation module is configured to:
displaying a task editing page, wherein the task editing page comprises a second module display area and a task editing area;
And moving the custom module in the second module display area to a task editing area to obtain a target task.
In some embodiments, the task creation module is configured to:
And sequentially moving the plurality of functional modules and the custom modules in the second module display area to the task editing area, and sequentially connecting the plurality of functional modules and the custom modules to obtain a target task, wherein a first module is connected with a starting module in the task editing area, and the first module is the custom module or any one of the plurality of functional modules.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
The embodiment of the disclosure also provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the visualization programming based module creation method of the above embodiments.
Fig. 10 is a block diagram of an electronic device 1000, shown in accordance with an exemplary embodiment.
Referring to fig. 10, an electronic device 1000 may include one or more of the following components: a processing component 1002, a memory 1004, a power component 1006, a multimedia component 1008, an audio component 1010, an input/output (I/O) interface 1012, a sensor component 1014, and a communication component 1016.
The processing component 1002 generally controls overall operation of the electronic device 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1002 can include one or more processors 1020 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 1002 can include one or more modules that facilitate interaction between the processing component 1002 and other components. For example, the processing component 1002 can include a multimedia module to facilitate interaction between the multimedia component 1008 and the processing component 1002.
The memory 1004 is configured to store various types of data to support operations at the electronic device 1000. Examples of such data include instructions for any application or method operating on the electronic device 1000, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1004 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply component 1006 provides power to the various components of the electronic device 1000. The power components 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 1000.
The multimedia component 1008 includes a screen between the electronic device 1000 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia assembly 1008 includes a front-facing camera and/or a rear-facing camera. When the electronic device 1000 is in an operational mode, such as a shooting mode or a video mode, the front-facing camera and/or the rear-facing camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 1010 is configured to output and/or input audio signals. For example, the audio component 1010 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 1000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in memory 1004 or transmitted via communication component 1016. In some embodiments, the audio component 1010 further comprises a speaker for outputting audio signals.
The I/O interface 1012 provides an interface between the processing assembly 1002 and peripheral interface modules, which may be a keyboard, click wheel, buttons, and the like. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 1014 includes one or more sensors for providing status assessment of various aspects of the electronic device 1000. For example, the sensor assembly 1014 may detect an on/off state of the electronic device 1000, a relative positioning of components such as a display and keypad of the electronic device 1000, the sensor assembly 1014 may also detect a change in position of the electronic device 1000 or a component of the electronic device 1000, the presence or absence of a user's contact with the electronic device 1000, an orientation or acceleration/deceleration of the electronic device 1000, and a change in temperature of the electronic device 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 can also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1016 is configured to facilitate communication between the electronic device 1000 and other devices, either wired or wireless. The electronic device 1000 may access a wireless network based on a communication standard, such as WiFi,2G, or 3G, or a combination thereof. In one exemplary embodiment, the communication component 1016 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1016 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 1000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 1004, including instructions executable by processor 1020 of electronic device 1000 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
The disclosed embodiments also provide a non-transitory computer readable storage medium, which when executed by a processor of an electronic device, enables the electronic device to perform the visual programming-based module creation method of the above embodiments.
Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (15)

1. A method of creating a module based on visual programming, applied to an electronic device, the method comprising:
responding to a custom module creation operation, displaying a module creation page, wherein the module creation page comprises a first module display area and a module creation area;
And sequentially moving the plurality of functional modules in the first module display area to the module creation area to create a custom module, wherein the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent equipment to execute corresponding actions.
2. The module creation method according to claim 1, wherein sequentially moving the plurality of function modules in the first module display area to the module creation area creates a custom module, comprising:
Sequentially moving a plurality of functional modules in the first module display area to the module creation area to obtain a module combination, and operating the module combination;
And under the condition that the module combination is operable, storing the module combination to obtain the custom module.
3. The module creation method according to claim 2, wherein the first module display area includes a plurality of function types, each of the function types includes a plurality of function modules, and the sequentially moving the plurality of function modules in the first module display area to the module creation area, to obtain a module combination, includes:
responding to a selection operation of a target function type, and displaying a function module belonging to the target function type, wherein the target function type is any one of the function types;
and sequentially moving the plurality of function modules belonging to the target function type to the module creation area to obtain the module combination.
4. A module creation method according to claim 3, characterized in that the method further comprises:
And sequentially moving at least one function module belonging to the target function type to the task editing area, displaying the function modules belonging to other function types in response to the selection operation of the other function types except the target function type, and sequentially moving at least one function module belonging to the other function types to the task editing area to obtain the module combination.
5. The module creation method of claim 1, wherein the first module display area includes a custom function type, the sequentially moving the plurality of function modules in the first module display area to the module creation area, and after creating the custom module, the method further comprises:
and responding to the selection operation of the custom function type, and displaying the custom module.
6. The module creation method of claim 5, further comprising:
And responding to the editing operation of the custom module, editing the custom module, and obtaining the updated custom module.
7. The module creation method of claim 6, further comprising:
And responding to the sharing operation of the custom module, and sharing the custom module to a target page.
8. The module creation method of claim 1, wherein the displaying the module creation page in response to the custom module creation operation comprises:
Displaying a visual programming page;
Responding to the selection operation of the custom module configuration options in the visual programming page, and displaying the creation controls corresponding to the custom module configuration options;
and responding to the selection operation of the creation control, and displaying the module creation page.
9. The module creation method of claim 8, wherein the displaying the module creation page in response to a selection operation of the creation control comprises:
Responding to the selection operation of the creation control, and displaying a creation module window;
inputting the module name of the custom module to be created in the creation module window;
And responding to the determining operation of the module name, and displaying the module creation page.
10. The module creation method according to claim 1, wherein the sequentially moving the plurality of function modules in the first module display area to the module creation area creates a custom module, the method further comprising:
creating a target task based on the custom module;
and controlling the intelligent equipment based on the target task so as to enable the intelligent equipment to execute corresponding actions according to the self-defining module in the target task.
11. The module creation method according to claim 10, wherein the creating a target task based on the custom module includes:
Displaying a task editing page, wherein the task editing page comprises a second module display area and a task editing area;
And moving the custom module in the second module display area to a task editing area to obtain a target task.
12. The method for creating a module according to claim 11, wherein said moving the custom module in the second module display area to a task editing area to obtain a target task includes:
And sequentially moving the plurality of functional modules and the custom module in the second module display area to a task editing area, and sequentially connecting the plurality of functional modules and the custom module to obtain the target task, wherein a first module is connected with a starting module in the task editing area, and the first module is the custom module or any one of the plurality of functional modules.
13. A module creation apparatus based on visual programming, the apparatus comprising:
The page display module is configured to respond to a custom module creation operation, display a module creation page, and the module creation page comprises a first module display area and a module creation area;
The creation module is configured to sequentially move the plurality of functional modules in the first module display area to the module creation area to create a custom module, the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent device to execute corresponding actions.
14. An electronic device, comprising:
A processor;
A memory for storing processor-executable instructions;
Wherein the processor is configured to perform the visualization programming based module creation method of any of claims 1-12.
15. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the visualization programming-based module creation method of any of claims 1-12.
CN202211537481.0A 2022-12-02 2022-12-02 Module creation method and device based on visual programming, electronic equipment and medium Pending CN118170362A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211537481.0A CN118170362A (en) 2022-12-02 2022-12-02 Module creation method and device based on visual programming, electronic equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211537481.0A CN118170362A (en) 2022-12-02 2022-12-02 Module creation method and device based on visual programming, electronic equipment and medium

Publications (1)

Publication Number Publication Date
CN118170362A true CN118170362A (en) 2024-06-11

Family

ID=91357102

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211537481.0A Pending CN118170362A (en) 2022-12-02 2022-12-02 Module creation method and device based on visual programming, electronic equipment and medium

Country Status (1)

Country Link
CN (1) CN118170362A (en)

Similar Documents

Publication Publication Date Title
CN107908351B (en) Application interface display method and device and storage medium
CN106537319A (en) Screen-splitting display method and device
CN113238752B (en) Code generation method, device, electronic equipment and storage medium
CN106775202B (en) Information transmission method and device
CN106020682A (en) Multi-task management method and device
CN106354504B (en) Message display method and device
CN111866571B (en) Method and device for editing content on smart television and storage medium
CN111814088A (en) Page processing method and device
US20230097879A1 (en) Method and apparatus for producing special effect, electronic device and storage medium
CN114282022A (en) Multimedia editing method and device, electronic equipment and storage medium
CN110782510A (en) Sticker generation method and device
CN114727150B (en) Video editing method, video editing device and storage medium
CN113919311B (en) Data display method and device, electronic equipment and storage medium
CN114047862B (en) Interface control method and device, equipment and storage medium
CN113112290B (en) Virtual resource adjusting method and device
CN111538450B (en) Theme background display method and device and storage medium
CN118170362A (en) Module creation method and device based on visual programming, electronic equipment and medium
CN118170081A (en) Method and device for controlling equipment based on visual programming, electronic equipment and medium
CN108958300B (en) Tripod head control method and device
CN107360315B (en) Information display method and device
CN111580875B (en) Parameter configuration method, device and storage medium
CN111857900B (en) Information setting method and device and electronic equipment
CN112506393B (en) Icon display method and device and storage medium
CN111443759B (en) Display control method, display control device, electronic equipment and computer-readable storage medium
CN114880219B (en) Test node configuration method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination