CN118170362A - Module creation method and device based on visual programming, electronic equipment and medium - Google Patents

Abstract

The disclosure relates to a module creation method, a device, an electronic device and a medium based on visual programming. The method comprises the following steps: responding to a custom module creation operation, displaying a module creation page, wherein the module creation page comprises a first module display area and a module creation area; and sequentially moving the plurality of functional modules in the first module display area to the module creation area to create a custom module, wherein the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent equipment to execute corresponding actions. The method enriches the modules which can be used in the visual programming process by creating the custom modules, can directly use the custom modules in the visual programming process, does not need to combine a plurality of functional modules, and is more convenient and quicker to use.

Description

Module creation method, device, electronic device and medium based on visual programming

Technical Field

The present disclosure relates to the field of computer technology, and in particular to a module creation method, device, electronic device and medium based on visual programming.

Background technique

In the field of computer technology, visual programming refers to allowing users to create programs by graphically operating program elements and control intelligent devices based on the created programs. The intelligent devices can be robots, robot dogs or other intelligent devices.

In the related art, electronic devices provide users with some basic function modules, and users can perform visual programming operations by moving the basic function modules, thereby controlling the smart device to implement the operations corresponding to the basic function modules. However, the basic function modules provided are relatively single, which leads to limited operations that can be implemented by smart devices and has limitations.

Summary of the invention

In order to overcome the problems existing in the related art, the present disclosure provides a module creation method, device, electronic device and medium based on visual programming.

According to a first aspect of an embodiment of the present disclosure, a module creation method based on visual programming is provided, which is applied to an electronic device, and the method includes:

In response to the custom module creation operation, displaying a module creation page, the module creation page including a first module display area and a module creation area;

Move the multiple function modules in the first module display area to the module creation area in sequence to create a custom module. The multiple function modules in the custom module are connected in sequence. The function modules are used to control the smart device to perform corresponding actions.

In some embodiments, the step of sequentially moving the plurality of function modules in the first module display area to the module creation area to create a custom module includes:

Moving the plurality of function modules in the first module display area to the module creation area in sequence to obtain a module combination, and running the module combination;

When the module combination is executable, the module combination is saved to obtain the custom module.

In some embodiments, the first module display area includes a plurality of function types, each of the function types includes a plurality of function modules, and the plurality of function modules in the first module display area are sequentially moved to the module creation area to obtain a module combination, including:

In response to a selection operation on a target function type, displaying function modules belonging to the target function type, the target function type being any one of the multiple function types;

Move multiple function modules belonging to the target function type to the module creation area in sequence to obtain the module combination.

In some embodiments, the method further comprises:

Move at least one function module belonging to the target function type to the task editing area in sequence, and in response to a selection operation of other function types except the target function type, display the function modules belonging to the other function types, and move at least one function module belonging to the other function types to the task editing area in sequence to obtain the module combination.

In some embodiments, the first module display area includes a custom function type, and after the plurality of function modules in the first module display area are sequentially moved to the module creation area and the custom module is created, the method further includes:

In response to a selection operation on the custom function type, the custom module is displayed.

In some embodiments, the method further comprises:

In response to the editing operation on the custom module, the custom module is edited to obtain an updated custom module.

In some embodiments, the method further comprises:

In response to a sharing operation on the custom module, the custom module is shared to a target page.

In some embodiments, in response to the custom module creation operation, displaying a module creation page includes:

Display the visual programming page;

In response to a selection operation on a custom module configuration option in the visual programming page, displaying a creation control corresponding to the custom module configuration option;

In response to a selection operation on the creation control, the module creation page is displayed.

In some embodiments, in response to the selection operation of the creation control, displaying the module creation page includes:

In response to a selection operation on the creation control, displaying a creation module window;

In the Create Module window, enter the module name of the custom module to be created;

In response to the determination operation of the module name, the module creation page is displayed.

In some embodiments, after the plurality of function modules in the first module display area are sequentially moved to the module creation area and a custom module is created, the method further comprises:

Based on the custom module, create a target task;

Based on the target task, the smart device is controlled so that the smart device performs corresponding actions according to the custom module in the target task.

In some embodiments, the creating a target task based on the custom module includes:

Displaying a task editing page, wherein the task editing page includes a second module display area and a task editing area;

Move the custom module in the second module display area to the task editing area to obtain the target task.

In some embodiments, moving the custom module in the second module display area to the task editing area to obtain the target task includes:

Move the multiple function modules and the custom module in the second module display area to the task editing area in sequence, and connect the multiple function modules and the custom module in sequence to obtain the target task, wherein the first module is connected to the start module in the task editing area, and the first module is the custom module or any one of the multiple function modules.

According to a second aspect of an embodiment of the present disclosure, there is provided a module creation device based on visual programming, which is applied to an electronic device, and the device includes:

A page display module, configured to display a module creation page in response to a custom module creation operation, wherein the module creation page includes a first module display area and a module creation area;

A creation module is configured to move multiple functional modules in the first module display area to the module creation area in sequence to create a custom module, in which the multiple functional modules are connected in sequence, and the functional module is used to control the smart device to perform corresponding actions.

In some embodiments, the creation module is configured to:

Moving the plurality of function modules in the first module display area to the module creation area in sequence to obtain a module combination, and running the module combination;

When the module combination is executable, the module combination is saved to obtain the custom module.

In some embodiments, the first module display area includes multiple function types, each of the function types includes multiple function modules, and the creation module is configured to:

In response to a selection operation on a target function type, displaying function modules belonging to the target function type, the target function type being any one of the multiple function types;

Move multiple function modules belonging to the target function type to the module creation area in sequence to obtain the module combination.

In some embodiments, the creation module is configured to:

Move at least one function module belonging to the target function type to the task editing area in sequence, and in response to a selection operation of other function types except the target function type, display the function modules belonging to the other function types, and move at least one function module belonging to the other function types to the task editing area in sequence to obtain the module combination.

In some embodiments, the first module display area includes a custom function type, and the device further includes:

The custom module display module is configured to display the custom module in response to a selection operation on the custom function type.

In some embodiments, the apparatus further comprises:

The custom module updating module is configured to edit the custom module in response to an editing operation on the custom module to obtain an updated custom module.

In some embodiments, the apparatus further comprises:

The custom module sharing module is configured to share the custom module to a target page in response to a sharing operation on the custom module.

In some embodiments, the page display module is configured to:

Display the visual programming page;

In response to a selection operation on a custom module configuration option in the visual programming page, displaying a creation control corresponding to the custom module configuration option;

In response to a selection operation on the creation control, the module creation page is displayed.

In some embodiments, the page display module is configured to:

In response to a selection operation on the creation control, displaying a creation module window;

In the Create Module window, enter the module name of the custom module to be created;

In response to the determination operation of the module name, the module creation page is displayed.

In some embodiments, the apparatus further comprises:

A task creation module, configured to create a target task based on the custom module;

The device control module is configured to control the smart device based on the target task so that the smart device performs corresponding actions according to the custom module in the target task.

In some embodiments, the task creation module is configured to:

Displaying a task editing page, wherein the task editing page includes a second module display area and a task editing area;

Move the custom module in the second module display area to the task editing area to obtain the target task.

In some embodiments, the task creation module is configured to:

Move the multiple function modules and the custom module in the second module display area to the task editing area in sequence, and connect the multiple function modules and the custom module in sequence to obtain the target task, wherein the first module is connected to the start module in the task editing area, and the first module is the custom module or any one of the multiple function modules.

According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

processor;

a memory for storing processor-executable instructions;

The processor is configured to execute the module creation method based on visual programming as described in any one of the first aspects of the embodiments of the present disclosure.

According to the fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute a module creation method based on visual programming as described in any one of the first aspect of an embodiment of the present disclosure.

The above method of the present disclosure has the following beneficial effects:

The module creation method based on visual programming provided by the embodiment of the present disclosure responds to the custom module creation operation and displays a module creation page including a first module display area and a module creation area. In the module creation page, multiple functional modules in the first module display area are moved to the module creation area in sequence to create a custom module. The multiple functional modules in the custom module are connected in sequence. The custom module includes the functions of the multiple functional modules, that is, the custom module is used to control the device to execute the actions corresponding to the multiple functional modules in sequence. By creating the custom module, the modules that can be used in the visual programming are enriched, and the custom module can be directly used in the visual programming process without combining multiple functional modules, so that the custom module can be reused, which is more convenient and quick to use.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

FIG1 is a flow chart showing a module creation method based on visual programming according to an exemplary embodiment;

FIG2 is a flow chart showing a module creation method based on visual programming according to an exemplary embodiment;

FIG3 is a schematic diagram of a visual programming page according to an exemplary embodiment;

FIG4 is a schematic diagram of a module creation page according to an exemplary embodiment;

FIG5 is a schematic diagram showing a module creation page according to an exemplary embodiment;

FIG6 is a schematic diagram of a visual programming page according to an exemplary embodiment;

FIG7 is a schematic diagram showing a module creation page according to an exemplary embodiment;

FIG8 is a flow chart showing a method for controlling a device based on visual programming according to an exemplary embodiment;

FIG9 is a device block diagram showing a module creation device based on visual programming according to an exemplary embodiment;

Fig. 10 is a block diagram of an electronic device according to an exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

The module creation method based on visual programming provided by the embodiment of the present disclosure is executed by an electronic device, which is a terminal. For example, the terminal is a smart phone, a tablet computer, a laptop computer, a desktop computer, etc. The terminal can also be called a user device, a portable terminal, a laptop terminal, a desktop terminal, etc.

FIG. 1 is a flow chart of a module creation method based on visual programming according to an exemplary embodiment. The method is executed by an electronic device. Referring to FIG. 1 , the method includes the following steps:

Step S101, in response to a custom module creation operation, a module creation page is displayed, the module creation page including a first module display area and a module creation area.

In an embodiment of the present disclosure, in order to create a custom module based on visual programming, a module creation page is provided, which includes a first module display area and a module creation area. The first module display area includes multiple functional modules, each functional module is used to control the smart device to perform a corresponding action, and the function that can be realized by each functional module is a single function. For example, a functional module can only control the smart device to perform one action. The module creation area is used to create a custom module based on the functional module.

Step S102, multiple function modules in the first module display area are moved to the module creation area in sequence, a custom module is created, multiple function modules in the custom module are connected in sequence, and the function modules are used to control the smart device to perform corresponding actions.

Since the function of the functional module is single, for example, a certain functional module can only control the intelligent device to perform a standing action, and another functional module can only control the intelligent device to perform a forward action, then if you want to realize the continuous action of controlling the intelligent device to perform standing and forward, you need to combine the two functional modules. In this way, if you need to control the intelligent device to perform this continuous action multiple times, you need to combine the functional modules multiple times, which is inefficient. In the embodiment of the present disclosure, in order to reduce the number of combinations and improve efficiency, the multiple functional modules in the first module display area are first moved to the module creation area in sequence, and a custom module is created. The custom module includes multiple functional modules. Therefore, when it is necessary to control the intelligent device to perform a series of actions corresponding to the multiple functional modules connected in sequence, the custom module can be directly used without using multiple functional modules for combination. The movement refers to selecting the functional module in the first module display area and moving the functional module to the module creation area. In the obtained custom module, the multiple functional modules are connected in sequence, and the multiple functional modules can be connected in sequence in the order of moving to the module creation area, or after the multiple functional modules are moved to the module creation area, the connection order between the multiple functional modules is adjusted by moving the functional modules in the module creation area.

The module creation method based on visual programming provided by the embodiment of the present disclosure responds to the custom module creation operation and displays a module creation page including a first module display area and a module creation area. In the module creation page, multiple functional modules in the first module display area are moved to the module creation area in sequence to create a custom module. The multiple functional modules in the custom module are connected in sequence. The custom module includes the functions of the multiple functional modules, that is, the custom module is used to control the device to execute the actions corresponding to the multiple functional modules in sequence. By creating the custom module, the modules that can be used in the visual programming are enriched, and the custom module can be directly used in the visual programming process without combining multiple functional modules, so that the custom module can be reused, which is more convenient and quick to use.

FIG. 2 is a flow chart of a module creation method based on visual programming according to an exemplary embodiment. The method is executed by an electronic device. Referring to FIG. 2 , the method includes the following steps:

Step S201, displaying a visual programming page.

Among them, the visual programming page is used for visual programming. The visual programming page includes action execution configuration options, custom module configuration options and sequence action configuration options. These three configuration options correspond to different editing operations. In the embodiment of the present disclosure, the creation of a custom module is explained for the custom module configuration option.

In some embodiments, a control application is installed in the electronic device. In response to a startup operation on the control application, the control application is opened and an initial interface of the control application is displayed. In response to a trigger operation on a visual programming button in the initial interface, the visual programming page is displayed.

Step S202, in response to a selection operation on a custom module configuration option in a visual programming page, displaying a creation control corresponding to the custom module configuration option.

In order to create a new custom module, the user selects the custom module configuration option, and the creation control corresponding to the custom module configuration option is displayed in the visual programming page, and the creation control is used to trigger the creation of the custom module. For example, referring to the visual programming page 301 shown in FIG3, the custom module configuration option is selected, and the creation control corresponding to the custom module configuration option is displayed in the visual programming page.

Step S203: In response to the selection operation of the creation control, a module creation page is displayed.

Among them, the selection operation includes single-click operation, double-click operation and other operations on the creation control. After the user selects the creation control, the module creation page is displayed, and the module creation page includes a first module display area and a module creation area. Among them, the first module display area displays multiple functional modules, and the module creation area is used to create a custom module. For example, referring to the module creation page shown in Figure 4, a module list is displayed on the left side of the module creation page, and the module list includes various types of functional modules such as motion, control, time, and display, and a module creation area is displayed on the right side.

In some embodiments, the module display area includes multiple function types, and each function type includes multiple function modules. For example, referring to the module creation page shown in FIG5 , a motion type in the first module display area is selected, and multiple function modules belonging to the motion type are displayed: a module for setting the forward or backward time length, a module for controlling the robot dog to stand up or lie down, etc.

In some embodiments, in response to the selection operation of the creation control, a module creation window is displayed; in the module creation window, the module name of the custom module to be created is input; in response to the confirmation operation of the module name, a module creation page is displayed. For example, referring to the visual programming page 601 shown in FIG6 , a module creation window is displayed in the visual programming page 601, and the user can input the name of the custom module in the name input area of the module creation window, and then click “Confirm” to display the subsequent module creation page.

In some embodiments, since it is necessary to test whether the custom module can run after the subsequent custom module is created, the module creation area also includes a start module, and the first functional module in the custom module is connected to the start module, so that the custom module can run. For example, refer to the start module "Start running the program" in the module creation page shown in Figure 4 or Figure 5.

Step S204, moving the multiple function modules in the first module display area to the module creation area in sequence to obtain a module combination, and running the module combination.

In the disclosed embodiment, when creating a custom module, the function module in the first module display area is moved to the module creation area, and multiple function modules are combined in the module creation area to obtain a module combination. Among them, moving a function module means that the user selects the function module and then moves the function module from the first module display area to the module creation area. For example, the user clicks on the function module, and then long presses the notification of the function module to perform a move operation, and moves the function module from the first module display area to the module creation area.

Among them, multiple functional modules in the module combination are connected in sequence, and multiple functional modules are connected in sequence means that multiple functional modules are connected together in a preset order, and the preset order can be the order in which multiple functional modules are moved to the module creation area, or can be other pre-set orders. For example, referring to the functional modules shown in Figure 5, each functional module has a groove on the upper side and a protrusion on the lower side, and the groove and the protrusion can match. When connecting, the protrusion of the previous functional module is matched with the groove of the next functional module, so that the two functional modules are connected.

In some embodiments, since the first module display area includes multiple function types, each function type includes multiple function modules, the multiple function modules used to create the custom module can be function modules belonging to the same function type, then the multiple function modules in the first module display area are moved to the module creation area in turn to obtain a module combination, including: in response to a selection operation on a target function type, displaying the function modules belonging to the target function type, the target function type is any function type among the multiple function types; moving the multiple function modules belonging to the target function type to the module creation area in turn to obtain a module combination.

In some embodiments, the multiple function modules used to create the target task may be function modules of different function types, then the multiple function modules in the first module display area are moved to the module creation area in sequence to obtain a module combination, including: moving at least one function module belonging to the target function type to the task editing area in sequence, and in response to the selection operation of other function types other than the target function type, displaying the function modules of other function types, and moving at least one function module belonging to other function types to the task editing area in sequence to obtain a module combination. Among them, the other function types may be one or more, and the function modules selected in each function type may be one or more, which is not limited in the embodiments of the present disclosure.

In the disclosed embodiment, running the module combination means: running the module combination, generating a programming code corresponding to the module combination, and making the smart device perform a corresponding action based on the programming code. If the action that the smart device can perform is consistent with the actions corresponding to the multiple functional modules in the module combination, it means that the functional module can operate normally. If the action that the smart device can perform is inconsistent with the actions corresponding to the multiple functional modules in the module combination, it means that the functional module cannot operate normally and the module combination needs to be readjusted.

Optionally, the electronic device needs to run the module combination when communicating with the smart device, so that the smart device performs corresponding actions based on the generated programming code. For example, the electronic device and the smart device can be connected by wireless communication via Bluetooth, and of course other methods can be used for connection. The embodiments of the present disclosure do not limit the specific method of communication connection.

Step S205, when the module combination is executable, the module combination is saved to obtain a custom module.

After obtaining the module combination, different functional modules may not be connected well, or other problems may cause the module combination to fail to operate normally. In the case that the module combination fails to operate normally, the module combination is saved, and the obtained custom module also fails to operate normally, which will affect the use of the subsequent custom module. Therefore, in the embodiment of the present disclosure, when the module combination is operable, the module combination is saved to obtain the custom module to ensure that the custom module can be used normally in the future. For example, the custom module includes a module for controlling standing up, a module for controlling walking forward, and a module for controlling turning left, and these three modules are connected in sequence, then the custom module can control the smart device to perform continuous actions: standing up, walking forward, and turning left.

In some embodiments, saving the module combination includes: saving multiple functional modules and the connection order between the multiple functional modules.

In some embodiments, after obtaining a custom module, the first module display area will include a custom function type, for example, referring to the module creation page shown in FIG7 , compared with FIG5 , a "custom" type is added to the first module display area. Afterwards, in response to a selection operation of the custom function type, the custom module is displayed, and the user can use the displayed custom module to create a task.

In some embodiments, after the created custom module is added to the custom function type, the custom module can be edited in response to an edit operation on the custom module to obtain an updated custom module. That is, the custom module can be modified after creation, for example, the connection order of the function modules in the custom module can be adjusted, or the function modules in the custom module can be deleted, or new function modules can be added to the custom module, etc.

In some embodiments, in response to a sharing operation on a custom module, the custom module is shared to a target page, which may be a page in a control application, and a user of the control application may view and use the custom module in the target page.

The module creation method based on visual programming provided by the embodiment of the present disclosure responds to the custom module creation operation and displays a module creation page including a first module display area and a module creation area. In the module creation page, multiple functional modules in the first module display area are moved to the module creation area in sequence to create a custom module. The multiple functional modules in the custom module are connected in sequence. The custom module includes the functions of the multiple functional modules, that is, the custom module is used to control the device to execute the actions corresponding to the multiple functional modules in sequence. By creating the custom module, the modules that can be used in the visual programming are enriched, and the custom module can be directly used in the visual programming process without combining multiple functional modules, so that the custom module can be reused, which is more convenient and quick to use.

In some embodiments, after creating a custom module, a target task may be created based on the custom module, and then based on the target task, the smart device may be controlled so that the smart device performs corresponding actions according to the custom module in the target task.

FIG8 is a flowchart of a method for controlling a device based on visual programming according to an exemplary embodiment. The method is executed by an electronic device and includes the following steps:

Step S801: displaying a task editing page, which includes a second module display area and a task editing area.

In the embodiment of the present disclosure, in order to control the intelligent device based on visual programming, a task editing page is provided, the task editing page includes a second module display area and a task editing area, the second module display area includes multiple function modules and at least one custom module, each function module and custom module is used to control the intelligent device to perform a corresponding action, the task editing area is used to create a task, and the task editing area includes a start module, the start module is the initial module of the task, and is used to indicate the start of a task. .

In some embodiments, a visual programming page is displayed, and in response to a selection operation of an action execution configuration option in the visual programming page, a newly created control corresponding to the action execution configuration option is displayed, and in response to the selection operation of the newly created control, a task editing page is displayed. The visual programming page is used for visual programming, and the visual programming page includes an action execution configuration option, a custom module configuration option, and a sequence action configuration option. These three configuration options correspond to different editing operations. In the embodiment of the present disclosure, the action execution configuration option is used to create a target task to control the smart device for explanation.

Optionally, in order to create a new task, the user selects an action execution configuration option, and a new control corresponding to the action execution configuration option is displayed in the visual programming page, and the new control is used to trigger the new task. The selection operation refers to a single-click operation, a double-click operation, and the like on the new control. After the user selects the new control, the task editing page is displayed.

Optionally, in response to a selection operation on a new control, a new task window is first displayed; in the new task window, a task name of the target task is input; in response to a confirmation operation on the task name, a task editing page is displayed.

Step S802, moving the custom module in the second module display area to the task editing area to obtain the target task.

In the embodiment of the present disclosure, when creating a target task, the target task is obtained by moving the custom module in the second module display area to the task editing area. Moving the custom module means that the user selects the custom module and then moves the custom module from the second module display area to the task editing area. For example, the user clicks on the custom module and then performs a move operation while long pressing the custom module to move the custom module from the second module display area to the task editing area.

In some embodiments, since the second module display area also includes other functional modules, multiple functional modules and custom modules in the second module display area can be moved to the task editing area in sequence, and the multiple functional modules and custom modules are connected in sequence to obtain the target task, wherein the first module is connected to the start module in the task editing area, and the first module is a custom module or any module of the multiple functional modules. Wherein, connecting multiple functional modules and custom modules in sequence means that multiple functional modules and custom modules are connected together in a preset order, and the preset order can be the order in which the multiple functional modules and custom modules are moved to the task editing area, or can be other pre-set orders.

In some embodiments, after obtaining the target task, the connection order of multiple functional modules and custom modules in the target task can be readjusted, or the functional modules or custom modules in the target task can be deleted, or new functional modules or custom modules can be added to the target task to obtain an updated target task.

Step S803: Based on the target task, control the smart device so that the smart device performs corresponding actions according to the custom module in the target task.

In some embodiments, in response to the running operation of the target task, a programming code corresponding to the target task is generated, and the programming code is sent to the smart device so that the smart device executes the actions corresponding to each module in the target task in sequence based on the programming code.

For the operation of the target task, in some embodiments, the operation includes any one of an immediate operation, a periodic operation, and a scheduled operation. The immediate operation refers to sending the programming code to the smart device immediately after the programming code is generated, the periodic operation refers to sending the programming code to the smart device according to a preset period after the programming code is generated, and the scheduled operation refers to sending the programming code to the smart device according to a preset time point after the programming code is generated. Optionally, the type of the operation is determined by setting the execution module. For example, the execution mode includes immediate execution, scheduled execution, and periodic execution. When immediate execution is selected, the subsequent execution is the immediate operation. When periodic execution is selected, the subsequent execution is the periodic operation. When scheduled execution is selected, the subsequent execution is the scheduled operation.

In some embodiments, each functional module has a corresponding programming code. For a custom module, when it is necessary to generate the programming code corresponding to the custom module, the programming code corresponding to each functional module included in the custom module is obtained, and the programming code corresponding to each functional module is combined according to the connection order of each functional module in the custom module to obtain the programming code corresponding to the custom module. Therefore, for a target task that only includes custom modules, generating the programming code corresponding to the target task includes: obtaining the programming code corresponding to each functional module included in the custom module, combining the programming code corresponding to each functional module according to the connection order of each functional module in the custom module, and obtaining the programming code corresponding to the target task.

In some embodiments, for a target task including multiple functional modules and a custom module, generating a programming code corresponding to the target task includes: determining the programming code corresponding to each of the multiple functional modules in the target task and the custom modules, and combining the programming codes corresponding to each of the multiple functional modules and the custom modules according to the connection order of the multiple functional modules and the custom modules to obtain the programming code corresponding to the target task.

The visual programming method provided by the embodiment of the present disclosure only requires writing the programming code corresponding to each functional module when setting each functional module, and then reusing the programming code corresponding to each functional module. Users do not need to repeatedly write the same programming code, which saves programming time and improves programming efficiency.

For smart devices, the smart devices need to be controlled by programming codes, so the electronic device sends the programming codes to the smart device, and the smart device runs the programming codes to sequentially execute the actions corresponding to each functional module and custom module in the target task. For example, multiple functional modules and custom modules in the target task write a continuous action, such as standing up, bowing, walking forward, and turning left. The programming code corresponding to the target task is generated and transmitted to the bottom layer of the robot dog, so that the robot dog can sequentially execute each action in the continuous action.

In some embodiments, when the smart device sequentially executes the action corresponding to each functional module in the target task, the functional module or custom module corresponding to the action currently executed by the smart device is highlighted in the task editing area. That is to say, in the process of running the programming code, the smart device can feed back the current operation status to the electronic device, and in the electronic device, the functional module or custom module corresponding to the action currently executed by the smart device is highlighted, so that the operation currently executed by the smart device is intuitively displayed in the task editing area, and the highlighted module and the action executed by the smart device can be compared to let the user know whether the smart device is executing the action according to the current target task, and if not, the user can find it in time. Among them, highlighting the functional module and the custom module means displaying the functional module and the custom module as a preset color, or displaying the functional module and the custom module as a different color from other modules that have not executed the corresponding action.

In some embodiments, the electronic device needs to control the smart device based on the target task when communicating with the smart device. For example, the electronic device and the smart device can be connected by wireless communication via Bluetooth, or other methods can be used for connection. The embodiments of the present disclosure do not limit the specific method of communication connection.

In addition, in some embodiments, the target task can also be saved. After the target task is saved, the target task is displayed on the visual programming page. Later, when the target task needs to be run again, the target task can be directly selected on the visual programming page to run. Optionally, the target task is saved in response to a trigger operation of a save control in the task editing page.

The method for controlling a device based on visual programming provided by an embodiment of the present disclosure includes, on a task editing page including a second module display area and a task editing area, moving a custom module and multiple functional modules in the second module display area to the task editing area to obtain a target task, wherein multiple functional modules and custom modules in the target task are connected in sequence, that is, by creating a target task, multiple functional modules and custom modules are combined, so that based on the target task, the intelligent device can be controlled to perform corresponding actions in sequence according to the connection sequence of multiple functional modules and custom modules in the target task. Compared with the single basic functional module in the related art, more complex control of the intelligent device can be performed by creating a target task, thereby enriching the control method of the intelligent device.

Furthermore, the disclosed embodiment provides a visual programming platform, based on which users can perform visual programming control on smart devices, and the visual programming platform has strong professionalism, supports professional parameters and modules, and can perform professional testing and operations. For users, the visual programming platform has very rich playability, which is conducive to helping users learn and educate visual programming.

FIG9 is a device block diagram of a module creation device based on visual programming according to an exemplary embodiment, which is applied to an electronic device. Referring to FIG9 , the device includes:

The page display module 901 is configured to display a module creation page in response to a custom module creation operation, wherein the module creation page includes a first module display area and a module creation area;

The creation module 902 is configured to move multiple functional modules in the first module display area to the module creation area in sequence, create a custom module, and connect multiple functional modules in the custom module in sequence. The functional module is used to control the smart device to perform corresponding actions.

The module creation device based on visual programming provided by the embodiment of the present disclosure responds to the custom module creation operation and displays a module creation page including a first module display area and a module creation area. In the module creation page, multiple functional modules in the first module display area are moved to the module creation area in sequence to create a custom module. The multiple functional modules in the custom module are connected in sequence. The custom module includes the functions of the multiple functional modules, that is, the custom module is used to control the device to execute the actions corresponding to the multiple functional modules in sequence. By creating the custom module, the modules that can be used in the visual programming are enriched, and the custom module can be directly used in the visual programming process without combining multiple functional modules, so that the custom module can be reused, which is more convenient and quick to use.

In some embodiments, the creation module 902 is configured to:

Move multiple function modules in the first module display area to the module creation area in sequence to obtain a module combination, and run the module combination;

When the module combination is operable, the module combination is saved to obtain a custom module.

In some embodiments, the first module display area includes multiple function types, each function type includes multiple function modules, and the creation module 902 is configured to:

In response to a selection operation on a target function type, displaying function modules belonging to the target function type, where the target function type is any one of the plurality of function types;

Move multiple function modules belonging to the target function type to the module creation area in sequence to obtain a module combination.

In some embodiments, the creation module 902 is configured to:

Move at least one function module belonging to the target function type to the task editing area in sequence, and in response to the selection operation of other function types except the target function type, display the function modules belonging to other function types, and move at least one function module belonging to other function types to the task editing area in sequence to obtain a module combination.

In some embodiments, the first module display area includes a custom function type, and the device further includes:

The custom module display module is configured to display the custom module in response to a selection operation on the custom function type.

In some embodiments, the apparatus further comprises:

The custom module updating module is configured to edit the custom module in response to an editing operation on the custom module to obtain an updated custom module.

In some embodiments, the apparatus further comprises:

The custom module sharing module is configured to share the custom module to a target page in response to a sharing operation on the custom module.

In some embodiments, the page display module 901 is configured to:

Display the visual programming page;

In response to a selection operation of a custom module configuration option in the visual programming page, displaying a creation control corresponding to the custom module configuration option;

In response to a selection operation on the create control, a module creation page is displayed.

In some embodiments, the page display module 901 is configured to:

In response to a selection operation on a creation control, displaying a creation module window;

In the Create Module window, enter the module name of the custom module to be created;

In response to the determination operation on the module name, a module creation page is displayed.

In some embodiments, the apparatus further comprises:

The task creation module is configured to create a target task based on the custom module;

The device control module is configured to control the smart device based on the target task so that the smart device performs corresponding actions according to the custom module in the target task.

In some embodiments, the task creation module is configured to:

Displaying a task editing page, the task editing page includes a second module display area and a task editing area;

Move the custom module in the second module display area to the task editing area to obtain the target task.

In some embodiments, the task creation module is configured to:

Move multiple functional modules and custom modules in the second module display area to the task editing area in sequence, and connect the multiple functional modules and custom modules in sequence to obtain the target task, wherein the first module is connected to the start module in the task editing area, and the first module is a custom module or any module among the multiple functional modules.

Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

An embodiment of the present disclosure further provides an electronic device, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the module creation method based on visual programming in the above embodiment.

FIG. 10 is a block diagram of an electronic device 1000 according to an exemplary embodiment.

10 , the electronic device 1000 may include one or more of the following components: a processing component 1002 , a memory 1004 , a power component 1006 , a multimedia component 1008 , an audio component 1010 , an input/output (I/O) interface 1012 , a sensor component 1014 , and a communication component 1016 .

The processing component 1002 generally controls the overall operation of the electronic device 1000, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1002 may include one or more processors 1020 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 1002 may include one or more modules to facilitate the interaction between the processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate the interaction between the multimedia component 1008 and the processing component 1002.

The memory 1004 is configured to store various types of data to support operations on the electronic device 1000. Examples of such data include instructions for any application or method operating on the electronic device 1000, contact data, phone book data, messages, pictures, videos, etc. The memory 1004 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

The power supply component 1006 provides power to various components of the electronic device 1000. The power supply component 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 1000.

The multimedia component 1008 includes a screen that provides an output interface between the electronic device 1000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1008 includes a front camera and/or a rear camera. When the electronic device 1000 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 1010 is configured to output and/or input audio signals. For example, the audio component 1010 includes a microphone (MIC), and when the electronic device 1000 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1004 or sent via the communication component 1016. In some embodiments, the audio component 1010 also includes a speaker for outputting audio signals.

I/O interface 1012 provides an interface between processing component 1002 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 1014 includes one or more sensors for providing various aspects of status assessment for the electronic device 1000. For example, the sensor assembly 1014 can detect the open/closed state of the electronic device 1000, the relative positioning of components, such as the display and keypad of the electronic device 1000, and the sensor assembly 1014 can also detect the position change of the electronic device 1000 or a component of the electronic device 1000, the presence or absence of user contact with the electronic device 1000, the orientation or acceleration/deceleration of the electronic device 1000, and the temperature change of the electronic device 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1014 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1016 is configured to facilitate wired or wireless communication between the electronic device 1000 and other devices. The electronic device 1000 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1016 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1016 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the electronic device 1000 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1004 including instructions, and the instructions can be executed by the processor 1020 of the electronic device 1000 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

The embodiments of the present disclosure also provide a non-temporary computer-readable storage medium. When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the module creation method based on visual programming in the above embodiments.

Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims (15)

1. A method of creating a module based on visual programming, applied to an electronic device, the method comprising:

responding to a custom module creation operation, displaying a module creation page, wherein the module creation page comprises a first module display area and a module creation area;

And sequentially moving the plurality of functional modules in the first module display area to the module creation area to create a custom module, wherein the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent equipment to execute corresponding actions.

2. The module creation method according to claim 1, wherein sequentially moving the plurality of function modules in the first module display area to the module creation area creates a custom module, comprising:

Sequentially moving a plurality of functional modules in the first module display area to the module creation area to obtain a module combination, and operating the module combination;

And under the condition that the module combination is operable, storing the module combination to obtain the custom module.

3. The module creation method according to claim 2, wherein the first module display area includes a plurality of function types, each of the function types includes a plurality of function modules, and the sequentially moving the plurality of function modules in the first module display area to the module creation area, to obtain a module combination, includes:

responding to a selection operation of a target function type, and displaying a function module belonging to the target function type, wherein the target function type is any one of the function types;

and sequentially moving the plurality of function modules belonging to the target function type to the module creation area to obtain the module combination.

4. A module creation method according to claim 3, characterized in that the method further comprises:

And sequentially moving at least one function module belonging to the target function type to the task editing area, displaying the function modules belonging to other function types in response to the selection operation of the other function types except the target function type, and sequentially moving at least one function module belonging to the other function types to the task editing area to obtain the module combination.

5. The module creation method of claim 1, wherein the first module display area includes a custom function type, the sequentially moving the plurality of function modules in the first module display area to the module creation area, and after creating the custom module, the method further comprises:

and responding to the selection operation of the custom function type, and displaying the custom module.

6. The module creation method of claim 5, further comprising:

And responding to the editing operation of the custom module, editing the custom module, and obtaining the updated custom module.

7. The module creation method of claim 6, further comprising:

And responding to the sharing operation of the custom module, and sharing the custom module to a target page.

8. The module creation method of claim 1, wherein the displaying the module creation page in response to the custom module creation operation comprises:

Displaying a visual programming page;

Responding to the selection operation of the custom module configuration options in the visual programming page, and displaying the creation controls corresponding to the custom module configuration options;

and responding to the selection operation of the creation control, and displaying the module creation page.

9. The module creation method of claim 8, wherein the displaying the module creation page in response to a selection operation of the creation control comprises:

Responding to the selection operation of the creation control, and displaying a creation module window;

inputting the module name of the custom module to be created in the creation module window;

And responding to the determining operation of the module name, and displaying the module creation page.

10. The module creation method according to claim 1, wherein the sequentially moving the plurality of function modules in the first module display area to the module creation area creates a custom module, the method further comprising:

creating a target task based on the custom module;

and controlling the intelligent equipment based on the target task so as to enable the intelligent equipment to execute corresponding actions according to the self-defining module in the target task.

11. The module creation method according to claim 10, wherein the creating a target task based on the custom module includes:

Displaying a task editing page, wherein the task editing page comprises a second module display area and a task editing area;

And moving the custom module in the second module display area to a task editing area to obtain a target task.

12. The method for creating a module according to claim 11, wherein said moving the custom module in the second module display area to a task editing area to obtain a target task includes:

And sequentially moving the plurality of functional modules and the custom module in the second module display area to a task editing area, and sequentially connecting the plurality of functional modules and the custom module to obtain the target task, wherein a first module is connected with a starting module in the task editing area, and the first module is the custom module or any one of the plurality of functional modules.

13. A module creation apparatus based on visual programming, the apparatus comprising:

The page display module is configured to respond to a custom module creation operation, display a module creation page, and the module creation page comprises a first module display area and a module creation area;

The creation module is configured to sequentially move the plurality of functional modules in the first module display area to the module creation area to create a custom module, the plurality of functional modules in the custom module are sequentially connected, and the functional modules are used for controlling the intelligent device to execute corresponding actions.

14. An electronic device, comprising:

A processor;

A memory for storing processor-executable instructions;

Wherein the processor is configured to perform the visualization programming based module creation method of any of claims 1-12.

15. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the visualization programming-based module creation method of any of claims 1-12.