TWI787728B - Method for generating a human-machine interface, computer program product and human-machine interface device - Google Patents

Abstract

The present invention provides a method for generating a human-machine interface, a computer program product and a human-machine interface device. The method for generating a human-machine interface includes: at a computing device, generating a visual programming interface for an operation of a graphical control component on a development interface of a human-machine interface, the visual programming interface being displayed on a display device in communication with the computing device, wherein the visual programming interface includes multiple graphical elements each associated with an instruction code element, configured to be connected with other graphical element on the visual programming interface to generate computer code; and receiving a command through the computing device to deposit at least one graphical element on the visual programming interface to generate an instruction code associated with the operation.

Description

Man-machine interface development method, computer program product, and man-machine interface device

The present invention relates to the field of information technology, in particular to a man-machine interface development method, a computer program product for man-machine interface development, and a man-machine interface device.

Human-Machine Interface (Human-Mankind Interface) is the interface between the machine and the user. Through the human-machine interface, the user can input operation instructions to the machine, and the machine can feedback the execution status of the operation instruction to the user through the human-machine interface. . In addition, through the man-machine interface, the machine can also report the internal system status to the user at any time. With the development of science and technology, industrial operations and daily life are digitized, and the demand for human-machine interface in the market is becoming more and more popular. Therefore, providing a man-machine interface development environment with convenient operation has become one of the important development goals in this field.

Traditional human-machine interface development uses code as a tool, and usually requires writing a large amount of code to develop a human-machine interface, which is time-consuming and labor-intensive. As the demand for the development environment of the man-machine interface increases, a man-machine interface design platform with a graphical interface has been generally developed in the prior art, in which the man-machine interface can be completed by dragging the graphical interface application program (widget) onto the design interface. The layout of the interface. However, in the conventional man-machine interface, the interaction between each graphical interface application program and the interaction with the controlled machine must still be realized by writing program codes. Therefore, in the prior art, the designer of the human-machine interface must be familiar with a certain programming language, which increases the technical threshold and development cost of the human-machine interface design. In addition, it is difficult to avoid coding errors in program design, and error detection must be carried out, which further increases the cost of development.

Therefore, one of the main purposes of the present invention is to provide a human-machine interface development method, a computer program product for human-machine interface development, and a human-machine interface device, which integrate a visual code programming interface, so that the human-machine interface development Efficiency is improved, technical barriers are lowered, and development costs are reduced.

One of the technical solutions of the embodiments of the present invention is to provide a human-machine interface development method, including: on a computing device, aiming at a graphical control element in a human-machine interface development interface, generating a visual image corresponding to the operation of the graphical control element a visual programming interface, the visual programming interface is displayed on a display signal connected to the computing device, wherein the visual programming interface includes a plurality of graphical objects, each of which is associated with a code element for for connecting with other such icon objects on the visual programming interface to generate code; and receiving an input instruction through the computing device, the input instruction instructs to place at least one of the icon objects on the visual programming interface, to An instruction code associated with the operation of the graphic control element is generated, wherein when the operation is performed on the graphic control element on the man-machine interface, the man-machine interface executes the instruction code.

Another technical solution of the embodiment of the present invention is to provide a computer program product, which carries a computer-readable program, and can execute the above-mentioned man-machine interface development method after being read by the computer.

Another technical solution of the embodiment of the present invention is to provide a human-machine interface device, the human-machine interface device is signal-connected to a main board of a device, and the human-machine interface device includes a display unit and a control unit. The display unit is used for displaying the content of the development interface mentioned above. The signal of the control unit is connected to the display unit for executing the man-machine interface developed by the above-mentioned man-machine interface development method. The control unit receives operations through the graphic control elements in the development interface, and executes corresponding instruction codes corresponding to the operations.

In order to further understand the features and technical content of the present invention, please refer to the following detailed description and drawings related to the present invention. However, the provided drawings are only for reference and description, and are not intended to limit the present invention.

The following specific embodiments are used together with Figures 1 to 8 to illustrate the human-machine interface development method, computer program product and human-machine interface device disclosed in the present invention. Those skilled in the art can understand the present invention from the content disclosed in this specification advantages and effects. However, the content disclosed below is not intended to limit the protection scope of the present invention. Those skilled in the art can implement the present invention in other different embodiments based on different viewpoints and applications without departing from the spirit of the present invention.

first embodiment

The first embodiment of the present invention will be described below with reference to FIG. 1 to FIG. 5C . First of all, please refer to Fig. 1 to Fig. 3, the first embodiment of the present invention provides a man-machine interface development method, which can be implemented as a computer program product, which contains a computer-readable program, through Fig. 1 and Fig. 2 After being read by the computing device C shown, the man-machine interface development method shown in FIG. 3 can be executed. The man-machine interface development method of the embodiment of the present invention includes at least step S100: on the computing device C, for a graphic control element G1 in the man-machine interface development interface 1, generate a visual programming interface corresponding to the operation of the graphic control element G1 2. The visual programming interface 2 is displayed on the display D signal connected to the computing device C, wherein the visual programming interface 2 includes a plurality of icon objects (P1~P5), and each icon object (P1~P5) Associated with a program code element, each icon object is used to connect with other icon objects (P1~P5) on the visual programming interface 2 to generate a program code; and step S102: receive an input command through the computing device C, input The instruction indicates to place at least one graphic object on the visual programming interface 2 to generate the instruction code 20A associated with the operation of the graphic control element, wherein, when the operation is performed on the graphic control element G1 on the man-machine interface, The man-machine interface executes the instruction code 20A.

1 and 2 illustrate the generation of a visual programming interface 2 from a human-machine interface development interface 1 . For example, please refer to Fig. 1, which shows the development interface 1 of the human-machine interface designed for the water dispenser, wherein the graphic control element G1 is designed as a cold water outlet button; the graphic control element G2 is designed as a hot water outlet button; the graphic control element G3 is designed as a hot water outlet button. It is designed as a hot water safety lock; the graphic control element G4 is a system control element, designed as a timer to make the hot water safety lock turn off at regular intervals after it is opened; the graphic control element G5 and G6 are used to display the temperature of the temporary register Numerical value, used to represent the water temperature in the water dispenser. The above is only for illustration, and the present invention is not limited thereto; for example, in other embodiments, the development interface 1 may also be a man-machine interface designed for coffee machines, printers, treadmills, industrial production machines, and the like. In step S100 , a visual programming interface 2 (see FIG. 2 ) of the graphic control element G1 is generated from the development interface 1 in FIG. 1 to set the event that the man-machine interface should execute when the cold water outlet button is pressed. Generating the visual programming interface 2 may be, for example, controlling the cursor with a mouse and pressing the right button on the graphic control element G1 to generate a feature setting menu of the graphic control element G1, wherein the visual programming interface 2 can be selected from the feature setting menu ; The present invention is not limited thereto.

Please refer to FIG. 2 . In this embodiment, when the graphic control element G1 representing the cold water outlet button is pressed, the events executed by the man-machine interface are realized by the instruction code 20A. The visual programming interface 2 includes a plurality of graphic objects ( P1 - P5 ), and each graphic object is associated with a code element for connecting with other graphic objects on the visual programming interface 2 to generate code. In detail, the instruction code 20A of FIG. 2 includes a graphical object P1 representing a conditional expression, a graphical object P2 representing a relational operator, two printed graphical objects P3 and P5, and a graphical object P4 of an execution function, wherein , the icon object P1 is associated with the program statement (if-else statement) used to execute the conditional expression; the icon object P2 is associated with the program statement used to execute the relational operator (relational operator); the icon objects P3 and P5 are associated with It is used to execute the program statement of printing; the icon object P4 is associated with the program statement of the output control signal, for example, in this embodiment, the program statement associated with the icon object P4 is used to generate the main board output to the water dispenser to provide cold water control signal.

By providing the visual programming interface 2, this embodiment can place multiple selected graphic objects (P1~P5) in the editing area 21 of the visual programming interface 2, and can combine the graphic objects (P1~P5) Splicing to generate instruction code 20A that complies with syntax and can perform required tasks. When the development interface 1 designed in FIG. 1 is developed and implemented in a water dispenser device, when the graphic control element G1 is pressed by the user, the man-machine interface will execute the instruction code 20A. In this embodiment, the man-machine interface first executes the icon object P1 to determine whether the condition in the icon object P2 is true. The program code corresponding to the object P2 in the figure is to determine whether the temperature value is less than 30. When the judgment is yes, the man-machine interface then executes the program code of the icon object P3 to display the text string "Cold water is available." set in the icon object P3, and then executes the program code of the icon object P4 to control the drinking water The output of the main board of the machine provides a control signal for cold water; when the judgment is negative, the man-machine interface executes the code associated with the icon object P5, and then displays the text string "Cold water is not available." set in the icon object P5. In other words, this embodiment uses the visual programming interface 2 to generate the instruction code 20A for splicing and assembling the graphical objects (P1~P5). Water conditionally. In this way, the embodiment of the present invention can complete the task setting of the graphic control element without writing program codes, which reduces the technical threshold and development cost of man-machine interface development, and at the same time avoids the chance of writing program codes to cause errors, and improves the development of man-machine interface. s efficiency.

The embodiment shown in FIG. 2 is to edit the instruction code 20A to design the task performed when the graphical control element G1 is depressed. In other words, the "operation" mentioned in the "instruction code related to the operation of the graphic control element" generated in step S102 refers to the operation that the button represented by the graphic control element G1 is pressed. However, the present invention is not limited thereto. In other embodiments, the instruction codes of other operations can be edited for any graphical control element in the development interface 1 , such as operations such as releasing a button and pressing a button for a long time.

Please continue with Figure 2. In one embodiment, the icon objects ( P1 ˜ P5 ) can be selected from the icon object menu 200 of the visual programming interface 2 . The icon object menu 200 may include multiple drop-down menus (201-207). In this embodiment, the visual programming interface 2 provides a drop-down menu 201 for logical icon objects, a drop-down menu 202 for loop icon objects, a drop-down menu 203 for mathematical operation icon objects, and a drop-down menu for operator icon objects. Type menu 204, register icon object drop-down menu 205, variable icon object drop-down menu 206, and function icon object drop-down menu 207 (used to output control signals to machines controlled by the man-machine interface) . However, the present invention is not limited to the above. The visual programming interface 2 may provide any other graphical objects representing code elements that can be used to write scripts. In addition, the program code elements may be statements of any programming language, and the present invention is not limited thereto.

Furthermore, in a variant embodiment of the present invention, the present invention can provide a graphical object menu for the operation of the graphical control element of the script to be edited, wherein the graphical object menu includes the graphical object menu that can be used to execute the graphical control element. Icon object for the action. For example, when it is desired to edit a command code for an operation of a graphic control element, the icon object menu 200 of the visual programming interface 2 only includes icon objects suitable for editing the command code of the operation, and are not suitable for The icon object for editing the script of the operation will not appear in the icon object menu 200 . In this way, this embodiment can further avoid writing errors of instruction codes.

Further, please refer to Figure 2, some icon objects further include user interface (U1~U4) for editing a part of the code elements associated with the icon object, and the rest of the code elements other than the user interface are Unable to edit. For example, icon object P2 provides user interfaces (U1~U3), among which user interface U2 is for man-machine interface designers to select operation subtypes (less than is used in this embodiment), and user interface U1 is for man-machine interface The designer selects the variable on the left of the operator (in this embodiment, the value of the temperature register is used as the variable), and the user interface U3 allows the man-machine interface designer to select the variable on the right of the operator (set to 30 in this embodiment). The user interfaces U4 and U5 of the icon objects P3 and P5 are used for inputting text strings to be printed out. In this way, in this embodiment, only need to move and drag the icon objects to arrange and combine the icon objects, and select or input variables through the user interface, without actually inputting the grammatical statements of the program, the man-machine interface can be completed The command code editing of graphic control components in the middle makes the development of man-machine interface more convenient.

The following describes the human-machine interface and its implementation according to the human-machine interface development method and the computer program product shown in FIGS. 1-3 with reference to FIGS. 4-5C. Please refer to FIG. 4 , this embodiment provides a human-machine interface device 3 for implementing the above-mentioned human-machine interface. The man-machine interface device 3 includes a display unit 31 and a control unit 32 . The man-machine interface device 3 is connected to the main board B of a device through the control unit 32 with signals. In this embodiment, the equipment is a water dispenser A, but the present invention is not limited thereto. The display unit 31 is used to display the content of the development interface 1 in FIG. 1 , wherein the graphic control element G4 in FIG. 1 is a system timer, so it is not displayed on the display unit 31 . The control unit 32 is signal-connected to the display unit 31 for executing the man-machine interface produced by the man-machine interface development method of the present invention, wherein the control unit 32 controls the components (G1, G2, G3, G5 through the graphic control elements in the development interface 1 , G6) to receive the operation and execute the corresponding instruction code. For example, when the control unit 32 receives a signal that the graphic control element G1 is pressed through the development interface 1 displayed on the display unit 31 , the control unit 32 executes the instruction code 20A in FIG. 2 .

In this embodiment, in addition to outputting signals to the display unit 31 and the device A, the command code can also be used to set the state of other graphic control elements after the control unit 32 executes it. The following uses the hot water safety lock of the water dispenser A (graphic control element G3 ) as an example for illustration. In FIG. 5A , when the control unit 32 executes the instruction code 20B, it first determines whether the temperature value is higher than or equal to 50 (the item P7 in the figure). When the judgment is yes, the control unit 32 then judges whether the stored value of the hot water safety lock is 1 (item P9 in the figure). When the judgment is 1, the control unit 32 outputs a display signal to the display unit 31 to display the specified output text string in the icon object P10, and outputs a control signal for providing hot water to the main board B of the water dispenser A (the icon object P11) ; When it is judged that the storage value of the hot water safety lock is not 1, then the display unit 31 is made to display the message representing "please release the hot water lock" in the icon object P12. The stored value of the above-mentioned hot water safety lock can be changed from the graphic control element G3. In detail, please refer to FIG. 5B , which shows the visual programming interface 2 of the graphic control element G3. The graphical control element G3 is a graphic interface application program of the hot water safety lock, and the operation set by the command code 20C is to set the storage value of the hot water safety lock to 1 when the graphical control element G3 is pressed for a long time.

Further, please refer to FIG. 5C, the development interface 1 of this embodiment further has a graphic control element of the system timer (see graphic control element G4 in FIG. 1), and the embodiment shown in FIG. 5C is the graphic control element in FIG. The visual programming interface 2 of the graphic control element G4, wherein the instruction code 20D sets the timer to set the stored value of the hot water safety lock to 0, and the graphic control element G4 sets the stored value of the hot water safety lock to 1 start the timer. In the instruction code 20B of the graphic control element G2 (hot water outlet button) in FIG. 5A, when the storage value of the hot water safety lock is 1, the output control signal provides hot water, and when it is not 1, no hot water is provided. In the embodiment, the state setting of the storage value of the hot water safety button under different conditions by the command code 20C and the command code 20D can achieve the design of safe hot water for the water dispenser A.

To sum up the above, with the technical means provided by this embodiment, the human-machine interface development method, computer program software and human-machine interface device provided by the present invention can generate a visual programming interface in the computing device and convert the A plurality of graphical objects are arranged and connected in the visual programming interface to generate the instruction code of the graphical control element. In this way, the present invention can design the man-machine interface in a visual way, wherein the designer does not need to write program codes manually, which lowers the technical threshold and saves the risk of program code errors, improves the efficiency of man-machine interface design and reduces the cost.

second embodiment

The second embodiment of the present invention will be described below with reference to FIG. 6 to FIG. 8 . Please refer to FIG. 6 and FIG. 7 , the man-machine interface development method provided by the second embodiment of the present invention further includes step S200: select an icon object and connect it to the icon object placed on the visual programming interface; step S202: Use the computing device to determine whether the connection between the selected icon object and the icon object placed on the visual programming interface conforms to the program syntax; and Step S204: If it is determined that the connection does not conform to the program syntax, make the The selected icon object cannot be connected to the icon object already placed on the visual programming interface. Step S200 to step S204 may be performed after step S100 or after step S102 in the first embodiment, the present invention is not limited thereto. Please refer to FIG. 6. For example, in the process of designing the script code, the icon object P3 is selected to be connected to the icon object P1 placed in the visual programming interface 2, wherein the icon object P1 is associated with the conditional syntax code element, and the icon object P3 is associated with the printed code element. In step S200 , after the icon object P3 is connected to the condition statement position (connection point P1A) of the icon object P1 , step S202 then determines whether the connection is grammatical. Since the pictorial object P3 is not a conditional statement that can determine whether it is true or false, it is determined in step S202 that the connection does not conform to the grammar, and then step S204 is executed to prevent the pictorial object P3 from being connected to the pictorial object P1.

The way to make the ungrammatical icon object cannot be connected after the connection can be to invalidate the connection point P1A of the icon object P1 placed on the visual programming interface 2, or to return the selected icon object P3 to the icon object menu 200, the present invention is not limited thereto. In this embodiment, the grammatical connection can successfully generate scripts, and the non-grammatical connection cannot be placed in the visual programming interface 2 . In this way, errors generated when designing instruction codes can be further reduced.

Please refer to FIG. 8 , in a variation embodiment, the man-machine interface development method of the present invention further includes step 300: judge the instruction formed by a plurality of the icon objects connected on the visual programming interface by a computing device Whether the code conforms to the program syntax; and step S302: if it is determined that the command code does not conform to the program syntax, close the user interface through the computing device. Taking FIG. 6 as an example, in a variant embodiment, after the pictorial object P3 is connected to the connection point P1A of the pictorial object P1, the computing device in FIG. 1 executes step S300 to determine the command formed after the connection is completed. Whether the code conforms to the syntax, and when it is judged to be ungrammatical, the user interface in the icon object P3 will be closed, and the man-machine interface designer cannot input the text string to be printed out. In this way, this embodiment can further avoid script code writing errors in the development process of the man-machine interface.

The content disclosed above is only the preferred feasible embodiment of the present invention, and does not limit the patent scope of the present invention. Therefore, all equivalent technical changes made by using the description and drawings of the present invention fall into the application of the present invention. within the scope of the patent.

C: computing device D: monitor 1: Development interface G1~G6: graphic control components P1~P15: icon objects P1A: icon object connection point U1~U5: User Interface 200: icon object menu 201~207: Icon object drop-down menu 20A~20D: instruction code 3: Man-machine interface device 31: Display unit 32: Control unit A: Equipment B: Motherboard

FIG. 1 and FIG. 2 are schematic diagrams of the implementation of the human-machine interface development method according to the first embodiment of the present invention.

FIG. 3 is a flow chart of the human-machine interface development method according to the first embodiment of the present invention.

FIG. 4 is a schematic diagram illustrating the implementation of the human-machine interface device according to the first embodiment of the present invention.

5A to 5C are schematic diagrams illustrating the implementation of the visual programming interface according to the first embodiment of the present invention.

FIG. 6 is a schematic diagram of the implementation of the man-machine interface development method according to the second embodiment of the present invention.

FIG. 7 is a flowchart of a human-machine interface development method according to a second embodiment of the present invention.

FIG. 8 is a variant embodiment of the man-machine interface development method of the second embodiment of the present invention.

The designated representative figure in this case is a flow chart, so there are no symbols for simple explanation.

Claims (10)

A human-machine interface development method, comprising: On a computing device, for a graphical control element in a development interface of a man-machine interface, a visual programming interface corresponding to an operation of the graphical control element is generated, and the visual programming interface is displayed on the signal connected to the computing device A display of the visual programming interface, wherein the visual programming interface includes a plurality of graphical objects, each of which is associated with a code element for connecting with other graphical objects on the visual programming interface generate code; and Receive an input instruction through the computing device, the input instruction indicates to place at least one of the graphic objects on the visual programming interface, so as to generate an instruction code associated with the operation of the graphic control element, wherein, when in the human When the operation is performed on the graphic control element on the machine interface, the man-machine interface executes the instruction code. Such as the human-machine interface development method of claim 1, further comprising: The graphical object includes at least one user interface for editing a portion of the code element, and the rest of the code element cannot be edited. For example, the human-machine interface development method of claim 2 further includes: judging by the computing device whether the instruction code formed by the plurality of graphical objects connected on the visual programming interface conforms to a program syntax; and If it is judged that the command code does not conform to the syntax of the program, the user interface is closed by the computing device. Such as the human-machine interface development method of claim 1, further comprising: The visual programming interface provides an icon object menu according to the graphic control element, wherein the icon object menu includes a plurality of icon objects that can be used to execute the operation of the graphic control element. Such as the human-machine interface development method of claim 1, further comprising: Selecting an icon object to be connected to an icon object placed on the visual programming interface; judging by the computing device whether the connection between the selected icon object and the icon object placed on the visual programming interface conforms to a program syntax; and If it is determined that the connection does not conform to the programming syntax, the selected icon object cannot be connected with the icon object placed on the visual programming interface. A computer program product, carrying a computer-readable program, which can execute the man-machine interface development method described in any one of claims 1 to 5 after being read by the computer. A human-machine interface device, the human-machine interface device is signal-connected to a main board of a device, the human-machine interface device includes: A display unit for displaying the content of the development interface as described in any one of claims 1 to 5; and A control unit, signal connected to the display unit, for executing the man-machine interface developed by the man-machine interface development method described in any one of claims 1 to 5, wherein the control unit displays through the display unit The graphic control element in the development interface receives the operation, and executes the instruction code corresponding to the operation. The human-machine interface device according to claim 7, wherein the control unit performs state setting on another graphic control element on the development interface after executing the instruction code. The human-machine interface device according to claim 7, wherein the control unit outputs a control signal to the device after executing the instruction code. The human-machine interface device according to claim 7, wherein the control unit outputs a display signal to the display unit after executing the instruction code.

Images