CN111460767B - HMI flow chart generation method and device - Google Patents
HMI flow chart generation method and device Download PDFInfo
- Publication number
- CN111460767B CN111460767B CN202010245767.6A CN202010245767A CN111460767B CN 111460767 B CN111460767 B CN 111460767B CN 202010245767 A CN202010245767 A CN 202010245767A CN 111460767 B CN111460767 B CN 111460767B
- Authority
- CN
- China
- Prior art keywords
- target
- character
- equipment
- graphic element
- characters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000001514 detection method Methods 0.000 claims description 32
- 238000012549 training Methods 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 238000012544 monitoring process Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 11
- 238000012015 optical character recognition Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 239000007788 liquid Substances 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000001824 photoionisation detection Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The method and the device for generating the HMI flow chart convert PID into a picture, determine target equipment and target characters contained in the picture, determine position coordinates of the target equipment and the target characters, identify the target characters, and accordingly obtain first-class target characters and binding groups, determine preset associated dynamic controls corresponding to the first-class target characters and the binding groups, and finally generate the HMI flow chart, so that the generated HMI flow chart not only can comprehensively display the target equipment and the target characters contained in the picture, but also can display the associated dynamic controls corresponding to the first-class target characters and the binding groups, and meanwhile, the HMI flow chart is generated according to the position information of the target equipment and the target characters in the picture, so that the position coordinates of the target equipment and the target characters in the picture can be ensured to be kept unchanged in the HMI flow chart, and the accuracy of the HMI flow chart can be improved and the labor cost can be saved.
Description
Technical Field
The present disclosure relates to the field of data processing, and in particular, to a method and apparatus for generating an HMI flowchart.
Background
The HMI (Human Machine Interface, human-machine interface) flowchart is an important monitoring operation interface in an industrial control system, through which the operation status of each component device of the industrial control system can be known, and the operation parameters of each device in the system can be manipulated. The PID (Process and Instrument Diagram, pipe and instrument flow diagram) flow diagram is a static engineering drawing showing the overall structure of an industrial control system.
In the prior art, the HMI flow chart is generally manually manufactured according to the PID by a person, and for some PIDs with complex structural functions, the HMI flow chart is obtained by adopting a manual manufacturing mode, so that a great deal of labor cost is required and mistakes are easy to occur. Therefore, how to save labor cost and improve accuracy of HMI flowcharts becomes a current urgent problem to be solved.
Disclosure of Invention
The application provides a generation method and device of an HMI (human machine interface) flow chart, and aims to solve the problems of saving labor cost and improving accuracy of the HMI flow chart.
In order to achieve the above object, the present application provides the following technical solutions:
a method of generating an HMI flow diagram, comprising:
converting the received PID of the equipment system into a picture;
Determining target equipment and target characters included in the picture, and determining position coordinates of the target equipment and the target characters; the target equipment and the target character are objects to be displayed in the HMI flow chart;
classifying the target characters to obtain first-class target characters and second-class target characters, wherein the first-class target characters are characters which do not need to be set in association with equipment; the second type target characters are characters of associated equipment to be set;
for each second type target character, determining the associated equipment of the second type target character from the target equipment, and binding the second type target character with the associated equipment to obtain a binding group;
determining a preset associated dynamic control corresponding to the first type of target characters and the binding group, wherein the associated dynamic control is at least used for monitoring and displaying running state data of the equipment system;
generating the HMI flow chart according to the preset first type target characters, the preset binding group and the preset display patterns of the associated dynamic control, and the preset first type target characters and the preset binding group position coordinates, wherein the preset binding group position coordinates are the position coordinates of the target equipment in the binding group.
In the above method, optionally, the determining the target device and the target character included in the picture, and determining the position coordinates of the target device and the target character include:
determining each graphic element included in the picture by adopting a pre-trained graphic detection model, and positioning each graphic element to obtain the position coordinates of the graphic element, wherein the graphic element comprises an equipment graphic element and a character graphic element;
performing image recognition on the equipment graphic element, determining target equipment corresponding to the equipment graphic element, and taking the position coordinate of the equipment graphic element as the position coordinate of the target equipment;
and carrying out character content recognition on the character graphic element, determining a character corresponding to the character graphic element, judging whether the character corresponding to the character graphic element exists in a preset character data table, if so, taking the character corresponding to the character graphic element as the target character, and taking the position coordinate of the character graphic element as the position coordinate of the target character.
The method, optionally, the process of obtaining the graph detection model, includes:
Acquiring a sample picture, wherein the sample picture comprises the equipment graphic element and the character graphic element, the equipment graphic element carries an equipment classification tag and an equipment position tag, and the character graphic element carries a character classification tag and the position tag;
and training a preset basic model by adopting the sample picture to obtain the graph detection model.
The method, optionally, for each second type of target character, determines, from the target devices, the associated device of the second type of target character, including:
and respectively calculating the distance difference between the position coordinates of the second type of target characters and the position coordinates of each target device, and taking the target device corresponding to the distance difference with the smallest difference as the associated device of the second type of target characters.
In the above method, optionally, the generating the HMI flowchart according to the preset display style of the first type target character, the binding group and the associated dynamic control, and the position coordinates of the first type target character and the binding group includes:
determining a first display style and a second display style from a preset display style database, wherein the first display style is as follows: the first type target characters and the display patterns of the associated dynamic controls of the first type target characters are displayed, and the second display patterns are as follows: the target device, the second class target character and the display style of the associated dynamic control of the binding group in the binding group;
According to the position coordinates of the first type target characters and the first display style, correspondingly displaying the first type target characters in the HMI;
displaying the binding group correspondingly in the HMI according to the position coordinates of the binding group and the second display style;
and obtaining the HMI flow chart according to the first type target characters displayed in the HMI and the binding group.
An HMI flowchart generation apparatus, comprising:
the conversion unit is used for converting the received PID of the equipment system into a picture;
a first determining unit configured to determine a target device and a target character included in the picture, and determine position coordinates of the target device and the target character; the target equipment and the target character are objects to be displayed in the HMI flow chart;
the classifying unit is used for classifying the target characters to obtain first-class target characters and second-class target characters, wherein the first-class target characters are characters needing to be set with associated equipment; the second type target characters are characters of which associated equipment is not required to be set;
the second determining unit is used for determining the associated equipment of the second type target characters from the target equipment aiming at each second type target character, and binding the second type target characters with the associated equipment to obtain a binding group;
The third determining unit is used for determining a preset associated dynamic control corresponding to the first type of target characters and the binding group, and the associated dynamic control is at least used for monitoring and displaying running state data of the equipment system;
the generation unit is used for generating the HMI flow chart according to the preset first type target characters, the preset binding group and the preset display patterns of the associated dynamic control and the preset first type target characters and the preset binding group position coordinates, wherein the binding group position coordinates are the position coordinates of the target equipment in the binding group.
The above apparatus, optionally, the first determining unit is configured to determine a target device and a target character included in the picture, and determine position coordinates of the target device and the target character, including:
the first determining unit is specifically configured to determine each graphic element included in the picture by using a pre-trained graphic detection model, and locate each graphic element to obtain a position coordinate of the graphic element, where the graphic element includes an equipment graphic element and a character graphic element;
performing image recognition on the equipment graphic element, determining target equipment corresponding to the equipment graphic element, and taking the position coordinate of the equipment graphic element as the position coordinate of the target equipment;
And carrying out character content recognition on the character graphic element, determining a character corresponding to the character graphic element, judging whether the character corresponding to the character graphic element exists in a preset character data table, if so, taking the character corresponding to the character graphic element as the target character, and taking the position coordinate of the character graphic element as the position coordinate of the target character.
The above apparatus, optionally, further includes a training unit, configured to obtain the graphic detection model, including:
the training unit is specifically configured to obtain a sample picture, where the sample picture includes the device graphic element and the character graphic element, the device graphic element carries a device classification tag and a device position tag, and the character graphic element carries a character classification tag and the position tag;
and training a preset basic model by adopting the sample picture to obtain the graph detection model.
The above apparatus, optionally, the second determining unit is configured to determine, for each second type of target character, from the target devices, the associated device of the second type of target character, including:
The second determining unit is specifically configured to calculate a distance difference between the position coordinates of the second type of target characters and the position coordinates of each target device, and use a target device corresponding to the distance difference with the smallest difference as the associated device of the second type of target characters.
In the above apparatus, optionally, the generating unit is configured to generate the HMI flowchart according to a preset display style of the first type target character, the binding group, and the associated dynamic control, and a position coordinate of the first type target character and the binding group, where the generating unit includes:
the generating unit is specifically configured to determine, from a preset display style database, a first display style and a second display style, where the first display style is: the first type target characters and the display patterns of the associated dynamic controls of the first type target characters are displayed, and the second display patterns are as follows: the target device, the second class target character and the display style of the associated dynamic control of the binding group in the binding group;
according to the position coordinates of the first type target characters and the first display style, correspondingly displaying the first type target characters in the HMI;
Displaying the binding group correspondingly in the HMI according to the position coordinates of the binding group and the second display style;
and obtaining the HMI flow chart according to the first type target characters displayed in the HMI and the binding group.
According to the method and the device, PID is converted into a picture, target equipment and target characters contained in the picture are determined, position coordinates of the target equipment and the target characters are determined, the target characters are classified, so that a first type of target characters and a binding group are obtained, preset associated dynamic controls corresponding to the first type of target characters and the binding group are determined, finally, an HMI flow chart is generated according to display patterns of the first type of target characters, the binding group and the associated dynamic controls and position coordinates of the first type of target characters and the binding group, therefore, the generated HMI flow chart not only can comprehensively display the target equipment and the target characters contained in the picture, but also can display the associated dynamic controls corresponding to the first type of target characters and the binding group, meanwhile, the HMI flow chart is generated according to position information of the target equipment and the target characters in the picture, so that the position coordinates of the target equipment and the target characters in the picture are kept unchanged in the HMI flow chart can be guaranteed, and the HMI flow chart can be comprehensively improved, and the HMI flow chart cost can be saved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method for generating an HMI flow chart disclosed in an embodiment of the present application;
FIG. 2 is a flow chart of a method for determining a target device and a target character and determining position coordinates of the target device and the target character according to an embodiment of the present application;
FIG. 3 is a diagram of a PID disclosed in an embodiment of the present application;
FIG. 4 is a graph of the results of identifying and locating PIDs as disclosed in embodiments of the present application;
FIG. 5 is a flow chart of an HMI disclosed in an embodiment of the present application;
FIG. 6 is a schematic structural diagram of an apparatus for generating an HMI flowchart according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
Fig. 1 is a method for generating an HMI flowchart according to an embodiment of the present application, which may include the following steps:
s101, converting the received PID of the equipment system into a picture.
In this embodiment, a picture conversion tool may be used to convert the received PID in CAD format, PDF format or other formats into a picture, specifically, may be converted into a picture in JPG format, where the picture format may be set by itself according to the requirements.
S102, determining target equipment and target characters included in the picture, and determining position coordinates of the target equipment and the target characters.
The target device and the target characters are objects to be displayed in the HMI flow chart, for example, the target device can be a motor, a switch valve, a regulating valve and the like, and the target characters can be a device number, an analog quantity bit number, an alarm bit number and the like. A specific implementation of this step may refer to the flow shown in fig. 2.
S103, classifying the target characters to obtain first-class target characters and second-class target characters.
The first type of target characters are characters which do not need to be set for the associated equipment, and the second type of target characters are characters which do not need to be set for the associated equipment. In this embodiment, one method for classifying the target character may be: and determining whether the target character is a target character of which the associated equipment needs to be set according to the characteristic information of each target character according to each target character, if so, taking the target character as a first type target character, and if so, taking the target character as a second type target character. The feature information of the target character may be a type corresponding to the target character, where the feature information of the target character determines whether the target character needs to set the association device in advance, for example, the feature information a of the target character may be preset without setting the association device, and the target character does not need to set the association device.
S104, aiming at each second type of target character, determining the associated equipment of the second type of target character from the target equipment, and binding the second type of target character with the associated equipment to obtain a binding group.
In this step, for each second type of target character, one implementation manner of determining the associated device of the second type of target character from the target devices may be: and respectively calculating the distance difference between the position coordinates of the second class of target characters and the position coordinates of each target device, and taking the target device corresponding to the distance difference with the smallest difference as the associated device of the second class of target characters.
S105, determining a preset associated dynamic control corresponding to the first type target character and the binding group.
Associated dynamic controls include, but are not limited to, devices parameters for monitoring and displaying operational status data of the device system, such as may also be used to display the device system, and the like. The associated dynamic control may be: associated popup panels, associated dynamic bit numbers, associated function blocks, and the like. In this embodiment, the associated dynamic controls corresponding to the first type of target characters and the binding group are preset, and the number of the associated dynamic controls may be single or multiple.
S106, generating an HMI flow chart according to the preset first type target characters, the preset binding group and the preset display patterns of the associated dynamic controls and the preset position coordinates of the first type target characters and the preset binding group.
It should be noted that, the location coordinates of the binding group are the location coordinates of the target devices in the binding group. One implementation of this step may include steps A1 to A4:
step A1: and determining a first display style and a second display style from a preset display style database. The first display style is as follows: the method comprises the steps of displaying a first type of target characters and display styles corresponding to associated dynamic controls of the first type of target characters. The second display style is: target equipment in the binding group, second class target characters and display styles of associated dynamic controls of the binding group. In this embodiment, the display style database specifies display styles for devices, characters, and associated dynamic controls for different industries.
Step A2: and correspondingly displaying the first type target characters in the HMI according to the position coordinates and the first display style of the first type target characters. In the step, after the first display style is determined, the first type target character is displayed in the HMI according to the position coordinates of the first type target character and the first display style.
Step A3: and correspondingly displaying the binding group in the HMI according to the position coordinates of the binding group and the second display style. In this step, similarly, after the second display style is determined, the binding group is displayed in the HMI according to the position coordinates of the target device in the binding group and the second display style.
Step A4: and obtaining the HMI flow chart according to the first type target characters and the binding group displayed in the HMI. And displaying all the first type target characters and the binding groups in the HMI at the same time, so as to obtain the HMI flow chart.
According to the method provided by the embodiment, PID is converted into a picture, target equipment and target characters contained in the picture are determined, position coordinates of the target equipment and the target characters are determined, the target characters are classified, so that first-class target characters and binding groups are obtained, preset associated dynamic controls corresponding to the first-class target characters and the binding groups are determined, finally, an HMI flow chart is generated according to display patterns of the first-class target characters, the binding groups and the associated dynamic controls and position coordinates of the first-class target characters and the binding groups, therefore, the generated HMI flow chart not only can comprehensively display the target equipment and the target characters contained in the picture, but also can display the associated dynamic controls corresponding to the first-class target characters and the binding groups, meanwhile, the HMI flow chart is generated according to position information of the target equipment and the target characters in the picture, so that the position coordinates of the target equipment and the target characters in the picture are kept unchanged in the HMI flow chart can be guaranteed.
Fig. 2 is an embodiment of determining the target device and the target character included in the picture in S102 in fig. 1, and determining the position coordinates of the target device and the target character, which may include the steps of:
s201, determining each graphic element included in the picture by adopting a pre-trained graphic detection model, and positioning each graphic element to obtain the position coordinates of the graphic element.
In this embodiment, the pre-trained graphic detection model may identify and locate each graphic element included in the image, where the graphic elements include a device graphic element and a character graphic element. Specifically, the equipment image element is used for representing equipment in the industrial system, and the character graphic element is used for representing equipment number, analog quantity bit number, alarm bit number and the like. In this embodiment, the process of obtaining the graphic detection model may include steps B1 to B2:
and B1, acquiring a sample picture. The sample picture comprises a device graphic element and a character graphic element, wherein the device graphic element carries a device classification label and a position label, and the character graphic element carries a character classification label and a position label. In this embodiment, the device classification tag is used to identify identity information of a device graphic element, which may be a name or a type of the device graphic element, and similarly, the character classification tag is used to identify identity information of a character graphic element, which may be a name or a type of the character graphic element. The position tag is a tag for locating an image element. Specifically, the position label of the graphic element is a rectangular box including the graphic element, and the vertex of the upper left corner of the rectangular box is marked as a first position point, and the vertex of the lower right corner is marked as a second position point. The position coordinates of the first position point and the second position point may be two-dimensional coordinates.
In this embodiment, optionally, according to a preset device database, a device classification label may be set for a device graphic element in the sample picture, and a character classification label may be set for a character graphic element.
And step B2, training a preset basic model by adopting sample pictures to obtain a graph detection model.
In this embodiment, the basic model may be a two-stage detection model or a one-stage detection model, where the two-stage detection model includes one or a combination of several of R-CNN, fast R-CNN, mask R-CNN, and the one-stage detection model includes one or a combination of several of YOLO, SSD, YOLOv2, YOLOv3, and Retna-Net. The base model may be selected according to different industrial fields.
The training process of training the basic model by using the sample picture to finally obtain the graphic detection model can refer to the prior art, and will not be described herein.
S202, carrying out image recognition on the equipment graphic element, determining target equipment corresponding to the equipment graphic element, and taking the position coordinates of the equipment graphic element as the position coordinates of the target equipment.
In this embodiment, after determining the device graphic element, image recognition is performed on the device graphic element through the graphic detection model, so as to determine a target device corresponding to the device graphic element, and the position coordinate of the device graphic element obtained by positioning is used as the position coordinate of the target device. The position coordinates of the device graphic element obtained by positioning are represented by a first position point and a second position point.
S203, carrying out character content recognition on the character graphic elements, determining characters corresponding to the character graphic elements, judging whether the characters corresponding to the character graphic elements exist in a preset character data table, if so, taking the characters corresponding to the character graphic elements as target characters, and taking the position coordinates of the character graphic elements as the position coordinates of the target characters.
In this embodiment, after determining the character graphic element, the character content of the character graphic element may be identified by using a graphic detection model, or the character content of the character graphic element may be identified by using an OCR (Optical Character Recognition ) technique, and in this embodiment, preferably, an OCR technique is used.
After determining the characters corresponding to the character graphic elements, comparing the characters corresponding to the graphic elements with the characters stored in a preset character data table, judging whether the characters corresponding to the character graphic elements exist in the character data table, and taking the characters corresponding to the character graphic elements as target characters if the characters corresponding to the character graphic elements exist in the character data table. If the character is not present, the character corresponding to the recognized character graphic element is marked as an error character. The character corresponding to the character graphic element may be a single character or a character string, and the position coordinates of the target character are represented by a first position point and a second position point.
When the position coordinates are represented by a first position point and a second position point in the position tag, the distance between the target device and the target character may be a distance between a target point of the target device and a target point of the target character, wherein the target point of the target device is a midpoint between the first position point and the second position point of the position coordinates of the target device, and the target point of the target character is a midpoint between the first position point and the second position point of the position coordinates of the target character.
According to the method provided by the embodiment, the target equipment and the target characters contained in the picture can be rapidly and accurately determined through the pre-trained graph detection model, and the position coordinates of the target equipment and the target characters are determined, so that accuracy of the HMI flow chart can be improved, and labor cost can be saved.
The method provided in the embodiment of the present application will be described below by taking a specific PID as an example. The method provided by the embodiment can comprise the following steps:
and C1, converting the PID into a picture in a JPG format. In this embodiment, the picture obtained after conversion is shown in fig. 3. In fig. 3, reference numeral 1 denotes a reaction vessel, reference numeral 2 denotes a switching valve, reference numerals 3 and 4 all denote throttle valves, and reference numerals 5 to 8 denote different character patterns, respectively.
And C2, performing target detection and positioning on the picture by adopting a pre-trained image detection model. Fig. 4 is a diagram of a result of detecting and positioning the fig. 3, where as shown in fig. 4, the detected and positioned objects are equipment graphic elements and character graphic elements included in a dashed rectangle frame in the diagram, a top point of an upper left corner of the dashed rectangle is a first position point, and a top point of a lower right corner is a second position point, and it should be noted that the throttle valve in fig. 3 is not a display object of the HMI flowchart, and the detection result is shown in table 1.
TABLE 1
The AILab is an analog number, a result is obtained by identifying the character and graphic elements, the Caltron is a reaction kettle, and the OV_R switch valve (right) is a result of identifying the equipment graphic elements.
And step C3, generating an HMI flow chart information table, wherein the HMI flow chart information table is shown in a table 2.
TABLE 2
In table 2, the target character obtained by OCR detection is a result of character content recognition of the character graphic element. In table 2, the target device takes the on-off valve (right) as an example, the target character xv_r0902f is a character bound to the on-off valve, xmin and Ymin are first position points of position coordinates of the on-off valve (right), and Xmax and Ymax are second position points of position coordinates of the on-off valve (right), which are a binding group. The associated popup panel XV_R0902F.pic, the associated dynamic bit number XV_R0902F_STA, and the associated function block XV_R0902F are associated dynamic controls preset by the binding group. In table 2, the first type of target characters are characters that do not need to be bound to the device, such as a traffic accumulation bit number and a liquid level bit number. The specific process of obtaining the binding group and the first type target character may refer to the above embodiment, and will not be described herein.
It should be noted that, the device classification name corresponding to the device classification label may be obtained according to preset device data, where the device classification label and the device name of the device are stored correspondingly in the device data.
In this embodiment, the flowchart information table may facilitate a system designer to check the recognition result, and may verify whether the information of a character database (e.g. I/O bit number table) designed by the system designer is correct, so as to improve the accuracy of the HMI flowchart, where the character database is used to verify whether the character obtained by OCR recognition exists in the character database.
And C4, generating an HMI flow chart according to the first type target characters, the binding group, the display style of the associated dynamic control and the position coordinates of the first type target characters and the binding group. For the specific process of the step, reference may be made to S106 of the above embodiment, which is not described herein, and the finally generated HMI flowchart is shown in fig. 5, in which fig. 5, a data display box under a character string is used to display an operation status parameter of the equipment system, for example, in fig. 5, a data display box under LAI R0902 is used to display a liquid level of the reaction kettle. It should be noted that, each display item included in fig. 5 is an adjustable display item, for example, the layout of each display item may be adjusted, and a designer may adaptively adjust the display item in fig. 5 according to the requirement, so as to increase the flexibility of operation of the generated HMI flowchart.
Compared with the existing manual production of the HMI flow chart, the method provided by the embodiment can quickly and accurately generate the HMI flow chart, and saves a great amount of labor cost.
Corresponding to the above-described generation method of an HMI flowchart disclosed in the embodiments of the present application, referring to fig. 6, a schematic structural diagram of a generation apparatus 600 of an HMI flowchart disclosed in the embodiments of the present application is shown, including:
a conversion unit 601, configured to convert a PID of a received device system into a picture;
a first determining unit 602, configured to determine a target device and a target character included in the picture, and determine position coordinates of the target device and the target character; the target equipment and the target characters are objects to be displayed in the HMI flow chart;
the classifying unit 603 is configured to classify target characters to obtain first-class target characters and second-class target characters, where the first-class target characters are characters that do not need to be set in association with equipment; the second type of target characters are characters of associated equipment to be set;
a second determining unit 604, configured to determine, for each second type of target character, an associated device of the second type of target character from the target devices, and bind the second type of target character with the associated device, so as to obtain a binding group;
A third determining unit 605, configured to determine a preset associated dynamic control corresponding to the first type of target character and the binding group, where the associated dynamic control is at least used to monitor and display running state data of the device system;
the generating unit 606 is configured to generate an HMI flowchart according to a preset first type target character, a binding group, a display style of an associated dynamic control, and position coordinates of the first type target character and the binding group, where the position coordinates of the binding group are position coordinates of a target device in the binding group.
The training unit 607 is configured to obtain a graphic detection model, where a specific implementation manner of the training unit 607 obtaining the graphic detection model is: acquiring a sample picture, wherein the sample picture comprises equipment graphic elements and character graphic elements, the equipment graphic elements carry equipment classification labels and equipment position labels, and the character graphic elements carry character classification labels and position labels; training a preset basic model by adopting sample pictures to obtain a graph detection model.
The determining first determining unit 602 is configured to determine the target device and the target character included in the picture, and determine the position coordinates of the target device and the target character according to the following specific implementation manner: determining each graphic element included in a picture by adopting a pre-trained graphic detection model, and positioning each graphic element to obtain the position coordinates of the graphic element, wherein the graphic element comprises equipment graphic elements and character graphic elements; performing image recognition on the equipment graphic element, determining target equipment corresponding to the equipment graphic element, and taking the position coordinates of the equipment graphic element as the position coordinates of the target equipment; and carrying out character content recognition on the character graphic element, determining a character corresponding to the character graphic element, judging whether the character corresponding to the character graphic element exists in a preset character data table, if so, taking the character corresponding to the character graphic element as a target character, and taking the position coordinate of the character graphic element as the position coordinate of the target character.
The specific process of the second determining unit 604 for determining, for each second type of target character, the associated device of the second type of target character from the target devices is: and respectively calculating the distance difference between the position coordinates of the second class of target characters and the position coordinates of each target device, and taking the target device corresponding to the distance difference with the smallest difference as the associated device of the second class of target characters.
The generating unit 606 is configured to generate the HMI flowchart according to a preset first type target character, a preset binding group, a preset display style of an associated dynamic control, and a position coordinate of the first type target character and the binding group, where the specific implementation manner of the HMI flowchart is: determining a first display style and a second display style from a preset display style database, wherein the first display style is as follows: the first type of target characters and the display patterns of the associated dynamic controls of the first type of target characters are as follows: target equipment, second class target characters in the binding group and display patterns of associated dynamic controls of the binding group; according to the position coordinates and the first display style of the first type target characters, the first type target characters are correspondingly displayed in the HMI; displaying the binding group correspondingly in the HMI according to the position coordinates of the binding group and the second display style; and obtaining the HMI flow chart according to the first type target characters and the binding group displayed in the HMI.
According to the device provided by the embodiment, PID is converted into a picture, target equipment and target characters contained in the picture are determined, position coordinates of the target equipment and the target characters are determined, the target characters are classified, so that first-class target characters and binding groups are obtained, preset associated dynamic controls corresponding to the first-class target characters and the binding groups are determined, finally, an HMI flow chart is generated according to display patterns of the first-class target characters, the binding groups and the associated dynamic controls and position coordinates of the first-class target characters and the binding groups.
The embodiment of the invention also provides an electronic device 700, the structural schematic diagram of which is shown in fig. 7, specifically including: the processor 701 and the memory 702 are connected by a bus, and the memory 702 is used for storing programs; the processor 701 is configured to execute a program to implement the method for generating the HMI flowchart in the embodiment of the present application.
The embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores instructions, which when running on a computer, cause the computer to execute the generation method of the HMI flow chart in the embodiment of the application.
The functions described in the methods of the present application, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computing device readable storage medium. Based on such understanding, a portion of the embodiments of the present application that contributes to the prior art or a portion of the technical solution may be embodied in the form of a software product stored in a storage medium, comprising several instructions for causing a computing device (which may be a personal computer, a server, a mobile computing device or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, so that the same or similar parts between the embodiments are referred to each other.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (8)
1. A method for generating an HMI flow chart, comprising:
converting the received pipeline and instrument flow chart PID of the equipment system into pictures;
determining target equipment and target characters included in the picture, and determining position coordinates of the target equipment and the target characters; the target equipment and the target character are objects to be displayed in the HMI flow chart;
Classifying the target characters to obtain first-class target characters and second-class target characters, wherein the first-class target characters are characters which do not need to be set in association with equipment; the second type target characters are characters of associated equipment to be set;
for each second type target character, determining the associated equipment of the second type target character from the target equipment, and binding the second type target character with the associated equipment to obtain a binding group;
determining a preset associated dynamic control corresponding to the first type of target characters and the binding group, wherein the associated dynamic control is at least used for monitoring and displaying running state data of the equipment system; the associated dynamic control comprises an associated popup panel, an associated dynamic bit number and an associated functional block;
generating the HMI flow chart according to the preset first type target characters, the preset binding group and the preset display patterns of the associated dynamic control, and the preset first type target characters and the preset binding group position coordinates, wherein the preset binding group position coordinates are the position coordinates of the target equipment in the binding group;
the generating the HMI flowchart according to the preset first class target characters, the binding group and the display style of the associated dynamic control, and the position coordinates of the first class target characters and the binding group includes:
Determining a first display style and a second display style from a preset display style database, wherein the first display style is as follows: the first type target characters and the display patterns of the associated dynamic controls of the first type target characters are displayed, and the second display patterns are as follows: the target device, the second class target character and the display style of the associated dynamic control of the binding group in the binding group;
according to the position coordinates of the first type target characters and the first display style, correspondingly displaying the first type target characters in the HMI;
displaying the binding group correspondingly in the HMI according to the position coordinates of the binding group and the second display style;
and obtaining the HMI flow chart according to the first type target characters displayed in the HMI and the binding group.
2. The method according to claim 1, wherein the determining the target device and the target character included in the picture and determining the position coordinates of the target device and the target character includes:
determining each graphic element included in the picture by adopting a pre-trained graphic detection model, and positioning each graphic element to obtain the position coordinates of the graphic element, wherein the graphic element comprises an equipment graphic element and a character graphic element;
Performing image recognition on the equipment graphic element, determining target equipment corresponding to the equipment graphic element, and taking the position coordinate of the equipment graphic element as the position coordinate of the target equipment;
and carrying out character content recognition on the character graphic element, determining a character corresponding to the character graphic element, judging whether the character corresponding to the character graphic element exists in a preset character data table, if so, taking the character corresponding to the character graphic element as the target character, and taking the position coordinate of the character graphic element as the position coordinate of the target character.
3. The method of claim 2, wherein the process of deriving the graphical detection model comprises:
acquiring a sample picture, wherein the sample picture comprises the equipment graphic element and the character graphic element, the equipment graphic element carries an equipment classification tag and an equipment position tag, and the character graphic element carries a character classification tag and the position tag;
and training a preset basic model by adopting the sample picture to obtain the graph detection model.
4. The method of claim 1, wherein said determining, for each of said second type of target character, from said target devices, said associated device of said second type of target character comprises:
and respectively calculating the distance difference between the position coordinates of the second type of target characters and the position coordinates of each target device, and taking the target device corresponding to the distance difference with the smallest difference as the associated device of the second type of target characters.
5. An HMI flowchart generation apparatus, comprising:
the conversion unit is used for converting the received PID of the equipment system into a picture;
a first determining unit configured to determine a target device and a target character included in the picture, and determine position coordinates of the target device and the target character; the target equipment and the target character are objects to be displayed in the HMI flow chart;
the classifying unit is used for classifying the target characters to obtain first-class target characters and second-class target characters, wherein the first-class target characters are characters which do not need to be set with associated equipment; the second type target characters are characters of associated equipment to be set;
The second determining unit is used for determining the associated equipment of the second type target characters from the target equipment aiming at each second type target character, and binding the second type target characters with the associated equipment to obtain a binding group;
the third determining unit is used for determining a preset associated dynamic control corresponding to the first type of target characters and the binding group, and the associated dynamic control is at least used for monitoring and displaying running state data of the equipment system; the associated dynamic control comprises an associated popup panel, an associated dynamic bit number and an associated functional block;
the generation unit is used for generating the HMI flow chart according to the preset first type target characters, the preset binding group and the preset display patterns of the associated dynamic control and the preset first type target characters and the preset binding group position coordinates, wherein the preset binding group position coordinates are the position coordinates of the target equipment in the binding group;
the generating unit is configured to generate the HMI flowchart according to the preset first type target character, the binding group, the display style of the associated dynamic control, and the position coordinates of the first type target character and the binding group, where the HMI flowchart includes:
The generating unit is specifically configured to determine, from a preset display style database, a first display style and a second display style, where the first display style is: the first type target characters and the display patterns of the associated dynamic controls of the first type target characters are displayed, and the second display patterns are as follows: the target device, the second class target character and the display style of the associated dynamic control of the binding group in the binding group;
according to the position coordinates of the first type target characters and the first display style, correspondingly displaying the first type target characters in the HMI;
displaying the binding group correspondingly in the HMI according to the position coordinates of the binding group and the second display style;
and obtaining the HMI flow chart according to the first type target characters displayed in the HMI and the binding group.
6. The apparatus according to claim 5, wherein the first determining unit is configured to determine a target device and a target character included in the picture, and determine position coordinates of the target device and the target character, and includes:
the first determining unit is specifically configured to determine each graphic element included in the picture by using a pre-trained graphic detection model, and locate each graphic element to obtain a position coordinate of the graphic element, where the graphic element includes an equipment graphic element and a character graphic element;
Performing image recognition on the equipment graphic element, determining target equipment corresponding to the equipment graphic element, and taking the position coordinate of the equipment graphic element as the position coordinate of the target equipment;
and carrying out character content recognition on the character graphic element, determining a character corresponding to the character graphic element, judging whether the character corresponding to the character graphic element exists in a preset character data table, if so, taking the character corresponding to the character graphic element as the target character, and taking the position coordinate of the character graphic element as the position coordinate of the target character.
7. The apparatus of claim 6, further comprising a training unit configured to obtain the graphical detection model, comprising:
the training unit is specifically configured to obtain a sample picture, where the sample picture includes the device graphic element and the character graphic element, the device graphic element carries a device classification tag and a device position tag, and the character graphic element carries a character classification tag and the position tag;
and training a preset basic model by adopting the sample picture to obtain the graph detection model.
8. The apparatus according to claim 5, wherein the second determining unit is configured to determine, for each of the second type of target characters, the associated device of the second type of target character from the target devices, including:
the second determining unit is specifically configured to calculate a distance difference between the position coordinates of the second type of target characters and the position coordinates of each target device, and use a target device corresponding to the distance difference with the smallest difference as the associated device of the second type of target characters.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010245767.6A CN111460767B (en) | 2020-03-31 | 2020-03-31 | HMI flow chart generation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010245767.6A CN111460767B (en) | 2020-03-31 | 2020-03-31 | HMI flow chart generation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111460767A CN111460767A (en) | 2020-07-28 |
| CN111460767B true CN111460767B (en) | 2024-01-19 |
Family
ID=71680153
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010245767.6A Active CN111460767B (en) | 2020-03-31 | 2020-03-31 | HMI flow chart generation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111460767B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112596786B (en) * | 2020-12-22 | 2022-10-18 | 浙江中控技术股份有限公司 | HMI flow chart generation method and device, storage medium and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002351774A (en) * | 1996-05-30 | 2002-12-06 | Matsushita Electric Ind Co Ltd | Data converting device and data receiving device of data communication system |
| CN105302535A (en) * | 2014-07-31 | 2016-02-03 | 青岛海尔智能家电科技有限公司 | Method and apparatus for generating man-machine interaction interface |
| CN107111748A (en) * | 2014-10-01 | 2017-08-29 | Abb瑞士股份有限公司 | For the method and system for the device that control system is configured based on engineering pattern object |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080189637A1 (en) * | 2006-10-16 | 2008-08-07 | Invensys Systems, Inc. | Data quality and status behavior for human machine interface graphics in industrial control and automation systems |
| KR20170112588A (en) * | 2016-03-31 | 2017-10-12 | 엘에스산전 주식회사 | Human machine interface system |
-
2020
- 2020-03-31 CN CN202010245767.6A patent/CN111460767B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002351774A (en) * | 1996-05-30 | 2002-12-06 | Matsushita Electric Ind Co Ltd | Data converting device and data receiving device of data communication system |
| CN105302535A (en) * | 2014-07-31 | 2016-02-03 | 青岛海尔智能家电科技有限公司 | Method and apparatus for generating man-machine interaction interface |
| CN107111748A (en) * | 2014-10-01 | 2017-08-29 | Abb瑞士股份有限公司 | For the method and system for the device that control system is configured based on engineering pattern object |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111460767A (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109840519B (en) | Self-adaptive intelligent bill identification and input device and application method thereof | |
| US9767531B2 (en) | Systems and methods for scaling visualizations | |
| US11341319B2 (en) | Visual data mapping | |
| CN111460767B (en) | HMI flow chart generation method and device | |
| CN111259969A (en) | Failure reporting identification method, device, server and medium | |
| CN113963033B (en) | Power equipment abnormality detection method and system based on artificial intelligence | |
| CN111966600B (en) | Webpage testing method, webpage testing device, computer equipment and computer readable storage medium | |
| CN117115823A (en) | Tamper identification method and device, computer equipment and storage medium | |
| CN111723799A (en) | Coordinate positioning method, device, equipment and storage medium | |
| CN112434585A (en) | Method, system, electronic device and storage medium for identifying virtual reality of lane line | |
| CN112613367A (en) | Bill information text box acquisition method, system, equipment and storage medium | |
| CN108279962B (en) | Method and device for creating visual data display interface | |
| JP2809762B2 (en) | Figure shaping device | |
| CN115631374A (en) | Control operation method, control detection model training method, device and equipment | |
| CN113902890A (en) | Self-supervision data enhancement method, system and equipment for visual concept detection | |
| CN113407080A (en) | Method and device for generating component label, computer equipment and storage medium | |
| CN113642642A (en) | Control identification method and device | |
| CN111696154A (en) | Coordinate positioning method, device, equipment and storage medium | |
| CN115298691A (en) | Learning device and learning method | |
| CN115298626A (en) | Work management device and work state determination method | |
| CN113158632B (en) | Table reconstruction method for CAD drawing and computer readable storage medium | |
| CN113177995B (en) | Text reorganization method of CAD drawing and computer readable storage medium | |
| CN114663414B (en) | Rock and ore recognition and extraction system and method based on UNET convolutional neural network | |
| CN113158632A (en) | Form reconstruction method for CAD drawing and computer readable storage medium | |
| CN116578217A (en) | Engineering drawing-based tolerance interface operation method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |