CN113220186A - Automatic configuration method and device based on image recognition and electronic equipment - Google Patents

Automatic configuration method and device based on image recognition and electronic equipment Download PDF

Info

Publication number
CN113220186A
CN113220186A CN202110765679.3A CN202110765679A CN113220186A CN 113220186 A CN113220186 A CN 113220186A CN 202110765679 A CN202110765679 A CN 202110765679A CN 113220186 A CN113220186 A CN 113220186A
Authority
CN
China
Prior art keywords
image
target
equipment
state
attribute
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110765679.3A
Other languages
Chinese (zh)
Inventor
胡卫军
卢奕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Huaxin Data System Co ltd
Original Assignee
Wuhan Huaxin Data System Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Huaxin Data System Co ltd filed Critical Wuhan Huaxin Data System Co ltd
Priority to CN202110765679.3A priority Critical patent/CN113220186A/en
Publication of CN113220186A publication Critical patent/CN113220186A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application provides an automatic configuration method and device based on image recognition and electronic equipment. The method comprises the following steps: loading a 3D target main picture image to a display interface, loading a 3D equipment state image corresponding to equipment to be configured, carrying out image recognition on the target main picture image through an image recognition technology to determine the target equipment to be configured in the target main picture image and the position information of the target equipment to be configured in the target main picture, matching the target equipment image of the target equipment to be configured with the equipment state image, placing the successfully matched target equipment state image at the target position corresponding to the position information, acquiring the structural variable of the target equipment to be configured, and binding the target equipment state image with the corresponding running state attribute in the structural variable one by one, thus completing the automatic configuration of the target equipment to be configured. The embodiment of the application improves the configuration efficiency and the configuration accuracy of the equipment to be configured.

Description

Automatic configuration method and device based on image recognition and electronic equipment
Technical Field
The present application relates to the field of data processing technologies, and in particular, to an automatic configuration method and apparatus based on image recognition, and an electronic device.
Background
With the development of society, the water treatment capacity of water utilities, such as sewage treatment plants, water supply plants and the like, is increasing, and the devices in the water utilities, such as various valves, various pumps, various fans, various instruments and the like, are increasing and need to be monitored and controlled. The configuration can realize the monitoring and control of the automatic process and the device, can collect various information from the automatic process and the automatic equipment, and displays the information in a mode which is easy to understand, such as graphical mode, and the like, so that management or operating personnel can intuitively monitor and control the automatic process or the device.
At present, the configuration is usually implemented by manual operation, for example, manually processing device pictures in various pictures to configure the corresponding devices. Due to the fact that the equipment is numerous, the equipment is configured in a manual operation mode, efficiency is low, and the equipment is complex and prone to error.
Disclosure of Invention
The embodiment of the application provides an automatic configuration method and device based on image recognition and an electronic device, which can realize automatic configuration of a device to be configured and improve configuration efficiency and configuration accuracy of the device to be configured.
The embodiment of the application provides an automatic configuration method based on image identification, which comprises the following steps:
loading a 3D target main picture image to a display interface;
loading 3D equipment state images corresponding to a plurality of equipment to be configured, wherein the equipment state image corresponding to each equipment to be configured is multiple, and each equipment state image comprises the equipment to be configured and information of one running state corresponding to the equipment to be configured;
carrying out image recognition on the target main picture image by using an image recognition technology so as to recognize target equipment to be configured in the target main picture image and determine the position information of the target equipment to be configured in the target main picture image;
matching a target device image corresponding to the target device to be configured with the device state image, and placing the successfully matched target device state image at a target position corresponding to the position information;
acquiring a structural variable of the target equipment to be configured, wherein the structural variable comprises an operation state attribute of the target equipment to be configured;
and binding the target equipment state images and the corresponding running state attributes one by one according to the running state information so as to complete the configuration of the target equipment to be configured.
The embodiment of the present application further provides a configuration device based on image recognition, including:
the first loading module is used for loading the 3D target main picture image to a display interface;
the second loading module is used for loading the 3D equipment state images corresponding to a plurality of equipment to be configured, wherein the equipment state image corresponding to each equipment to be configured is multiple, and each equipment state image comprises the equipment to be configured and information of one running state corresponding to the equipment to be configured;
the identification determination module is used for carrying out image identification on the target main picture image by utilizing an image identification technology so as to identify the target equipment to be configured in the target main picture image and determine the position information of the target equipment to be configured in the target main picture image;
a matching and placing module, configured to match a target device image corresponding to the target device to be configured with the device state image, and place the successfully matched target device state image at a target position corresponding to the position information;
an obtaining module, configured to obtain a structural variable of the target device to be configured, where the structural variable includes an operation state attribute of the target device to be configured;
and the first binding module is used for binding the target equipment state images and the corresponding running state attributes one by one according to the running state information so as to complete the configuration of the target equipment to be configured.
An embodiment of the present application further provides an electronic device, where the electronic device includes:
one or more processors; a memory; and one or more computer programs, wherein the processor is coupled to the memory, the one or more computer programs being stored in the memory and configured to be executed by the processor to perform the image recognition-based auto-configuration method described above.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps in any of the above automatic configuration methods based on image recognition are implemented.
The embodiment of the application loads a 3D device state image corresponding to a device to be configured by loading a 3D target main picture image to a display interface, identifies the target device to be configured in the target main picture image and the position information of the target device to be configured in the target main picture by image identification technology, matches the target device image of the target device to be configured with the device state image, and places the successfully matched target device state image at the target position corresponding to the position information, so that the target device state image matched with the target device to be configured is automatically placed at the target position corresponding to the target device to be configured, the target device state image is automatically placed, the placing accuracy and the placing efficiency are improved, and the structural variables of the target device to be configured are obtained, the target equipment state image and the corresponding running state attributes in the structural variables are bound one by one, and the display of the target equipment state image is determined through the running state attributes in the structural variables, so that the automatic configuration of the target equipment to be configured is completed, the configuration efficiency and the configuration accuracy of the equipment to be configured are improved, and the labor cost of manual configuration is reduced; on the other hand, the equipment to be configured is configured by utilizing the 3D equipment state image and the target main picture image, so that the equipment to be configured displayed on the display interface is displayed in a 3D mode, therefore, management or operating personnel can monitor and control the automatic process or device in a three-dimensional mode, the monitoring and control accuracy is improved, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart illustrating an automatic configuration method based on image recognition according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a main screen image provided in an embodiment of the present application;
fig. 3 is a schematic diagram of an apparatus state image of an apparatus to be configured according to an embodiment of the present disclosure;
FIG. 4 is another schematic flow chart illustrating an automatic configuration method based on image recognition according to an embodiment of the present disclosure;
FIG. 5 is a schematic flow chart illustrating an automatic configuration method based on image recognition according to an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a pop-up interface provided by an embodiment of the present application;
FIG. 7 is a schematic diagram illustrating an exemplary configuration apparatus based on image recognition according to an embodiment of the present disclosure;
FIG. 8 is a schematic diagram of another configuration apparatus based on image recognition according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides an automatic configuration method and device based on image recognition, electronic equipment and a storage medium. Any one of the configuration devices based on image recognition provided by the embodiments of the present application can be integrated in an electronic device. The electronic device includes, but is not limited to, a smart phone, a tablet Computer, a notebook Computer, a smart television, a smart robot, a Personal Computer (PC), a server Computer, and the like. The automatic configuration method based on image recognition is applied to electronic equipment, for example, can be applied to software corresponding to a Supervisory Control And Data Acquisition (SCADA) system in the electronic equipment.
Please refer to fig. 1, which is a flowchart illustrating an automatic configuration method based on image recognition according to an embodiment of the present disclosure. The automatic configuration method based on the image recognition is applied to electronic equipment and comprises the following steps.
And 101, loading the 3D target main picture image to a display interface.
The target main picture image can be a picture image to be monitored and controlled in the water business industry, and can also be a picture image to be monitored and controlled in other industries. In the embodiment of the present application, a screen image to be monitored and controlled in the water service industry is taken as an example for description.
The target main screen image may be the entire screen image to be monitored and controlled or may be a part of the screen image to be monitored and controlled. Correspondingly, the target main picture image may be one or more. When the target main picture image is divided into a plurality of pictures, the whole picture to be monitored and controlled is divided into a plurality of pictures, or a part of the picture to be monitored and controlled is divided into a plurality of pictures.
The target home screen image includes an apparatus image of the apparatus to be configured.
Fig. 2 is a schematic diagram of a main image provided by an embodiment of the present application, where the main image is a part of an image to be monitored and controlled, and a plurality of devices to be configured, such as water pumps and valves, are displayed in the main image. It should be noted that the gray scale in fig. 2 is to indicate what the target main picture image is, and if the target main picture image is replaced by a line graph, the corresponding effect cannot be achieved.
It should be noted that the target main picture image provided in the embodiment of the present application is a 3D image, and the 3D image may be an image obtained by 3D rendering through 3D software, or may be a 3D image acquired through other devices. Compared with a 2D main picture image, the 3D target main picture image can observe various state information of the equipment to be configured more three-dimensionally, so that the monitoring and control accuracy is improved, and the observation experience is improved.
The display interface may be a designated display interface in a Supervisory Control And Data Acquisition (SCADA) system, And the designated display interface is used to display a picture image to be monitored And controlled.
The loading of the 3D target home screen image to the display interface may be reading and loading the 3D target home screen image from the first preset folder to the display interface. The first preset folder is a folder for placing the target main picture image. The target home screen image includes first identification information such as a file name of the target home screen image. The first identification information may uniquely identify one target main picture image.
In an embodiment, the step of loading the 3D target home screen image to the display interface includes: acquiring first identification information and a position attribute of a 3D target main picture image (in a preset file); and loading the target main picture image corresponding to the first identification information from a first preset folder to a display interface, and placing the target main picture image at a position corresponding to the position attribute on the display interface.
Understandably, the first identification information and the position attribute of each target home screen image are saved in a file in advance, and the file in which the first identification information and the position attribute of the target home screen image are saved is taken as a preset file. The preset file may be an excel file, or may be a database file or a file with other format, etc. And no matter how many target main picture images exist, each target main picture image corresponds to one position attribute, and when the target main picture image corresponding to the first identification information is loaded to the display interface, the target main picture image is placed at the position corresponding to the position attribute. Therefore, the accurate control of the placement position of the target main picture image is achieved. In addition, only the target main picture image corresponding to the first identification information in the preset file is loaded so as to quickly determine the target main picture image.
102, loading a plurality of 3D device state images corresponding to devices to be configured, wherein the device state image corresponding to each device to be configured is multiple, and each device state image includes information of the devices to be configured and an operation state corresponding to the devices to be configured.
The equipment to be configured comprises a plurality of equipment in the water service industry, and the plurality of equipment can comprise a plurality of equipment of the same type or a plurality of equipment of different types.
And determining an equipment state image corresponding to the equipment to be configured according to the running state information of the equipment to be configured. For example, the number of the set device state images is the same as the number of states of the operating states, and accordingly, each operating state corresponds to a device state image one by one. Each device state image comprises equipment to be configured and information corresponding to one running state of the equipment to be configured.
The operation states of the device include at least two, and in the embodiment of the present application, four operation states are taken as an example for description. For example, the number of states of the operating states corresponding to the device to be configured is four, and correspondingly, there are four device state images. The four operation states are respectively start (normal), stop, fault, broken line and the like, correspondingly, the operation state is that the start corresponds to an equipment state image representing the normal operation state, the operation state is that the stop corresponds to an equipment state image representing the stop operation state, the operation state is that the fault corresponds to an equipment state image representing the fault operation state, and the operation state is that the broken line corresponds to an equipment state image representing the broken line operation state.
In one embodiment, the device status image includes devices to be configured, and the devices to be configured may represent the operation status of start (normal), stop, fault, disconnection, etc. with different colors. If the equipment to be configured in the equipment state image is red, the equipment to be configured is in a stop operation state, the equipment to be configured is yellow, the equipment to be configured is in a fault operation state, the equipment to be configured is green, the equipment to be configured is in a normal operation state, and the equipment to be configured is gray, the equipment to be configured is in a broken line operation state. Different running states of the equipment to be configured are represented by different colors, so that an operator can know the current running state of the equipment to be configured at a glance, and the user experience is improved.
Fig. 3 is a schematic diagram of four device state images of a device to be configured according to an embodiment of the present disclosure. As can be seen from fig. 3, the color of the device to be configured in the four device status images is different, and the others are the same. It should be noted that the gray scale in fig. 3 is to indicate that the colors of the devices to be configured are different.
In an embodiment, loading the 3D device state images corresponding to the plurality of devices to be configured may be from a second preset folder. The second preset folder is a folder in which the device state image is placed. Each device status image includes second identification information, which may be a file name or the like of the device status image. The second identification information uniquely identifies a device status image.
In an embodiment, the loaded device state images of the multiple devices to be configured may be device state images corresponding to the devices to be configured in the target home screen image one to one, or may not be corresponding to one. For example, there are four devices to be configured in the target home screen image, and when the devices to be configured correspond to one another, the loaded device state image of the device to be configured is also the device state image of the four devices to be configured; if the device state images are not consistent with each other, the loaded device state images of the devices to be configured may also be device state images of three devices to be configured, or device state images of five devices to be configured, and the like (subsequently, unmatched device state images are deleted from the display interface).
In an embodiment, the step of loading the 3D device state images corresponding to the plurality of devices to be configured includes: acquiring first identification information (such as file names of the target home picture images) of the 3D target home picture images (in a preset file), and acquiring second identification information (such as file names of the device state images) of the 3D device state images of a plurality of devices to be configured, which corresponds to the first identification information; and loading the equipment state image corresponding to the second identification information from the second preset folder. In the embodiment, only the device state images of the plurality of devices to be configured corresponding to the target main picture image are loaded, so that the state images of other devices are prevented from being loaded by mistake, and the configuration efficiency is reduced.
103, performing image recognition on the target home screen image by using an image recognition technology to recognize the target equipment to be configured in the target home screen image and determine the position information of the target equipment to be configured in the target home screen image.
The image recognition technology may be an image recognition technology based on OpenCV (BSD license (open source) based cross-platform computer vision and machine learning software library), an image detection technology or other image recognition technologies.
And carrying out image recognition on the target main picture image by using an image recognition technology so as to recognize the target equipment to be configured in the target main picture image and determine the position information of the target equipment to be configured in the target main picture image. The equipment to be configured identified from the target main picture image by using the image identification technology is used as the target equipment to be configured, and the position information of the identified equipment to be configured is used as the position information of the target equipment to be configured. For example, the position information may be represented by (x, y, w, h), where x and y represent the x coordinate and y coordinate of the target device to be configured in the target home screen image (with the upper left corner as the origin), respectively, and w and h represent the width and height of the target device to be configured in the target home screen image, respectively.
The number of the identified target devices to be configured may be one or more. If the target device to be configured is one, the corresponding position information is one, and if the target device to be configured is multiple, the corresponding position information is multiple. And taking the equipment to be configured identified from the target main picture image by using an image identification technology as target equipment to be configured.
The image recognition technology is utilized to automatically realize the positioning of the target equipment to be configured in the target main picture image, and the configuration efficiency and the configuration accuracy are improved.
And 104, matching the target equipment image corresponding to the target equipment to be configured with the equipment state image, and placing the successfully matched target equipment state image at the target position corresponding to the position information.
The target device image corresponding to the target device to be configured refers to the device image corresponding to the target device to be configured identified in the target home screen image. And after the target equipment image is determined, matching the target equipment image with the equipment state image.
In one embodiment, matching the target device image with the device status image includes: acquiring target image attributes of a target equipment image and image attributes of an equipment state image, wherein the image attributes comprise image size, image shape and the like; matching the target image attributes of the target device image with the image attributes of the device status image. And if the target image attribute of the target equipment image is the same as the image attribute of the equipment state image, the matching is considered to be successful, otherwise, the matching is considered to be failed. The embodiment performs matching through the image attributes, accelerates the matching speed, and improves the configuration efficiency.
In one embodiment, matching the target device image with the device status image includes: and determining target characteristic information of the target equipment image and characteristic information of the equipment state image, and matching the target image attribute of the target equipment image with the image attribute of the equipment state image. If the similarity of the characteristic information is greater than the preset similarity, if so, the matching is considered to be successful, otherwise, the matching is considered to be failed.
In one embodiment, matching the target device image with the device status image includes: acquiring a target image attribute of a target equipment image corresponding to a target equipment to be configured and an image attribute of an equipment state image; determining target characteristic information of a target equipment image and characteristic information of an equipment state image; and matching the target image attribute with the image attribute, and matching the target characteristic information with the characteristic information. If the target image attribute and the image attribute, and the target characteristic information and the characteristic information are successfully matched, the matching is considered to be successful; otherwise, the match is considered to fail. The embodiment performs matching in two dimensions from image attributes and feature information to improve matching accuracy.
In an embodiment, image attribute matching may be performed first, and when the device state images exceeding the number of states corresponding to the operating state are matched, matching may be performed further according to the feature information, so as to avoid a situation that the image attributes of the two target devices to be configured are the same, and the actual devices are different.
And determining the equipment state image successfully matched with the target equipment image of the target equipment to be configured as a target equipment state image, and placing the target equipment state image at the target position corresponding to the position information. For example, the device state image of the target device to be configured in the normal operation state, the device state image of the stop operation state, the device state image of the fault operation state, and the device state image of the disconnection operation state are all determined as target device state images, and the four target device state images are finally placed at the target position.
And 105, acquiring the structural variable of the target equipment to be configured, wherein the structural variable comprises the running state attribute of the target equipment to be configured.
Establishing a corresponding structural variable for the device to be configured in advance, for example, attributes in the structural variable of a certain device to be configured include: device type identification, device identification, start, stop, fault, disconnect, pop-up window attributes, and the like. Starting, stopping, faults, disconnection and the like are used as running state attributes of the target equipment to be configured.
The structural variables of the target equipment to be configured also have corresponding attributes. And acquiring the running state attribute of the structural variable of the target equipment to be configured. Specifically, the method comprises the following steps: acquiring a device type identifier and a device identifier of a target device to be configured, wherein the device type identifier and the device identifier can uniquely determine the target device to be configured; and acquiring the structural variable of the target equipment to be configured according to the equipment type identifier and the equipment identifier. The device identifier may be a device name and/or a device number; the device type identifier may be a device type name and/or a device type number, etc.
And 106, binding the target equipment state images and the corresponding running state attributes one by one according to the running state information to complete the configuration of the target equipment to be configured.
And binding the target equipment state image with the corresponding running state attributes one by one according to the running state information in the target equipment state image. If the target equipment state image representing the starting operation state is bound with the starting attribute in the structure variable, the target equipment state image representing the stopping operation state is bound with the stopping attribute in the structure variable, the target equipment state image representing the fault operation state is bound with the fault attribute in the structure variable, and the target equipment state image representing the disconnection operation state is bound with the disconnection attribute in the structure variable. And binding the target equipment state image with the corresponding running state attribute one by one so as to determine the display of the target equipment state image through the running state attribute in the structural variable. Thus, the automatic configuration of the target equipment to be configured is completed.
In an embodiment, the step of binding the target device status images and the corresponding operating status attributes one by one according to the operating status information includes: and adding a display condition attribute to the target equipment state image, and corresponding the display condition attribute to the running state attribute matched with the running state information so as to realize one-to-one binding of the target equipment state image and the corresponding running state attribute. It can be understood that a display condition attribute is added to each target device state image of the target device to be configured, and the display condition attribute of the target device state image corresponds to the running state attribute matched with the running state information in a one-to-one manner. Such as the display condition attribute of the target apparatus state image indicating the startup operation state corresponding to the startup attribute, and the like.
The one-to-one correspondence between the display condition attribute of the target device status image and the running status attribute matched with the running status information includes: setting the display condition attribute of the target device state image to be the corresponding running state attribute, or setting the attribute value of the display condition attribute of the target device state image to be the attribute value of the corresponding running state attribute, or by other means.
The display condition attribute is added to the target equipment state image to bind with the running state attribute through the display condition attribute, so that the binding of the target equipment state image and the running state attribute can be quickly realized, and the binding accuracy is improved.
The method comprises the steps of automatically placing a target equipment state image matched with a target equipment to be configured at a target position corresponding to the target equipment to be configured, automatically placing the target equipment state image, improving placing accuracy and placing efficiency, then obtaining a structural variable of the target equipment to be configured, binding the target equipment state image and a corresponding running state attribute in the structural variable one by one, and determining display of the target equipment state image according to the running state attribute in the structural variable, so that automatic configuration of the target equipment to be configured is completed, configuration efficiency and configuration accuracy of the equipment to be configured are improved, and labor cost of manual configuration is reduced.
In an embodiment, the automatic configuration method based on image recognition further includes: combining the state images of the target equipment placed at the same target position to obtain an image combination; and binding the target equipment to be configured corresponding to the picture combination with the popup property.
The target device state images placed at the same target position are target device state images of a target device to be configured, and combining the target device state images placed at the same target position can be understood as combining the target device state images of the same target device to be configured. The target equipment state images of the same target equipment to be configured are combined, so that the target equipment state images of the same target equipment to be configured can be fixed, and other function settings can be performed on the image combination to realize other corresponding functions.
And combining the state images of the target equipment at the same target position to obtain a picture combination, and binding the target equipment to be configured corresponding to the picture combination with the popup property to realize the popup function of the target equipment to be configured. The corresponding popup attribute can be triggered through the key to trigger the corresponding popup function.
In an embodiment, the step of binding the target device to be configured corresponding to the picture combination and the popup property includes: and adding a button popup attribute for the picture combination, and binding the button popup attribute corresponding to the picture combination with the popup attribute in the structural variable.
By adding the button popup attribute to the picture combination, the target device to be configured corresponding to the picture combination is quickly bound with the popup attribute, the configuration efficiency is improved, and the popup function of the target device to be configured is realized after the configuration is successful.
In an embodiment, before the step of loading the 3D device state images corresponding to the plurality of devices to be configured, the method further includes: acquiring a 3D main picture image; identifying equipment to be configured in the main picture image by using an image identification technology, and cutting the equipment to be configured to obtain an equipment image of the equipment to be configured; copying the equipment image to achieve the number of copies which is the same as the number of the running states of the equipment to be configured; and carrying out image processing on the copied equipment image according to the running state so as to obtain an equipment state image corresponding to each running state of the equipment to be configured. The details of the steps in this embodiment are referred to the corresponding description hereinafter. In the embodiment, the image recognition technology is used for cutting the main picture image, and the image recognition technology is used for positioning the equipment to be configured in the target main picture image in the subsequent steps, so that the target equipment to be configured, which is positioned by the image recognition technology, is consistent with the size of the equipment to be configured, which is obtained by cutting, and the positioning is convenient.
It should be noted that the above embodiments can be implemented by means of a script, such as a VBA script. VBA, Visual Basic for Applications, is a programming language for executing common automation (OLE) tasks in its desktop Applications. Configuration is automatically realized through the script, and the configuration efficiency and accuracy are improved.
Fig. 4 is another flowchart of an automatic configuration method based on image recognition according to an embodiment of the present disclosure. The automatic configuration method based on the image recognition is applied to electronic equipment and comprises the following steps.
A rendered 3D home screen image is acquired 201.
In this embodiment, the home screen image is rendered using 3D software. Such as obtaining the home screen image from the first preset folder. The main picture image corresponds to first identification information, such as a file name of the main picture image.
202, clipping and image processing are performed on the equipment to be configured in the main picture image, so as to obtain an equipment state image corresponding to each operation state of the equipment to be configured.
The main picture image comprises an equipment image of the equipment to be configured, the equipment to be configured in the main picture image is cut to obtain the equipment image, and the equipment image is subjected to image processing to obtain an equipment state image corresponding to each running state of the equipment to be configured. The equipment to be configured comprises a plurality of operation states, and each operation state corresponds to an equipment state image.
In one embodiment, step 202 comprises: identifying equipment to be configured in the main picture image, and cutting the equipment to be configured to obtain an equipment image of the equipment to be configured; copying the equipment image to achieve the number of copies which is the same as the number of the running states of the equipment to be configured; and carrying out image processing on the copied equipment image according to the running state so as to obtain an equipment state image corresponding to each running state of the equipment to be configured.
Wherein the cropped device image is also 3D. And copying the cut equipment image to achieve the number of copies which is the same as the number of the running states of the equipment to be configured. If the number of the running states of the equipment to be configured is 4, the equipment images are copied to obtain 4 equipment images. And carrying out image processing on the 4 copied equipment images according to the running states to obtain equipment state images corresponding to all the running states of the equipment to be configured.
For example, if the running state is starting, processing the color of the equipment to be configured in the equipment image to be green to obtain an equipment state image corresponding to the normal running state; if the running state is stopped, processing the color of the equipment to be configured in the equipment image into red to obtain an equipment state image corresponding to the stopped running state; if the running state is a fault, processing the color of the equipment to be configured in the equipment image into yellow to obtain an equipment state image corresponding to the fault running state; and if the running state is the broken line, processing the color of the equipment to be configured in the equipment image into gray to obtain an equipment state image corresponding to the broken line running state.
Further, after the device state image corresponding to each operating state of the device to be configured is obtained, the device state image corresponding to each operating state is named according to a preset naming rule to obtain a file name corresponding to the device state image, and the file name corresponding to the device state image is used as second identification information of the device state image. If the device state images of the running states of starting, stopping, faults, disconnection and the like corresponding to the device 1 to be configured are named as A1-1.jpg, A1-2.jpg, A1-3.jpg and A1-4.jpg respectively; the equipment state images of the running states such as starting, stopping, fault, disconnection and the like corresponding to the equipment 2 to be configured are named as A2-1.jpg, A2-2.jpg, A2-3.jpg and A2-4.jpg respectively. The device name and/or the device number of the device to be configured, or the area name and/or the area number of the device to be configured, and the like, may be used as the device name and/or the device number of the device to be configured.
The step includes identifying the equipment to be configured in the main picture image, and cutting and processing the equipment to be configured to obtain equipment state images corresponding to the running states of the equipment to be configured, so that configuration efficiency is improved.
And 203, saving the device state image into a second preset folder.
204, creating the structure variable of the equipment to be configured.
The structural variables of the device to be configured include a plurality of attributes of the device to be configured, such as device type identifier, device identifier, start, stop, fault, disconnection, popup attribute, and the like. Starting, stopping, faults, broken lines and the like are used as running state attributes of the equipment to be configured.
205, a preset file is established, and the preset file is filled according to the home screen image, the device to be configured in the home screen image, and the device state image corresponding to each operation state of the device to be configured.
The preset file may be an excel file, or may be another database file, etc.
Specifically, the preset file is filled according to the first identification information of the home screen image, the device name and the device type name of the device to be configured, each operation state, and the second identification information of the device state image corresponding to each operation state of the device to be configured. The fields and corresponding values in the populated default file may be as shown in table 1 in the following table.
Table 1 fields and corresponding values in a preset file
Figure 302556DEST_PATH_IMAGE001
In table 1, the main screen image 1111.jpg includes a No. 1 inlet valve (a No. 1 inlet valve), a No. 2 inlet valve (a No. 2 inlet valve), and a No. 1 fine grid (a No. 1 fine grid) of the device to be configured. The device state images corresponding to the operating states of each device to be configured are different.
In one embodiment, when the picture to be monitored and controlled is relatively large, the main picture image can be divided into a plurality of corresponding pictures.
No matter how many main picture images are, the position attribute of each main picture image in the display interface can be set, and correspondingly, the position attribute of each main picture image is saved in a preset file and is not listed in table 1.
206, writing a configuration script of the equipment to be configured.
The VBA language can be used to write a configuration script for the device to be configured.
207, the configuration script is executed.
After the configuration script of the equipment to be configured is compiled, the automatic configuration of the equipment to be configured can be completed by executing the configuration script by one key.
The execution logic of the auto-configuration script may be the same as described above in the previous embodiment of FIG. 4, or as shown in FIG. 5. Fig. 5 is a flowchart illustrating a further automatic configuration method based on image recognition according to an embodiment of the present disclosure, which includes the following steps.
301, first identification information and a position attribute of a 3D target home screen image are acquired from a preset file.
The target main picture image comprises a main picture image needing monitoring control, the first identification information comprises a file name and the like of the target main picture image, and the position attribute comprises display position information of the target main picture image in a display interface.
302, loading a target home screen image corresponding to the first identification information from the first preset folder to the display interface, and placing the target home screen image at a position corresponding to the position attribute on the display interface.
No matter the number of the target main picture images is one or more, the target main picture images are placed at the positions corresponding to the position attributes on the display interface, so that the target main picture images can be accurately placed, and the accurate control of the placement positions of the target main picture images is achieved. In addition, only the target main picture image corresponding to the first identification information in the preset file is loaded, and redundant main picture images cannot be loaded, so that the target main picture image can be quickly determined.
303, obtaining second identification information of the 3D device status images of the multiple devices to be configured corresponding to the first identification information from a preset file, where there are multiple device status images corresponding to each device to be configured.
And acquiring a plurality of devices to be configured corresponding to the first identification information and second identification information of the 3D device state images of the plurality of devices to be configured from a preset file according to the first identification information, namely acquiring the devices to be configured included in the target main picture image and the second identification information of the 3D device state images of the devices to be configured. The second identification information includes a file name of the device status image and the like.
It can be easily understood that the second identification information is acquired according to the first identification information. The first identification information includes a file name of the target home screen image, such as 1111.jpg in table 1; the second identification information includes file names of device status images of devices to be configured in the target home screen image, such as a1-1.jpg, a1-2.jpg, a1-3.jpg, a1-4.jpg, a2-1.jpg, a2-2.jpg, a2-3.jpg, a2-4.jpg, B2-1.jpg, B2-2.jpg, B2-3.jpg, B2-4.jpg, and the like in table 1.
304, loading device status images corresponding to the second identification information from a second preset folder, where each device status image includes a device to be configured and information corresponding to an operating status of the device to be configured.
Specifically, the device state image corresponding to the second identification information is loaded from the second preset folder to the display interface.
And 305, performing image recognition on the target home screen image by using an image recognition technology to identify the target device to be configured in the target home screen image and determine the position information of the target device to be configured in the target home screen image.
And 306, matching the target device image corresponding to the target device to be configured with the device state image, and placing the successfully matched target device state image at the target position corresponding to the position information.
And taking an image of the target equipment to be configured included in the target main picture image as a target equipment image, and matching the target equipment image with the equipment state image, such as matching the target equipment image with A1-1.jpg, A1-2.jpg, A1-3.jpg, A1-4.jpg, A2-1.jpg, A2-2.jpg, A2-3.jpg, A2-4.jpg, B2-1.jpg, B2-2.jpg, B2-3.jpg, B2-4.jpg and the like.
And taking the successfully matched device state image as a target device state image. Assuming that the target device image is the device image of the water inlet valve No. 1, the successfully matched device state images are A1-1.jpg, A1-2.jpg, A1-3.jpg and A1-4.jpg, A1-1.jpg, A1-2.jpg, A1-3.jpg and A1-4.jpg are taken as the target device state images corresponding to the water inlet valve No. 1, and A1-1.jpg, A1-2.jpg, A1-3.jpg and A1-4.jpg are placed at the target position corresponding to the device image of the water inlet valve No. 1 in the target main screen image. Similarly, other target devices to be configured in the target main picture image are also processed in a consistent manner.
307, combining the target device state images placed at the same target position to obtain a picture combination.
Such as combining a1-1.jpg, a1-2.jpg, a1-3.jpg, a1-4.jpg to obtain picture combination 1, combining a2-1.jpg, a2-2.jpg, a2-3.jpg, a2-4.jpg to obtain picture combination 2, and so on.
308, obtaining the structure variable of the target device to be configured, wherein the structure variable includes the running state attribute and the popup attribute of the target device to be configured.
309, adding a display condition attribute to the target device state image, and corresponding the display condition attribute to the running state attribute matched with the running state, so as to bind the target device state image and the corresponding running state attribute one by one.
And 310, adding a button popup property to the picture combination, and binding the button popup property corresponding to the picture combination with the popup property in the structural variable to complete the configuration of the target device to be configured.
If the button popup attributes are added to the picture combination 1, the picture combination 2, the picture combination … … and the like, after the configuration is completed, the popup function of the target device to be configured is realized by triggering any one target device state image in the picture combination. The key popup attribute is not added to each target equipment state image in the picture combination, and the key popup attribute is added to the picture combination, so that the efficiency of adding the key popup attribute is improved, and the configuration efficiency is further improved.
The popup function refers to popping up a popup interface corresponding to the target device to be configured when any one target device state image of the target device to be configured is triggered, and any function can be realized in the popup interface. As shown in table 1, the target device to be configured is a number 1 inlet valve, the corresponding pop-up window interface is a pop-up window interface 1, the target device to be configured is a number 2 inlet valve, and the corresponding pop-up window interface is a pop-up window interface 2.
Fig. 6 is a schematic diagram of a popup interface of a target device to be configured according to an embodiment of the present disclosure. The popup interface corresponds to a popup interface of a No. 1 fine grid, and buttons related to control states and buttons related to control modes are arranged in the popup interface. The starting, stopping and the like of the No. 1 fine grid can be realized by controlling the buttons related to the state, and the buttons related to the control mode can determine local control, remote control and the like. Information of the current running time and the accumulated running time of the No. 1 fine grid and the like are also included in the popup interface.
The pop-up interface is only a schematic diagram and does not constitute a limitation on the pop-up interface.
It should be noted that, the same steps as the above steps in the steps 301 to 310 and the corresponding advantageous effects are obtained, please refer to the description of the corresponding steps, and are not described herein again.
According to the method, the target main picture image is automatically placed at the position corresponding to the position attribute on the display interface, so that the target main picture image can be accurately placed, and the accurate control of the placement position of the target main picture image is achieved; moreover, second identification information of the 3D equipment state images of the plurality of equipment to be configured corresponding to the first identification information is obtained through the first identification information of the target main picture image, and only the equipment state images of the plurality of equipment to be configured corresponding to the target main picture image are loaded, so that the state images of other equipment are prevented from being loaded by mistake, and the configuration efficiency is reduced; the target equipment state image is placed at the position information of the target equipment to be configured through an image recognition technology, so that the placing speed and the placing accuracy of the target equipment state image are improved; during configuration, the target equipment state image and the corresponding running state attribute in the structure variable are automatically bound one by one, and the target equipment to be configured corresponding to the picture combination and the popup attribute are bound, so that the configuration efficiency, speed and accuracy are improved. In addition, the embodiment uses the 3D device state image and the target main picture image for configuration, so that the monitoring and control accuracy is improved, and the user experience is improved.
In one embodiment, after completing the configuration of the target device to be configured, the method further comprises: acquiring the current running state of target equipment to be configured; determining a target running state attribute corresponding to the current running state; and displaying an equipment state image corresponding to the target running state attribute at the target position of the target equipment to be configured on the display interface. And if the current running state of the target equipment to be configured is stopped, determining the target running state attribute as a stopping attribute, and displaying an equipment state image which corresponds to the stopping attribute and represents the stopped running at the target position of the target equipment to be configured on the display interface. Therefore, the running condition of the target equipment to be configured can be displayed in real time through the equipment state image according to the actual running condition, and the monitoring and controlling efficiency of the equipment to be configured is improved.
In one embodiment, after completing the configuration of the target device to be configured, the method further comprises: receiving a trigger operation of a picture combination of a target device to be configured; triggering the popup attribute of the target equipment to be configured according to the triggering operation; and determining to display the popup interface according to the popup attribute. The trigger operation on the picture combination of the target device to be configured may be a trigger operation on any one target device state image in the picture combination of the target device to be configured. The trigger operation may be key trigger, touch trigger, or the like. Triggering the popup window attribute of the target to be configured according to the triggering operation, and determining and displaying a corresponding popup window interface according to the popup window attribute. The embodiment can trigger and display the popup interface through triggering operation so as to realize the popup function of the target device to be configured, improve the practicability and improve the user experience.
According to the method described in the above embodiments, the present embodiment will be further described from the perspective of the configuration device based on image recognition, and the configuration device based on image recognition may be specifically implemented as an independent entity or integrated in an electronic device.
Fig. 7 is a schematic structural diagram of a configuration device based on image recognition according to an embodiment of the present disclosure. The apparatus may include a first loading module 401, a second loading module 402, an identification determination module 403, a match placement module 404, an acquisition module 405, and a first binding module 406.
The first loading module 401 is configured to load a 3D target home screen image to a display interface.
In an embodiment, the first loading module 401 is specifically configured to obtain first identification information and a location attribute of a 3D target home screen image; and loading the target main picture image corresponding to the first identification information from a first preset folder to a display interface, and placing the target main picture image at a position corresponding to the position attribute on the display interface.
The second loading module 402 is configured to load a plurality of 3D device state images corresponding to devices to be configured, where each device state image corresponding to each device to be configured includes the device to be configured and information of an operation state corresponding to the device to be configured.
In an embodiment, the second loading module 402 is specifically configured to obtain first identification information of the target home screen image; acquiring second identification information of the 3D equipment state images of the plurality of equipment to be configured corresponding to the first identification information; and loading the equipment state image corresponding to the second identification information from a second preset folder.
An identification determining module 403, configured to perform image identification on the target home screen image by using an image identification technology, so as to identify the target device to be configured in the target home screen image and determine the position information of the target device to be configured in the target home screen image.
A matching and placing module 404, configured to match the target device image corresponding to the target device to be configured with the device status image, and place the successfully matched target device status image at the target position corresponding to the position information.
An obtaining module 405, configured to obtain a structure variable of the target device to be configured, where the structure variable includes an operation state attribute of the target device to be configured.
The first binding module 406 is configured to bind the target device status image and the corresponding operating status attribute one by one according to the operating status information, so as to complete the configuration of the target device to be configured.
In an embodiment, the first binding module 406 is specifically configured to add a display condition attribute to the target device status image; and corresponding the display condition attribute with the running state attribute matched with the running state so as to realize one-to-one binding of the target equipment state image and the corresponding running state attribute.
In one embodiment, as shown in fig. 8, the image recognition-based configuration device further includes: a combination module 407 and a second binding module 408. The combining module 407 is configured to combine the target device status images placed at the same target location to obtain a picture combination. A second binding module 408, configured to bind the target device to be configured corresponding to the picture combination and the popup property.
In an embodiment, the second binding module 408 is specifically configured to add a button popup attribute to the picture combination, and bind the button popup attribute corresponding to the picture combination with the popup attribute in the structure variable.
In one embodiment, as shown in fig. 8, the image recognition-based configuration device further includes: a cropping processing module 409. The cropping processing module 409 is configured to crop and perform image processing on the device to be configured in the home screen image to obtain a device state image corresponding to each operation state of the device to be configured.
In an embodiment, the cropping processing module 409 is specifically configured to obtain a 3D main picture image; identifying equipment to be configured in the main picture image, and cutting the equipment to be configured to obtain an equipment image of the equipment to be configured; copying the equipment image to achieve the number of copies which is the same as the state number of the running state of the equipment to be configured; and carrying out image processing on the copied equipment image according to the running state so as to obtain an equipment state image corresponding to each running state of the equipment to be configured.
In one embodiment, the image recognition-based configuration device further comprises: and operating the display module. The operation display module is used for acquiring the current operation state of the target equipment to be configured; determining a target running state attribute corresponding to the current running state; and displaying an equipment state image corresponding to the target running state attribute at the target position of the target equipment to be configured on the display interface.
In one embodiment, the image recognition-based configuration device further comprises: and a pop-up window module. The system comprises a popup module, a display module and a control module, wherein the popup module is used for receiving triggering operation of picture combination of target equipment to be configured; triggering the popup attribute of the target equipment to be configured according to the triggering operation; and determining to display the popup interface according to the popup attribute.
In specific implementation, the above modules/units may be implemented as independent entities, or may be combined arbitrarily and implemented as one or several entities. The specific implementation processes of the above apparatus and each unit, and the achieved beneficial effects, may refer to the corresponding descriptions in the foregoing method embodiments, and for convenience and brevity of description, no further description is provided herein.
An electronic device according to an embodiment of the present application is further provided, as shown in fig. 9, which shows a schematic structural diagram of the electronic device according to an embodiment of the present application, specifically:
the electronic device may include components such as a processor 901 of one or more processing cores, memory 902 of one or more computer-readable storage media, Radio Frequency (RF) circuitry 903, a power supply 904, an input unit 905, and a display unit 906. Those skilled in the art will appreciate that the electronic device configurations shown in the figures do not constitute limitations of the electronic device, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components. Wherein:
the processor 901 is the control center of the electronic device. The processor is connected to various parts of the whole electronic device by various interfaces and lines, and executes various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 902 and calling data stored in the memory 902, thereby integrally monitoring the electronic device. Optionally, the processor may include one or more processing cores; preferably, the processor may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor.
The memory 902 may be used to store software programs (computer programs) and modules, and the processor 901 executes various functional applications and data processing by operating the software programs and modules stored in the memory 902. The memory 902 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 902 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 902 may also include a memory controller to provide the processor 901 access to the memory 902.
The RF circuit 903 may be used for receiving and transmitting signals during information transmission and reception, and in particular, for processing downlink information of a base station after being received by one or more processors 901; in addition, data relating to uplink is transmitted to the base station. In general, RF circuitry 903 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 903 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), and the like.
The electronic device further includes a power supply 904 (e.g., a battery) for supplying power to the various components, and preferably, the power supply 904 is logically connected to the processor 901 via a power management system, so that functions of managing charging, discharging, and power consumption are implemented via the power management system. The power supply 904 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The electronic device may further include an input unit 905, and the input unit 905 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. Specifically, in one particular embodiment, input unit 905 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 901, and can receive and execute commands sent by the processor 901. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 905 may include other input devices in addition to a touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The electronic device may also include a display unit 906, which display unit 906 may be used to display information input by or provided to the user as well as various graphical user interfaces of the electronic device, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 906 may include a Display panel, and may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may cover the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 901 to determine the type of the touch event, and then the processor 901 provides a corresponding visual output on the display panel according to the type of the touch event. Although in the figures the touch sensitive surface and the display panel are shown as two separate components to implement the input and output functions, in some embodiments the touch sensitive surface may be integrated with the display panel to implement the input and output functions.
Although not shown, the electronic device may further include a camera, a bluetooth module, and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 901 in the electronic device loads an executable file corresponding to a process of one or more application programs into the memory 902 according to the following instructions, and the processor 901 runs the application programs stored in the memory 902, so as to implement various functions as follows:
loading a 3D target main picture image to a display interface; loading 3D equipment state images corresponding to a plurality of equipment to be configured, wherein the equipment state image corresponding to each equipment to be configured is multiple, and each equipment state image comprises the equipment to be configured and information of one running state corresponding to the equipment to be configured; carrying out image recognition on the target main picture image by using an image recognition technology so as to recognize target equipment to be configured in the target main picture image and determine the position information of the target equipment to be configured in the target main picture image; matching a target device image corresponding to the target device to be configured with the device state image, and placing the successfully matched target device state image at a target position corresponding to the position information; acquiring a structural variable of the target equipment to be configured, wherein the structural variable comprises an operation state attribute of the target equipment to be configured; and binding the target equipment state images and the corresponding running state attributes one by one according to the running state information so as to complete the configuration of the target equipment to be configured.
The electronic device can implement the steps in any embodiment of the automatic configuration method based on image recognition provided in the embodiment of the present application, and therefore, the beneficial effects that can be achieved by any automatic configuration method based on image recognition provided in the embodiment of the present application can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions (computer programs) which are stored in a computer-readable storage medium and loaded and executed by a processor, or by related hardware controlled by the instructions (computer programs). To this end, an embodiment of the present invention provides a storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to perform the steps of any embodiment of the automatic configuration method based on image recognition provided by the embodiment of the present invention.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium can execute the steps in any image recognition-based automatic configuration method provided in the embodiments of the present invention, the beneficial effects that can be achieved by any image recognition-based automatic configuration method provided in the embodiments of the present invention can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
The foregoing describes in detail an automatic configuration method, an apparatus, an electronic device, and a storage medium based on image recognition provided in an embodiment of the present application, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the foregoing embodiment is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. An automatic configuration method based on image recognition is characterized by comprising the following steps:
loading a 3D target main picture image to a display interface;
loading 3D equipment state images corresponding to a plurality of equipment to be configured, wherein the equipment state image corresponding to each equipment to be configured is multiple, and each equipment state image comprises the equipment to be configured and information of one running state corresponding to the equipment to be configured;
carrying out image recognition on the target main picture image by using an image recognition technology so as to recognize target equipment to be configured in the target main picture image and determine the position information of the target equipment to be configured in the target main picture image;
matching a target device image corresponding to the target device to be configured with the device state image, and placing the successfully matched target device state image at a target position corresponding to the position information;
acquiring a structural variable of the target equipment to be configured, wherein the structural variable comprises an operation state attribute of the target equipment to be configured;
and binding the target equipment state images and the corresponding running state attributes one by one according to the running state information so as to complete the configuration of the target equipment to be configured.
2. The image-recognition-based automatic configuration method of claim 1, wherein the structural variables further include a popup property of the target device to be configured; the automatic configuration method based on image recognition further comprises the following steps:
combining the state images of the target equipment placed at the same target position to obtain an image combination;
and binding the target equipment to be configured corresponding to the picture combination with the popup property.
3. The image-recognition-based automatic configuration method of claim 1, wherein before the step of loading the 3D device status images corresponding to the plurality of devices to be configured, the method further comprises:
acquiring a 3D main picture image;
identifying equipment to be configured in the main picture image, and cutting the equipment to be configured to obtain an equipment image of the equipment to be configured;
copying the equipment image to achieve the number of copies which is the same as the state number of the running state of the equipment to be configured;
and carrying out image processing on the copied equipment image according to the running state so as to obtain an equipment state image corresponding to each running state of the equipment to be configured.
4. The image-recognition-based automatic configuration method of claim 1, wherein the step of binding the target device status images with the corresponding operating status attributes one-to-one according to the operating status information comprises:
adding a display condition attribute to the target device state image;
and corresponding the display condition attribute with the running state attribute matched with the running state so as to realize one-to-one binding of the target equipment state image and the corresponding running state attribute.
5. The image-recognition-based automatic configuration method of claim 1, wherein the step of loading the 3D home image onto a display interface comprises:
acquiring first identification information and position attributes of a 3D target main picture image;
and loading the target main picture image corresponding to the first identification information from a first preset folder to a display interface, and placing the target main picture image at a position corresponding to the position attribute on the display interface.
6. The image-recognition-based automatic configuration method of claim 1, wherein the step of loading the 3D device status images corresponding to the plurality of devices to be configured comprises:
acquiring first identification information of the target main picture image;
acquiring second identification information of the 3D equipment state images of the plurality of equipment to be configured corresponding to the first identification information;
and loading the equipment state image corresponding to the second identification information from a second preset folder.
7. The image-recognition-based automatic configuration method of claim 1, further comprising, after completing the configuration of the target device to be configured:
acquiring the current running state of the target equipment to be configured;
determining a target running state attribute corresponding to the current running state;
and displaying an equipment state image corresponding to the target running state attribute at the target position of the target equipment to be configured on the display interface.
8. The image-recognition-based automatic configuration method of claim 2, wherein the target device to be configured is further provided with a popup interface, and after the configuration of the target device to be configured is completed, the method further comprises:
receiving a trigger operation of a picture combination of a target device to be configured;
triggering the popup attribute of the target equipment to be configured according to the triggering operation;
and determining to display the popup interface according to the popup attribute.
9. A configuration device based on image recognition, comprising:
the first loading module is used for loading the 3D target main picture image to a display interface;
the second loading module is used for loading the 3D equipment state images corresponding to a plurality of equipment to be configured, wherein the equipment state image corresponding to each equipment to be configured is multiple, and each equipment state image comprises the equipment to be configured and information of one running state corresponding to the equipment to be configured;
the identification determination module is used for carrying out image identification on the target main picture image by utilizing an image identification technology so as to identify the target equipment to be configured in the target main picture image and determine the position information of the target equipment to be configured in the target main picture image;
a matching and placing module, configured to match a target device image corresponding to the target device to be configured with the device state image, and place the successfully matched target device state image at a target position corresponding to the position information;
an obtaining module, configured to obtain a structural variable of the target device to be configured, where the structural variable includes an operation state attribute of the target device to be configured;
and the first binding module is used for binding the target equipment state images and the corresponding running state attributes one by one according to the running state information so as to complete the configuration of the target equipment to be configured.
10. An electronic device comprising a processor and a memory, wherein the processor is electrically connected to the memory, the memory is used for storing instructions and data, and the processor is used for executing the steps of the image recognition-based automatic configuration method according to any one of claims 1 to 8.
CN202110765679.3A 2021-07-07 2021-07-07 Automatic configuration method and device based on image recognition and electronic equipment Pending CN113220186A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110765679.3A CN113220186A (en) 2021-07-07 2021-07-07 Automatic configuration method and device based on image recognition and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110765679.3A CN113220186A (en) 2021-07-07 2021-07-07 Automatic configuration method and device based on image recognition and electronic equipment

Publications (1)

Publication Number Publication Date
CN113220186A true CN113220186A (en) 2021-08-06

Family

ID=77081590

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110765679.3A Pending CN113220186A (en) 2021-07-07 2021-07-07 Automatic configuration method and device based on image recognition and electronic equipment

Country Status (1)

Country Link
CN (1) CN113220186A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105204458A (en) * 2015-08-11 2015-12-30 许继集团有限公司 Intelligent configuration method
CN106227513A (en) * 2016-07-12 2016-12-14 华自科技股份有限公司 Based on the method and system of graphic configuration under mobile platform
CN108089857A (en) * 2017-12-05 2018-05-29 广东雅达电子股份有限公司 A kind of industry web monitors the generation method of the page in real time
CN110533090A (en) * 2019-08-21 2019-12-03 国网江苏省电力有限公司电力科学研究院 Switch tool condition detection method and device
CN112288860A (en) * 2020-11-02 2021-01-29 四川长虹电器股份有限公司 Three-dimensional configuration diagram design system and method
CN112650493A (en) * 2020-12-25 2021-04-13 安徽鸿程光电有限公司 Method for generating control state image, using method, device and electronic equipment
CN113034680A (en) * 2021-04-06 2021-06-25 四川虹微技术有限公司 Configuration diagram display method based on desktop true three-dimensional

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105204458A (en) * 2015-08-11 2015-12-30 许继集团有限公司 Intelligent configuration method
CN106227513A (en) * 2016-07-12 2016-12-14 华自科技股份有限公司 Based on the method and system of graphic configuration under mobile platform
CN108089857A (en) * 2017-12-05 2018-05-29 广东雅达电子股份有限公司 A kind of industry web monitors the generation method of the page in real time
CN110533090A (en) * 2019-08-21 2019-12-03 国网江苏省电力有限公司电力科学研究院 Switch tool condition detection method and device
CN112288860A (en) * 2020-11-02 2021-01-29 四川长虹电器股份有限公司 Three-dimensional configuration diagram design system and method
CN112650493A (en) * 2020-12-25 2021-04-13 安徽鸿程光电有限公司 Method for generating control state image, using method, device and electronic equipment
CN113034680A (en) * 2021-04-06 2021-06-25 四川虹微技术有限公司 Configuration diagram display method based on desktop true three-dimensional

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
张颖颖等: "基于图像识别的DCS组态画面生成方法", 《电脑知识与技术》 *

Similar Documents

Publication Publication Date Title
US10147398B2 (en) Display control method and device
TWI643121B (en) Method and terminal device for displaying objects
CN107038112B (en) Application interface debugging method and device
US9760331B2 (en) Sharing a screen between electronic devices
CN107943683B (en) Test script generation method and device, electronic equipment and storage medium
CN110837398B (en) Method and terminal for displaying card of quick application
CN107958365B (en) Material information changing method and device, storage medium and electronic equipment
CN107040610B (en) Method of data synchronization, device, storage medium, terminal and server
CN106203459B (en) Picture processing method and device
CN112870724B (en) Resource management method and device, storage medium and electronic equipment
CN109584341B (en) Method and device for drawing on drawing board
US9280452B1 (en) Systems and methods for generating test cases
CN111078556B (en) Application testing method and device
CN110368676A (en) Control method, device, storage medium and the electronic equipment of touch information
CN111625383A (en) Process abnormal event processing method and device, electronic equipment and storage medium
CN104410790A (en) Information processing method and electronic equipment
CN109983428A (en) A kind of operating method and device of application
CN110765085A (en) Log information writing method, system, storage medium and mobile terminal
CN113220186A (en) Automatic configuration method and device based on image recognition and electronic equipment
CN110717486B (en) Text detection method and device, electronic equipment and storage medium
CN110827658A (en) Method and device for displaying equipment in electronic map
CN111142885A (en) eSIM device management method, device, equipment and storage medium
CN111897726B (en) Abnormality positioning method, abnormality positioning device, storage medium and mobile terminal
CN112308766B (en) Image data display method and device, electronic equipment and storage medium
CN108595325A (en) Input method software testing method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210806