CN115082670A

CN115082670A - Instrument data acquisition method, data processing method and equipment

Info

Publication number: CN115082670A
Application number: CN202210621795.2A
Authority: CN
Inventors: 周征湘; 郭夕元; 高东华
Original assignee: Alibaba China Co Ltd
Current assignee: Alibaba China Co Ltd
Priority date: 2022-06-01
Filing date: 2022-06-01
Publication date: 2022-09-20

Abstract

The embodiment of the application provides an instrument data acquisition method, a data processing method and equipment. Determining an identification model corresponding to production equipment and associated information related to the identification model; responding to image acquisition operation, and acquiring a dial plate image of the instrument of the production equipment according to the area indication information in the associated information; identifying instrument data in the dial plate image by using the identification model; according to the verification indication information in the associated information, verifying the instrument data; and sending the meter data under the condition that the verification of the meter data is successful. The technical scheme provided by the embodiment of the application improves the portability of acquiring the instrument data and ensures the accuracy of the instrument data.

Description

Instrument data acquisition method, data processing method and equipment

Technical Field

The embodiment of the application relates to the technical field of production and manufacturing, in particular to an instrument data acquisition method, a data processing method and equipment.

Background

In a product manufacturing environment, production equipment is usually configured with meters for recording operation states of the production equipment, etc., and in order to monitor operation conditions of the production equipment, react to abnormal events, etc., currently, Manufacturing Execution Systems (MES) are often used by manufacturers to manage production conditions, etc., and the MES needs to collect meter data of the production equipment.

In the related technology, production equipment is connected to an upper computer or a gateway through a serial port mode and is connected to a local area network, and an MES realizes the acquisition of instrument data through an open interface, but the data acquisition mode is complex.

Disclosure of Invention

The embodiment of the application provides an instrument data acquisition method, a data processing method and equipment, which are used for solving the technical problem that a data acquisition mode is complex in the prior art.

In a first aspect, an embodiment of the present application provides a meter data obtaining method, including:

determining an identification model corresponding to production equipment and relevant information related to the identification model;

responding to image acquisition operation, and acquiring a dial plate image of the instrument of the production equipment according to the area indication information in the associated information;

identifying instrument data in the dial plate image by using the identification model;

according to the verification indication information in the associated information, verifying the instrument data;

and sending the meter data under the condition that the verification of the meter data is successful.

In a second aspect, an embodiment of the present application provides a data processing method, including:

determining a plurality of sample images obtained by image acquisition of a meter in a production facility at a plurality of acquisition angles and/or a plurality of acquisition environments;

determining label data corresponding to the sample images respectively;

training a recognition model by using the plurality of sample images and the corresponding label data respectively;

determining relevant information corresponding to the production equipment;

establishing an incidence relation among the identification model, the incidence information and the production equipment; the identification model is used for identifying instrument data in a dial plate image of the instrument; and the associated information is used for indicating to extract the dial plate image and verifying the instrument data.

In a third aspect, an embodiment of the present application provides an electronic device, including an image acquisition component, a storage component, and a processing component;

the storage component stores one or more computer instructions; the one or more computer instructions are for execution by the processing component to invoke to implement the meter data acquisition method as described in the first aspect above.

In a fourth aspect, embodiments of the present application provide a computing device, including a storage component and a processing component;

the storage component stores one or more computer instructions; the one or more computer instructions are for execution by the processing component to perform the data processing method of the second aspect.

In the embodiment of the application, an identification model corresponding to production equipment and associated information related to the identification model are determined; responding to image acquisition operation, and acquiring a dial plate image of the instrument of the production equipment according to the area indication information in the associated information; identifying instrument data in the dial plate image by using the identification model; according to the verification indication information in the associated information, verifying the instrument data; and sending the meter data under the condition that the verification of the meter data is successful. The meter data is automatically read by collecting the dial plate image of the meter and utilizing the identification model, the portability is improved, the calibration of the meter data is realized by combining the associated information of the identification model, and the accuracy of the meter data is ensured.

These and other aspects of the present application will be more readily apparent from the following description of the embodiments.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 shows a schematic structural diagram of a system architecture to which the technical solution of the embodiment of the present application is applied;

FIG. 2 is a flow chart illustrating one embodiment of a meter data acquisition method provided herein;

FIG. 3 is a flow chart illustrating one embodiment of a data processing method provided herein;

FIG. 4 is a schematic diagram illustrating a scene interaction in a practical application according to an embodiment of the present application;

FIG. 5 is a schematic diagram illustrating the structure of one embodiment of a meter data device provided herein;

FIG. 6 is a schematic diagram illustrating an embodiment of an electronic device provided by the present application;

FIG. 7 is a block diagram illustrating an embodiment of a data processing apparatus provided herein;

FIG. 8 illustrates a schematic structural diagram of one embodiment of a computing device provided herein.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

In some of the flows described in the specification and claims of this application and in the above-described figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, the number of operations, e.g., 101, 102, etc., merely being used to distinguish between various operations, and the number itself does not represent any order of performance. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.

The technical scheme of the embodiment of the application is mainly suitable for application scenarios of instrument data acquisition, particularly instrument data of production equipment.

As described in the background, conventional meter data acquisition is complex. Moreover, certain requirements are imposed on production equipment, the production equipment is required to have corresponding interfaces, part of the production equipment may not provide acquisition interfaces, different production equipment needs to be customized and developed, and a production execution system (manufacturing execution system, abbreviated as MES) needs to integrate a plurality of production equipment, and a hardware integration mode is adopted, so that the integration workload is large, and the data acquisition cost is high.

In order to improve portability of data acquisition and reduce data acquisition cost, the inventor provides the technical scheme of the application through a series of researches.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Fig. 1 shows a schematic diagram of a system architecture to which the technical solution of the embodiment of the present application can be applied, where the system architecture may include a client 101 and a server 102.

Wherein, the connection between the client 101 and the server 102 can be established through a network. The network provides a medium for communication links between clients 101 and servers 102. The network may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The client 101 may be an APP (Application), or a web Application such as H5(HyperText Markup Language5, 5 th edition), or a light Application (also referred to as an applet, a light Application), or a cloud Application, and the client 101 is deployed in an electronic device and needs to run depending on a device or some APPs in the device. The electronic device may have a display screen and support information browsing, for example, may be a personal mobile terminal such as a mobile phone, a tablet computer, a personal computer, and the like, and may further have an image capturing function, and the like. For ease of understanding, the client is primarily represented in fig. 1 in the form of a device, and various other applications such as a human-machine conversation-type application, a model training-type application, a text processing-type application, a web browser application, a shopping-type application, a search-type application, an instant messaging tool, a mailbox client, social platform software, and the like may also be generally configured in the electronic device. Of course, the electronic device may be a proprietary device that separately configures the client, etc.

The server 102 may include a server that provides various services, such as a server for background training that provides support for models used on the client 101.

In addition, the client 101 can utilize the image capturing function of the electronic device to capture images of meters in the production equipment 103 to obtain meter data, and the like, and the client 101 can establish a network connection with a production execution system (MES)104, although in other embodiments of the present application, the production execution system 104 can be integrated in the server 102. In addition, in other embodiments of the present application, the production execution system 104 may be connected to the server 102 via a network, and the client 101 may interact information with the production execution system 104 via the server 102.

It should be noted that the server 102 may be implemented as a distributed server cluster composed of a plurality of servers, or may be implemented as a single server. The server may also be a server of a distributed system, or a server incorporating a blockchain. The server can also be a cloud server, or an intelligent cloud computing server or an intelligent cloud host with artificial intelligence technology.

It should be noted that the meter data obtaining method provided in the embodiment of the present application is generally executed by the client 101, and a corresponding meter data obtaining device is generally disposed in the client 101. However, in other embodiments of the present application, the server 102 may also have similar functions as the client 101, so as to execute the meter data obtaining method provided by the embodiments of the present application. In other embodiments, the meter data obtaining method provided by the embodiment of the present application may also be executed by the client 101 and the server 102 together.

It should be noted that, the data processing method provided in the embodiment of the present application is generally executed by the server 102, and the corresponding data processing apparatus is generally disposed in the server 102. However, in other embodiments of the present application, the client 101 may also have a similar function as the server 102, so as to execute the data processing method provided in the embodiments of the present application. In other embodiments, the data processing method provided by the embodiment of the present application may also be executed by the client 101 and the server 102 together.

It should be understood that the number of clients and servers in fig. 1 is merely illustrative. There may be any number of clients and servers, as desired for implementation. Different staff members may use different clients to obtain meter data, etc.

The number of production plants in fig. 1 is also only schematic. As will be appreciated by those skilled in the art, in an actual production environment, a production plant may deploy multiple production devices, etc., and a worker may use a client to obtain meter data, etc. for different production devices.

The details of implementation of the technical solution of the embodiments of the present application are set forth in the following.

Fig. 2 is a flowchart of an embodiment of a method for acquiring meter data according to an embodiment of the present application, where the method may include the following steps:

201: and determining the identification model corresponding to the production equipment and the relevant information related to the identification model.

The identification model can be obtained based on sample images of the instrument dial and label data training, and the label data comprises instrument data and the like corresponding to the sample images.

The meter in the embodiment of the present application may refer to a meter for measuring a production condition of a production facility at a time, which has a dial for displaying measurement data, that is, meter data. The meter data may include, for example, temperature, air pressure, electrical quantity, blood pressure, flow, production volume, fault indications, and the like. The dial may include pointer type data, and meter data is expressed by scale values, but may also include data such as numeric type, character type, or indicator light type.

The identification models respectively corresponding to different production devices and related information thereof can be trained in advance, the server can correspondingly store the device identifiers, the identification models and the related information, and the specific training mode is described in detail in the following embodiments.

The identification model corresponding to the production equipment and the associated information related to the identification model can be determined in various implementation modes:

as an alternative, a plurality of model selection prompts may be displayed; and determining the selected recognition model and the related information related to the recognition model based on the user selection operation.

The model selection prompt information may include device information such as a device identifier of the production device, which is used to facilitate a user to search and confirm the production device, and then perform a selection operation, where the identification model corresponding to the selected model selection prompt information and the related information are used as the identification model and the related information corresponding to the production device.

Optionally, based on the user selection operation, a model selection request including an apparatus identifier may be sent to the server, so that the server determines the recognition model corresponding to the model selection prompt information operated by the user and the associated information related to the recognition model, and sends the recognition model and the associated information to the client.

As another alternative, the information code configured by the production equipment is scanned to obtain the equipment identifier, and the corresponding recognition model and the associated information related to the recognition model are searched based on the equipment identifier.

The information code can be a bar code, a two-dimensional code or a three-dimensional code and other graphic codes bearing equipment identification, the information code can be scanned by utilizing the image acquisition assembly, equipment information such as the equipment identification can be obtained by decoding, and therefore the identification model and the associated information corresponding to the equipment identification can be searched based on the equipment identification.

Optionally, the model obtaining request may be sent to the server based on the device identifier, so that the server may search for the identification model and the associated information corresponding to the device identifier, and send the identification model and the associated information to the client.

As yet another alternative, the radio frequency tag configured by the production equipment is read to obtain the equipment identifier, and the corresponding identification model and the associated information related to the identification model are searched based on the equipment identifier.

The radio frequency tag may be an NFC (Near Field Communication) tag, and a non-contact manner may be adopted by using a Near Field Communication technology, and the NFC tag in the electronic device is close to the NFC tag configured by the production device, that is, the NFC tag configured by the production device may be read, and device information such as a device identifier may be obtained, so that the identification model and the associated information corresponding to the device identifier may be searched based on the device identifier.

202: and responding to the image acquisition operation, and acquiring a dial plate image of the instrument of the production equipment according to the area indication information in the associated information.

The associated information may include area indication information, and the instrument image may be collected according to the area indication information, so that accuracy of extracting a target area from the instrument image may be improved, where the target area may be an ROI area, that is, a dial area of the instrument.

The area indication information may include an area restriction condition, and the area location condition may include, for example, a target area location, and the like.

As an alternative, an image preview interface may be displayed in response to an image capture operation; according to the area indication information in the associated information, displaying area prompt information corresponding to the position of the target area on the image preview interface; and according to the confirmation operation aiming at the image preview interface, extracting a dial plate image corresponding to the target area position from the collected instrument image.

The image preview interface can present the currently acquired image, the area prompt information may include, for example, an area frame and the like, so as to prompt the user that the dial plate of the meter can be moved into the area frame by moving the acquisition area, and then, a confirmation operation may be performed on the image presented by the image preview interface to generate a meter image, and based on the target area position, the dial plate image and the like may be accurately extracted from the meter image.

Wherein the target area position may be determined based on the target area labeled to the sample image of the production device, and the like.

203: and identifying the instrument data in the dial image by using the identification model.

204: and verifying the meter data according to the verification indication information in the associated information.

The meter data can be recognized from the dial image by using the recognition model. Due to the influence of external environments such as light rays and the like, the collected instrument image can not be accurately extracted to obtain the dial plate image and the instrument data can be accurately identified from the dial plate image, and the accuracy of extracting the dial plate image can be improved through the region indication information in the associated information, so that the identification accuracy is ensured to a certain extent. In addition, the associated information can also comprise verification indication information used for verifying the identified instrument data so as to improve the identification accuracy.

The verification prompt information can comprise a verification condition, and the instrument data is verified by judging whether the instrument data meets the verification condition or not.

The verification condition may include, for example, a predetermined data format and/or a predetermined data type, and the meter data is verified by determining whether the meter data conforms to the predetermined data format and/or the predetermined data type. The data format refers to a data format, and may include a format such as a numerical value, a character or a binary number, for example,% d, which represents the actual length output of the integer data; as another example,% md, m is the width of the specified output field. If the digit of the data is less than m, the left end is supplemented with a blank, and if the digit of the data is more than m, the data is output according to the actual digit; as another example,% ld, output long integer data, etc., the data types may include, for example, integer type, real number type, boolean type, character type, combination type, etc.

Assume that the predetermined data format is% d. If the value 9 in the meter data is identified as P, since P is a letter, it indicates that the identification is wrong, the meter data is failed to be verified, and the like.

The verification prompt information may be determined based on the meter type and data attribute of the production equipment, and may be set by a user.

205: and transmitting the meter data under the condition that the verification of the meter data is successful.

According to the embodiment of the application, the instrument data can be sent again under the condition that the instrument data is verified successfully, so that the accuracy of the sent instrument data is guaranteed.

Alternatively, the meter data may be sent to a production execution system. The production execution system may determine the generation status of the production equipment based on the meter data, and may make processing decisions, etc. The client side can directly send the meter data to the production execution system, or send the meter data to the production execution system through the server side.

In addition, the associated information may further include reporting indication information, and in the case that the verification of the instrument data is successful, the instrument data may be sent to the production execution system according to the reporting indication information in the associated information.

The reporting indication information may include a reporting mode, such as a reporting data format, a reporting data type, and/or a reporting description mode, for example, the meter data is a temperature value, and the reporting description mode is "current temperature value is% d ℃ (centigrade)",% d represents a reporting data format, so that the meter data can be converted into the reporting data format, and the like, and then the reporting description mode is sent to the production execution system.

In the embodiment, the dial plate image of the instrument is collected, the identification model is utilized to realize the automatic reading of the instrument data, the portability of data acquisition is improved, a hardware integration mode is not needed, the data acquisition cost can be effectively reduced, the calibration of the instrument data is realized by combining the associated information of the identification model, and the accuracy of the instrument data is ensured.

In some embodiments, the association information may further include abnormality indication information, and the method may further include:

and outputting early warning prompt information under the condition that the instrument data is determined to be abnormal data according to the abnormal indication information in the associated information.

The abnormal conditions of the production equipment of the user can be timely prompted through the early warning prompt information, so that intervention processing and the like can be timely performed.

The abnormal indication information may include an abnormal condition, for example, a data value range, and it may be determined whether the meter data is abnormal data by determining whether the meter data is within the data value range.

The early warning prompt message may be used to prompt production equipment for an anomaly, which may include the meter data. In addition, the corresponding processing mode can be determined according to the meter data, so that early warning prompt information containing the processing mode can be generated and used for prompting intervention processing and the like of the production equipment according to the processing mode.

In some embodiments, the method may further comprise:

and outputting error prompt information under the condition that the instrument data verification fails.

As an alternative, the error prompt message may prompt the user to perform a re-acquisition operation, to re-perform an image acquisition operation, to re-identify, or the like.

As another alternative, the error notice information may include update notice information for prompting the user to view the meter dial to determine the real data, and modify the meter data based on the real data, or the like, so that the updated meter data, or the like, may be transmitted.

In some embodiments, to further improve the identification accuracy, the method may further include:

under the condition that the instrument data check fails, taking the dial plate image as a sample image;

sending the sample image to a server; and the sample image is used for retraining the recognition model by combining the label data corresponding to the sample image.

The label data corresponding to the sample image can be obtained by manual labeling, and after the server receives the sample image, the server can prompt the user to perform manual labeling on the sample image, and the like, for example, labeling the position of a target area, labeling the corresponding real instrument data, and the like.

Of course, the tag data may also be obtained in other manners, and in some embodiments, the error prompt information is used to prompt the user to perform the re-acquisition operation; the method may further comprise:

determining re-identification data which corresponds to the sample image and is successfully verified; the re-identification data is obtained by identifying the re-collected dial plate image by using an identification model;

using the re-identification data as label data of the sample image;

sending the sample image and the label data to a server; the sample images are used to retrain the recognition model in conjunction with the label data.

In some embodiments, in the case that the error prompt includes the update prompt, the method may further include:

updating the meter data in response to an update operation for the meter data;

and sending the updated meter data to a production execution system.

taking the dial plate image as a sample image and taking the updated meter data as label data;

In some embodiments, before determining the identification model corresponding to the production equipment and the association information related to the identification model, the method may further include:

determining label data corresponding to the images of the plurality of sample images respectively based on manual labeling operation;

sending a plurality of sample images and corresponding label data to a server; the sample images and the corresponding label data are used for training the recognition model.

The tag data may include manually labeled meter data, target area, and the like.

The method can be used for acquiring a plurality of sample images obtained by acquiring images of instruments in the production equipment from a plurality of acquisition angles in a plurality of acquisition environments respectively; the plurality of collecting environments may be collecting environments with different light rays, and the like.

Of course, since different devices may also affect the image acquisition result, the plurality of sample images used for training the recognition model may include sample images acquired by a plurality of acquisition devices at a plurality of acquisition angles and/or in a plurality of acquisition environments, and the like.

Optionally, each time a sample image is obtained, corresponding annotation prompt information may be output, and a user may mark an annotation region in the sample image and input corresponding meter data, and the like.

Fig. 3 is a flowchart of an embodiment of a data processing method provided in the embodiment of the present application, and the embodiment mainly introduces the technical solution of the present application from the perspective of model generation, where the method may include the following steps:

301: a plurality of sample images obtained from image acquisition of a meter in a production facility at a plurality of acquisition angles and/or in a plurality of acquisition environments is determined.

Wherein the plurality of sample images may be acquired by a plurality of acquisition devices. The acquisition device can be an electronic device equipped with the client or other devices with image acquisition functions.

302: and determining label data corresponding to the sample images respectively.

Alternatively, the target areas in the plurality of sample images and the corresponding meter data may be determined respectively based on a manual labeling operation. The target area in the sample image and the corresponding meter data can be labeled manually, after the sample image is acquired by the acquisition equipment, the labeling prompt information can be output, and a user can label the target area, the meter data and the like accordingly.

303: and training the recognition model by utilizing the plurality of sample images and the corresponding label data respectively.

Each sample image and the corresponding label data thereof can be used as a training sample, and a large number of training samples can be used for training and generating the recognition model.

The recognition model can comprise an area extraction module and a data recognition module, and the area extraction module of the recognition model can be trained according to the marked target area in the training process, and the data recognition module can be trained according to the instrument data.

304: and determining the relevant information corresponding to the production equipment.

305: and establishing an association relation among the identification model, the association information and the production equipment.

Each production device can be implemented in the implementation manner of the embodiment shown in fig. 3, so as to obtain the identification models and the associated information corresponding to different production devices.

The identification model is used for identifying instrument data in a dial plate image of an instrument; and the associated information is used for indicating to extract the dial plate image and verify the meter data.

The identification model and the association information may be stored in correspondence with the device identifier of the production device. The production equipment can be provided with an information code or a radio frequency tag containing equipment identification, the equipment identification can be obtained from the information code or the radio frequency tag, and the corresponding identification model and the associated information can be obtained by searching based on the equipment identification.

The associated information may include area indication information for indicating to extract the dial image, and verification indication information for verifying the meter data.

In addition, the association information may further include reporting indication information for indicating to send the meter data.

In addition, the related information may further include abnormality indication information for determining whether the meter data is abnormal data or not.

In some embodiments, the associated information of the production equipment may be obtained according to the equipment type of the production equipment, the data requirement of the production execution system, and the like.

Of course, the associated information may also be obtained for manual setting operation of the production apparatus, and the like.

In some embodiments, the method may further comprise:

sending a plurality of model selection prompt messages to a client;

and sending the selected recognition model and the corresponding associated information to the client based on a model selection request sent by the client.

In some embodiments, the method may further comprise:

receiving an equipment identifier sent by a client, and searching for a recognition model and associated information corresponding to the equipment identifier;

and sending the identification model and the associated information to the client.

The client can scan the information code set by the production equipment or read the equipment identification from the radio frequency tag set by the production equipment.

The client responds to the image acquisition operation, namely a dial plate image of the instrument of the production equipment can be obtained according to the area indication information in the associated information, instrument data in the dial plate image is identified by using the identification model, the instrument data is verified according to the verification indication information in the associated information, and the instrument data is sent under the condition that the instrument data is successfully verified.

For easy understanding, the technical solution of the present application is explained below with reference to a scene interaction diagram shown in fig. 4. As shown in the schematic view of figure 4,

a first user can use a client 401 configured by a first electronic device to perform image acquisition on an instrument dial plate from a plurality of acquisition angles under a plurality of acquisition environments to obtain a plurality of sample images for any production device 400 in a production workshop, and label target areas and corresponding instrument data in the plurality of sample images and relevant information of production devices corresponding to the plurality of sample images, such as device identifications, device types and the like; the plurality of sample images and the manual annotation data are sent to the server 402.

The server 402 may train an identification model for target areas, meter data, and the like manually labeled on the basis of the plurality of sample images and the plurality of sample images, so as to obtain identification models of different production devices, and determine associated information corresponding to the production devices on the basis of relevant information of the production devices; and then correspondingly storing the identification model, the equipment identification and the associated information.

The second user may use the client 403 configured in the second electronic device, and may, for any production device in the production plant, obtain a device identifier by scanning a two-dimensional code set on the production device or reading an NFC tag set on the production device, and request, based on the device identifier, from the server 402 to obtain a corresponding recognition model and associated information related to the recognition model. The first user and the second user may be the same user or different users, and the first electronic device may be the same as or different from the second electronic device.

Then, the client 403 may display an image preview interface based on the image acquisition operation triggered by the user, and display area prompt information based on the target area position on the image preview interface according to the area indication information in the association information; and then, according to the confirmation operation aiming at the image preview interface, the dial plate image corresponding to the target area position can be extracted from the collected image.

The client 403 can identify the meter data in the dial image by using the identification model; according to the verification indication information in the associated information, verifying the instrument data; and under the condition that the meter data is successfully verified, sending the meter data to the MES404 according to the reporting indication information in the association information.

In addition, the client 403 may also output warning prompt information when determining that the meter data is abnormal data according to the abnormal indication information in the association information.

In the case that the meter data verification fails, the client 403 may further output error prompt information to prompt the user to re-acquire the dial image and the like.

The client 403 may also use the dial image as a sample image in case of a failed meter data check; and send the sample image to the server 402, and the server 402 may retrain the recognition model based on the sample image and the label data.

The tag data may be re-identification data which is verified successfully or may be obtained by manual marking or may be meter data after updating, and the like.

According to the technical scheme of the embodiment of the application, production equipment does not need to be modified, only electronic equipment with an image acquisition function such as a mobile phone or a PDA (personal digital assistant) is needed, and only dial plate images of instruments on the production equipment need to be acquired, so that instrument data can be automatically identified and reported to an MES (manufacturing execution system), the automatic reading of the instrument data is realized, the portability of instrument data acquisition is improved, the calibration of the instrument data is realized by combining with relevant information of a recognition model, the accuracy of the instrument data is ensured, and the corresponding dial plate images can be used as sample images to retrain the recognition model under the condition that the calibration of the instrument data fails, so that the applicability of the recognition model is improved, the recognition accuracy is improved, and the accuracy of the instrument data is further ensured; in addition, the method can also be used for carrying out abnormity detection on the instrument data so as to output early warning prompt information when the instrument data are abnormal data, thereby realizing the purpose of early warning in time, prompting abnormal conditions of user production equipment in time, and carrying out intervention processing and the like in time.

Fig. 5 is a schematic structural diagram of an embodiment of a meter data acquiring apparatus provided in an embodiment of the present application, where the apparatus may include:

a first determining module 501, configured to determine an identification model corresponding to a production device and associated information related to the identification model;

an image obtaining module 502, configured to obtain, in response to an image acquisition operation, a dial plate image of an instrument of the production equipment according to the area indication information in the association information;

the identification module 503 is used for identifying the instrument data in the dial plate image by using the identification model;

the verification module 504 is configured to verify the meter data according to the verification indication information in the association information;

and a data sending module 505, configured to send the meter data when the meter data is successfully verified.

In some embodiments, the apparatus may further comprise:

and the first processing module is used for outputting error prompt information under the condition that the instrument data verification fails.

In some embodiments, the apparatus may further comprise:

the second processing module is used for taking the dial plate image as a sample image under the condition that the instrument data check fails; sending the sample image to a server; and the sample image is used for retraining the recognition model by combining the label data corresponding to the sample image.

In some embodiments, the error prompt message is used to prompt the user to perform the re-acquisition operation;

the first processing module can be used for taking the dial plate image as a sample image under the condition that the instrument data check fails;

determining re-identification data which corresponds to the sample image and is successfully verified; the heavy identification data is obtained by identifying the heavy acquisition image by using an identification model;

using the re-identification data as label data of the sample image;

In some embodiments, the error prompt includes an update prompt,

the first processing module may be further configured to update the meter data in response to an update operation for the meter data; and sending the updated meter data to a production execution system.

In some embodiments, the first processing module may be further configured to take the dial plate image as a sample image and take the updated meter data as label data; sending the sample image and the label data to a server; the sample image is used for combining with the label data to train the recognition model.

In some embodiments, the first obtaining module may be specifically configured to, in response to an image acquisition operation, display an image preview interface, and display acquisition prompt information corresponding to a target area position on the image preview interface according to area indication information in the association information; and extracting a dial plate image corresponding to the target area position from the acquired image according to the confirmation operation aiming at the image preview interface.

In some embodiments, the data sending module is specifically configured to send the meter data to the production execution system according to the reporting indication information in the association information.

In some embodiments, the apparatus may further comprise:

and the abnormality processing module is used for outputting early warning prompt information under the condition that the instrument data is determined to be abnormal data according to the abnormal indication information in the associated information.

In some embodiments, the first determining module may be specifically configured to display a plurality of model selection prompt messages; determining the selected recognition model and the relevant information related to the recognition model based on the user selection operation;

or scanning an information code configured by the production equipment to obtain an equipment identifier, and searching a corresponding identification model and relevant information related to the identification model based on the equipment identifier;

or reading the radio frequency tag configured by the production equipment to obtain the equipment identifier, and searching the corresponding identification model and the associated information related to the identification model based on the equipment identifier.

In some embodiments, the apparatus may further comprise:

the training triggering module is used for acquiring a plurality of sample images obtained by image acquisition of a meter in the production equipment in a plurality of acquisition angles and/or a plurality of acquisition environments;

The instrument data acquiring apparatus shown in fig. 5 can execute the instrument data acquiring method shown in the embodiment shown in fig. 2, and the implementation principle and the technical effect are not repeated. The specific manner in which each module and unit of the meter data acquisition device in the above embodiments perform operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

An embodiment of the present application further provides an electronic device, as shown in fig. 6, the electronic device may include an image acquisition component 601, a storage component 602, and a processing component 603;

the storage component 602 stores one or more computer instructions for execution by the processing component to invoke to implement the meter data acquisition method as shown in FIG. 2.

Of course, the electronic device may of course also comprise other components, such as input/output interfaces, display components, communication components, etc.

The input/output interface provides an interface between the processing components and peripheral interface modules, which may be output devices, input devices, etc. The communication component is configured to facilitate wired or wireless communication between the computing device and other devices, and the like.

Wherein the processing components may include one or more processors executing computer instructions to perform all or part of the steps of the above-described method. Of course, the processing elements may also be implemented as one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components configured to perform the above-described methods.

The storage component is configured to store various types of data to support operations at the terminal. The memory components may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The image capturing component may be, for example, a camera or other components including an image sensor, and the image sensor may include, for example, a CCD (charge-coupled device), a CMOS (complementary metal oxide semiconductor), or the like.

The display element may be an Electroluminescent (EL) element, a liquid crystal display or a microdisplay of similar construction, or a retina-directable or similar laser-scanned display.

An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the method for acquiring meter data according to the embodiment shown in fig. 2 may be implemented. The computer-readable medium may be included in the electronic device described in the above embodiment; or may exist separately without being assembled into the electronic device.

Embodiments of the present application further provide a computer program product, which includes a computer program carried on a computer-readable storage medium, and when the computer program is executed by a computer, the meter data acquiring method according to the embodiment shown in fig. 2 can be implemented. In such embodiments, the computer program may be downloaded and installed from a network, and/or installed from a removable medium. The computer program, when executed by a processor, performs various functions defined in the system of the present application.

Fig. 7 is a schematic structural diagram of an embodiment of a data processing apparatus according to an embodiment of the present application, where the apparatus may include:

a second determining module 701, configured to determine a plurality of sample images obtained by image capturing of a meter in a production apparatus at a plurality of capturing angles and/or a plurality of capturing environments; determining label data corresponding to the images of the plurality of sample images respectively;

a training module 702, configured to train an identification model using the plurality of sample images and the corresponding label data;

a third determining module 703, configured to determine associated information corresponding to the production device;

an association module 704, configured to establish an association relationship between the identification model, the association information, and the production equipment; the identification model is used for identifying instrument data in a dial plate image of the instrument; the correlation information is used to indicate that the meter data is verified.

The data processing apparatus shown in fig. 7 may execute the data processing method shown in the embodiment shown in fig. 3, and the implementation principle and the technical effect are not described again. The specific manner in which each module and unit of the meter data acquisition device in the above embodiments perform operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

Embodiments of the present application further provide a computing device, which may be implemented as the server shown in fig. 1, as shown in fig. 8, the computing device may include a storage component 801 and a processing component 802;

the storage component 801 stores one or more computer instructions for execution by the processing component to implement the data processing method shown in fig. 3.

Of course, a computing device may also necessarily include other components, such as input/output interfaces, communication components, and so forth.

It should be noted that the computing device may be a physical device or a flexible computing host provided by a cloud computing platform. It can be implemented as a distributed cluster consisting of a plurality of servers or terminal devices, or as a single server or a single terminal device.

An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the data processing method of the embodiment shown in fig. 3 may be implemented. The computer-readable medium may be included in the electronic device described in the above embodiment; or may exist separately without being assembled into the electronic device.

Embodiments of the present application further provide a computer program product, which includes a computer program carried on a computer-readable storage medium, and when the computer program is executed by a computer, the data processing method as described in the embodiment shown in fig. 3 can be implemented. In such embodiments, the computer program may be downloaded and installed from a network, and/or installed from a removable medium. The computer program, when executed by a processor, performs various functions defined in the system of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A meter data acquisition method, comprising:

2. The method of claim 1, further comprising:

3. The method of claim 1, further comprising:

sending the sample image to a server; the sample image is used for combining with the label data corresponding to the sample image to retrain the recognition model.

4. The method of claim 2, wherein the error prompt message is used to prompt a user to perform a re-acquisition operation; the method further comprises the following steps:

determining re-identification data which is successfully verified and corresponds to the sample image; the re-identification data is obtained by identifying the re-collected dial plate images by using the identification model;

using the re-identification data as label data of the sample image;

5. The method of claim 2, wherein the error prompt comprises an update prompt, the method further comprising:

updating the meter data in response to an update operation for the meter data;

and sending the updated meter data to a production execution system.

6. The method of claim 5, further comprising:

7. The method of claim 1, wherein the extracting, in response to the image capturing operation, the dial plate image of the meter of the production equipment according to the area indication information in the associated information includes:

displaying an image preview interface in response to an image capture operation,

according to the area indication information in the associated information, displaying area prompt information corresponding to the position of the target area on the image preview interface;

and according to the confirmation operation aiming at the image preview interface, extracting a dial plate image corresponding to the target area position from the collected instrument image.

8. The method of claim 1, wherein the sending the meter data comprises:

and sending the instrument data to a production execution system according to the reporting indication information in the associated information.

9. The method of claim 1, further comprising:

10. The method of claim 1, wherein the determining the identification model corresponding to the production equipment and the associated information related to the identification model comprises:

displaying a plurality of model selection prompt messages; determining the selected recognition model and the related information related to the recognition model based on the user selection operation;

or reading the radio frequency tag configured by the production equipment to obtain an equipment identifier, and searching a corresponding identification model and associated information related to the identification model based on the equipment identifier.

11. The method of claim 1, wherein before determining the identification model corresponding to the production equipment and the associated information related to the identification model, the method further comprises:

determining a plurality of sample images obtained by image acquisition of a meter in the production equipment at a plurality of acquisition angles and/or a plurality of acquisition environments;

determining label data corresponding to the sample images based on manual labeling operation;

sending the plurality of sample images and the corresponding label data to a server; the plurality of sample images and the respectively corresponding label data are used for training the recognition model.

12. A data processing method, comprising:

determining a plurality of sample images obtained by image acquisition of a meter in a production facility at a plurality of acquisition angles and/or in a plurality of acquisition environments;

determining label data corresponding to the sample images respectively;

determining relevant information corresponding to the production equipment;

13. An electronic device is characterized by comprising an image acquisition component, a storage component and a processing component;

the storage component stores one or more computer instructions; the one or more computer instructions are for execution by the processing component to implement the meter data acquisition method of any of claims 1-11.

14. A computing device comprising a storage component and a processing component;

the storage component stores one or more computer instructions; the one or more computer instructions to be invoked for execution by the processing component to implement the data processing method of claim 12.