WO2022000806A1

WO2022000806A1 - Data acquisition method, system and apparatus, terminal device, and medium

Info

Publication number: WO2022000806A1
Application number: PCT/CN2020/116015
Authority: WO
Inventors: 任孝江; 贺毅; 左志军; 姚维兵; 徐华昕; 张凯
Original assignee: 广州明珞装备股份有限公司; 明珞汽车装备（上海）有限公司
Priority date: 2020-06-30
Filing date: 2020-09-17
Publication date: 2022-01-06
Also published as: CN111857029B; CN111857029A

Abstract

A data acquisition method, system and apparatus, a terminal device, and a medium. In said method, required data is transferred to a fixed area (an acquisition area), data of signal points dispersed in different areas is placed collectively into the acquisition area and are numbered, and when data parsing is performed, corresponding numbers are used to correspondingly parse data of each partition, making full use of the strong data processing capability of a PLC itself, and acquiring data collectively, so only a single memory area needs to be read for each scanning, and data reading and processing can be performed within dozens of milliseconds. The present invention greatly improves the acquisition efficiency, accuracy and security, and has a simple configuration, that is, data can be parsed merely by configuring a starting address and an acquisition quantity of a memory area required to be acquired; and the present invention can reduce the number of acquisition points, save the storage and calculation space, and save the costs of 4G network traffic, and can be widely applied to the technical field of data acquisition.

Description

A method, system, device, terminal device and medium for data collection

technical field

The present invention relates to the technical field of data collection, and in particular, to a method, system, device, terminal device and medium for data collection.

Background technique

In industrial big data processing, data collection is the key. Data collection requires high real-time, validity and accuracy. The data required for big data analysis is diverse and may be distributed in different PLC memory areas. In the process of acquisition, it is necessary to access and scan different memory areas, which is inefficient, requires scanning different memory areas, and has low security, and puts forward higher hardware requirements for multi-threaded processing of acquisition software.

Most of the current acquisition software needs to continuously scan and read each data according to the configured PLC data storage area number. When the amount of data required is large, it often requires a long scan load and scan cycle.

Terminology Explanation:

PLC: Programmable Logic Controller (Programmable Logic Controller) is a digital operation operating electronic system specially designed for application in industrial environment. It uses a programmable memory to store instructions for performing operations such as logic operations, sequence control, timing, counting and arithmetic operations, and controls various types of mechanical equipment or production through digital or analog input and output. process.

PLC memory area: Like ordinary computers, PLC data processing and storage also require special data storage and exchange. Compared with ordinary computers, PLC memory area has more partitions, including processing input and output, and processing intermediate variables. There are also storage areas that can be manually numbered.

SUMMARY OF THE INVENTION

In view of at least one of the above technical problems, the purpose of the present invention is to provide a method, system, device, terminal device and medium for data collection.

The technical solution adopted by the present invention is: on the one hand, the embodiment of the present invention includes a method for data collection, including:

According to the data collection task, obtain the signal point list of the required collection zone;

processing and storing the data of each signal point in the signal point list in the acquisition area;

reading the data in the collection area and numbering to obtain numbered data;

The numbered data is sent to a cloud server, and the cloud server is configured to parse the data to parse the numbered data.

Further, the step of processing and storing the data of each signal point in the signal point list in the collection area includes:

Use programmable logic controller to integrate the data of each signal point;

Perform data type conversion and data cleaning on the integrated data;

Store the processed data in the acquisition area.

Further, the step of performing data type conversion and data cleaning on the integrated data includes:

The data type obtained after integration is 32-bit floating point type;

converting the integrated data type into a 16-bit floating point type;

Data cleaning is performed on the data after data type conversion processing.

On the other hand, an embodiment of the present invention further includes a data acquisition system, including:

The acquisition module is used to acquire the signal point list of the required acquisition partition according to the data acquisition task;

a processing module, configured to process and store the data of each signal point in the signal point list in the collection area;

Numbering module, used for reading the data in the collection area and numbering to obtain numbered data;

A parsing module, configured to send the numbered data to a cloud server, where the cloud server configures parsing data to parse the numbered data.

Further, the processing module includes:

The data integration unit is used to integrate the data of each signal point using the programmable logic controller;

The data processing unit is used to perform data type conversion and data cleaning processing on the integrated data;

The storage unit is used to store the processed data in the acquisition area.

Further, the data processing unit includes:

A data collection sub-unit for collecting the integrated data;

Data processing sub-unit, numbering the collected data;

The data storage subunit is used to store the numbered data locally and send it to the cloud server.

On the other hand, an embodiment of the present invention further includes a data acquisition device, including a programmable logic controller, a collector, and a cloud server, wherein the programmable logic controller and the collector are used to collect data and analyze each signal The data of the point is processed; the cloud server is used for executing the configuration analysis data to analyze the serial number data.

On the other hand, an embodiment of the present invention further includes a terminal device for data collection, including a memory and a processor, where the memory is configured to store at least one program, and the processor is configured to load the at least one program to execute the one method of data collection.

On the other hand, an embodiment of the present invention further includes a storage medium, in which processor-executable instructions are stored, and when executed by the processor, the processor-executable instructions are used to execute the method for data collection .

The beneficial effects of the present invention are: the present invention concentrates the required data into a fixed storage area (collection area) through simple PLC program writing, on the one hand, fully utilizes the powerful data processing capability of the PLC itself, and on the other hand, the data is centralized For acquisition, each scan only needs to read a single memory area, and the data can be read and processed in tens of milliseconds; the acquisition efficiency, accuracy and security are greatly improved, and the configuration is simple, only the required memory needs to be configured. The data can be parsed according to the starting address of the area and the number of collections; the invention can reduce the number of collection points, save storage and calculation space and save the cost of 4G network traffic.

Description of drawings

Fig. 1 is the flow chart of the steps of the data collection method described in this embodiment;

2 is a schematic diagram of the data collection described in this embodiment;

FIG. 3 is a system block diagram of data acquisition according to this embodiment.

detailed description

As shown in FIG. 1 , an embodiment of the present invention includes a method for data collection, which specifically includes the following steps:

S1. According to the data collection task, obtain a list of signal points of the required collection zone;

S2. Process the data of each signal point in the signal point list and store it in the collection area;

S3. Read the data in the collection area and number it to obtain numbered data;

S4. Send the numbered data to a cloud server, and the cloud server configures parsing data to parse the numbered data.

A method for data collection described in this embodiment is to transfer the required data to a fixed area (collection area), and collect signal points scattered in different areas into the collection area, so that when the data collector is used to collect data, You only need to scan a fixed continuous memory area, and make a uniform number for the data transmitted from each partition. When doing data analysis, you can use the corresponding number to parse the data corresponding to each partition. For details, please refer to the schematic diagram of data acquisition in Figure 2. . Specifically, first, according to the data collection task, a list of signal points of the required collection partition is obtained, that is, step S1, the signal points required for collection are scattered in each partition, not continuous, and are often only discontinuous in a certain memory area. Bit bits, such as the signal points I0.1, I100.6 in the input area, and the signal points Q0.1, Q100.5 in the output area, etc. When obtaining the list of signal points, it is necessary to determine the data processing method of each signal point.

Regarding step S2, that is, the step of processing the data of each signal point in the signal point list and storing it in the collection area, which specifically includes:

S201. Use the programmable logic controller to integrate the data of each signal point;

S202. Perform data type conversion and data cleaning on the integrated data;

S203. Store the processed data in the collection area.

In this embodiment, with regard to step S2, data arithmetic processing is implemented by programming in the PLC, that is, data integration, type conversion, data cleaning and other operations are performed on the data of each signal point in each partition. In step S201, data integration can reduce the required The collected signal points, such as the need to calculate the duration of an action, often need to collect at least two signal points, one start signal and one end signal point, and the change information of the start signal and the end signal needs to be collected separately. When the signal comes, it is recorded as time point T1, and when the end signal comes, it is recorded as time point T2, and T2-T1 is the duration of the action; and in this embodiment, a point ( At this time, the value of the collection point is 1), and the point is reset when the end signal comes (the value of the collection point is 0 at this time). When collecting, it is only necessary to record the time when the value of the collection point changes from 1 to 0, which is the action time. This method finally only needs to collect and record the data change of one point, which reduces the collected signal by half, and the calculation is more efficient.

For step S202, that is, the step of data type conversion and data cleaning processing is performed on the integrated data, specifically including:

S202-1. The data type obtained after integration is 32-bit floating point type;

S202-2. Convert the integrated data type to a 16-bit floating point type;

S202-3. Perform data cleaning on the data after data type conversion processing.

In this embodiment, performing type conversion processing on the data can save the space required by the collector and the server for calculation and storage. For example, to obtain the data type integrated by the PLC, the PLC engineer can convert the integer data for program standardization or other reasons. Save as a 32-bit floating point type. In this embodiment, the integrated data is converted into a 16-bit floating point type through data conversion. This type conversion reduces the required space by half; these methods greatly reduce the amount of collected signals And the space required for data calculation and storage. In the field of industrial big data, in order to reduce the transmission of data packets and save the cost of traffic costs, the data needs to be encoded and compressed, and then decompressed and decoded by the cloud server according to the corresponding data Data type conversion and data cleaning can greatly reduce the complexity of encoding and compression, and require less hardware for the collector.

Regarding steps S3 and S4, in this embodiment, the data stored in the collection area is numbered, the numbered data is compressed and saved, and then sent to the cloud server. Finally, the cloud server needs to configure corresponding data analysis data, such as numbering The data of 1 corresponds to 1 of the input memory area in the PLC, and the number 2 corresponds to the 2 of the PLC output memory area. The server performs batch data analysis according to the configuration information, which can greatly improve the analysis speed and efficiency and save the computing space.

To sum up, the method for data collection described in the embodiment of the present invention has the following advantages:

The embodiment of the present invention collects the required data into a fixed storage area (collection area) by writing a simple PLC program. On the one hand, the powerful data processing capability of the PLC itself is fully utilized. On the other hand, the data is collected in a centralized manner. It only needs to read a single memory area, and the data can be read and processed in tens of milliseconds; the collection efficiency, accuracy and security are greatly improved, and the configuration is simple, only need to configure the starting address of the memory area to be collected and The data can be analyzed by collecting the number; the method described in the embodiment of the present invention can reduce the number of collecting points, save the storage and calculation space, and save the cost of 4G network traffic.

On the other hand, referring to FIG. 3 , this embodiment further includes a data acquisition system, including:

Further, the processing module includes:

The data processing unit is used to collect and number the integrated programmable logic controller data;

The storage unit is used to store the processed data in the acquisition area.

Further, the data processing unit includes:

A data collection sub-unit for collecting the integrated data;

Data processing sub-unit, numbering the collected data;

On the other hand, an embodiment of the present invention further includes a data acquisition device, including a programmable logic controller, a collector, and a cloud server, wherein the programmable logic controller and the collector are used to collect data and analyze each signal point data for processing; the cloud server is configured to execute the configuration parsing data described in the embodiment to parse the serial number data.

On the other hand, an embodiment of the present invention further includes a terminal device for data collection, including a memory and a processor, where the memory is configured to store at least one program, and the processor is configured to load the at least one program to execute the program in the embodiment. A method of data collection described.

On the other hand, an embodiment of the present invention further includes a storage medium, in which a processor-executable instruction is stored, and the processor-executable instruction, when executed by the processor, is used to execute a kind of data described in the embodiment method of collection.

The system can be a device such as a server or a personal computer. By writing the method for data acquisition into a computer program and writing it into the server or personal computer, the data acquisition system can be obtained, and by running the system, The same technical effect as the one method of data acquisition can be achieved.

In this embodiment, the data collection apparatus includes a memory and a processor, where the memory is configured to store at least one program, and the processor is configured to load the at least one program to execute the method in the embodiment.

The memory can also be produced separately and used to store a computer program corresponding to the one method of data acquisition. When the memory is connected to the processor, the computer program stored in the memory will be read out and executed by the processor, thereby implementing the method for data acquisition and achieving the technical effects described in the embodiments.

It should be noted that, unless otherwise specified, when a feature is called "fixed" or "connected" to another feature, it can be directly fixed or connected to another feature, or it can be indirectly fixed or connected to another feature. on a feature. In addition, descriptions such as upper, lower, left, right, etc. used in the present disclosure are only relative to the mutual positional relationship of each component of the present disclosure in the accompanying drawings. As used in this disclosure, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. Also, unless otherwise defined, all technical and scientific terms used in this embodiment have the same meaning as commonly understood by those skilled in the art. The terms used in the description of the embodiments are only used to describe specific embodiments, rather than to limit the present invention. As used in this example, the term "and/or" includes any combination of one or more of the associated listed items.

It will be understood that, although the terms first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish elements of the same type from one another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples or exemplary language ("for example," "such as," etc.) provided in this embodiment is intended only to better illustrate embodiments of the invention and does not detract from the scope of the invention unless otherwise requested impose restrictions.

It should be appreciated that embodiments of the present invention may be implemented or implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in non-transitory computer readable memory. The method can be implemented in a computer program using standard programming techniques - including a non-transitory computer-readable storage medium configured with a computer program, wherein the storage medium so configured causes the computer to operate in a specific and predefined manner - according to the specific Methods and figures described in the Examples. Each program may be implemented in a high-level procedural or object-oriented programming language to communicate with a computer system. However, if desired, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.

Furthermore, the operations of the processes described in this embodiment may be performed in any suitable order unless otherwise indicated by this embodiment or otherwise clearly contradicted by context. The processes described in this embodiment (or variations and/or combinations thereof) may be performed under the control of one or more computer systems configured with executable instructions, and may be executed as code collectively executing on one or more processors (eg, executable instructions, one or more computer programs, or one or more applications), implemented in hardware, or a combination thereof. The computer program includes a plurality of instructions executable by one or more processors.

Further, the methods may be implemented in any type of computing platform operably connected to a suitable, including but not limited to personal computer, minicomputer, mainframe, workstation, network or distributed computing environment, stand-alone or integrated computer platform, or communicate with charged particle tools or other imaging devices, etc. Aspects of the invention may be implemented in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, an optically read and/or written storage medium, RAM, ROM, etc., such that it can be read by a programmable computer, when a storage medium or device is read by a computer, it can be used to configure and operate the computer to perform the processes described herein. Furthermore, the machine-readable code, or portions thereof, may be transmitted over wired or wireless networks. The invention described in this embodiment includes these and other various types of non-transitory computer-readable storage media when such media includes instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. The invention also includes the computer itself when programmed according to the methods and techniques described herein.

A computer program can be applied to input data to perform the functions described in this embodiment to transform the input data to generate output data for storage to non-volatile memory. The output information can also be applied to one or more output devices such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including specific visual depictions of physical and tangible objects produced on the display.

The above are only preferred embodiments of the present invention, and the present invention is not limited to the above-mentioned embodiments, as long as it achieves the technical effect of the present invention by the same means, all within the spirit and principle of the present invention, the Any modification, equivalent replacement, improvement, etc., should be included within the protection scope of the present invention. Various modifications and changes can be made to its technical solutions and/or implementations within the protection scope of the present invention.

Claims

A method for data collection, comprising:

According to the data collection task, obtain the signal point list of the required collection zone;

processing and storing the data of each signal point in the signal point list in the acquisition area;

reading the data in the collection area and numbering;

The collected signal value data and the numbered data are sent to a cloud server, and the cloud server is configured with parsing data to parse the numbered data.
The method for data collection according to claim 1, wherein the step of processing the data of each signal point in the signal point list and storing it in the collection area includes:

Use programmable logic controller to integrate the data of each signal point;

Perform data type conversion and data cleaning on the integrated data;

Store the processed data in the acquisition area.
A method for data collection according to claim 2, wherein the step of performing data type conversion and data cleaning processing on the integrated data comprises:

The data type obtained after integration is 32-bit floating point type;

Convert the integrated data type to a 16-bit floating point type.
A data acquisition system, comprising:

The acquisition module is used to acquire the signal point list of the required acquisition partition according to the data acquisition task;

a processing module, configured to process and store the data of each signal point in the signal point list in the collection area;

Numbering module, used for reading the data in the collection area and numbering to obtain numbered data;

A parsing module, configured to send the numbered data to a cloud server, where the cloud server configures parsing data to parse the numbered data.
A data acquisition system according to claim 4, wherein the processing module comprises:

The data integration unit is used to integrate the data of each signal point using the programmable logic controller;

The data processing unit is used to collect and number the integrated programmable logic controller data;

The storage unit is used to store the processed data in the acquisition area.
A data acquisition system according to claim 5, wherein the data processing unit comprises:

A data collection sub-unit for collecting the integrated data;

Data processing sub-unit, numbering the collected data;

The data storage subunit is used to store the numbered data locally and send it to the cloud server.
A data acquisition device, characterized in that it comprises a programmable logic controller, a collector and a cloud server, wherein the programmable logic controller and the collector are used to collect data and process the data of each signal point; The cloud server is configured to execute the configuration parsing data of claim 1 to parse the serial number data.
A terminal device for data collection, characterized in that it includes a memory and a processor, the memory is used to store at least one program, and the processor is used to load the at least one program to execute any one of claims 1-3. method described.
A storage medium storing processor-executable instructions, wherein the processor-executable instructions are used to execute the method according to any one of claims 1-3 when executed by the processor.