CN111061752A - Data processing method and device and electronic equipment - Google Patents
Data processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN111061752A CN111061752A CN201911341060.9A CN201911341060A CN111061752A CN 111061752 A CN111061752 A CN 111061752A CN 201911341060 A CN201911341060 A CN 201911341060A CN 111061752 A CN111061752 A CN 111061752A
- Authority
- CN
- China
- Prior art keywords
- target
- measuring point
- acquisition
- data
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 31
- 238000005259 measurement Methods 0.000 claims abstract description 129
- 238000003860 storage Methods 0.000 claims abstract description 85
- 238000000034 method Methods 0.000 claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 20
- 238000009826 distribution Methods 0.000 claims abstract description 11
- 238000004590 computer program Methods 0.000 claims description 15
- 238000013500 data storage Methods 0.000 abstract description 23
- 230000009286 beneficial effect Effects 0.000 abstract description 5
- 238000005457 optimization Methods 0.000 abstract description 5
- 239000002699 waste material Substances 0.000 abstract description 4
- 230000002159 abnormal effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008014 freezing Effects 0.000 description 2
- 238000007710 freezing Methods 0.000 description 2
- 101100208128 Arabidopsis thaliana TSA1 gene Proteins 0.000 description 1
- 101100208421 Candida albicans (strain SC5314 / ATCC MYA-2876) TMP1 gene Proteins 0.000 description 1
- 102100031437 Cell cycle checkpoint protein RAD1 Human genes 0.000 description 1
- 102100033934 DNA repair protein RAD51 homolog 2 Human genes 0.000 description 1
- 101001130384 Homo sapiens Cell cycle checkpoint protein RAD1 Proteins 0.000 description 1
- 101001132307 Homo sapiens DNA repair protein RAD51 homolog 2 Proteins 0.000 description 1
- 101100182720 Homo sapiens LY6E gene Proteins 0.000 description 1
- 101001049835 Homo sapiens Potassium channel subfamily K member 3 Proteins 0.000 description 1
- 101001049829 Homo sapiens Potassium channel subfamily K member 5 Proteins 0.000 description 1
- 101100201844 Homo sapiens RSPH1 gene Proteins 0.000 description 1
- 102100032131 Lymphocyte antigen 6E Human genes 0.000 description 1
- 102100023207 Potassium channel subfamily K member 3 Human genes 0.000 description 1
- 102100023202 Potassium channel subfamily K member 5 Human genes 0.000 description 1
- 102100035089 Radial spoke head 1 homolog Human genes 0.000 description 1
- 101100153788 Schizosaccharomyces pombe (strain 972 / ATCC 24843) tpx1 gene Proteins 0.000 description 1
- 101150048440 TSA1 gene Proteins 0.000 description 1
- 101150104676 TSA2 gene Proteins 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
Abstract
The invention provides a data processing method, a data processing device and electronic equipment, and relates to the technical field of data processing, wherein the method is used for predetermining acquisition tasks of a distribution room and measurement points included in the acquisition tasks, and distributing a record table for the measurement points; firstly, judging whether a target measuring point is in a measuring point storage range or not; the measuring point storage range is used for representing the number of the measuring points which can be stored in the station area; the target measuring point is one of the measuring points of the platform area; and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point. Therefore, the technical scheme provided by the embodiment of the invention combines the service and field task use environments to carry out data storage optimization processing, efficiently compresses the expenditure of data storage space, is beneficial to reducing the expenditure of data storage space, and solves the problem that the existing data processing method has serious waste of storage space.
Description
Technical Field
The present invention relates to the technical field of power devices, and in particular, to a data processing method and apparatus, and an electronic device.
Background
The existing power equipment terminal still has a large bottleneck on data processing, and especially an object-oriented acquisition terminal released by a national network needs to solve the problem of data processing of big data under the condition of multi-task and multi-data acquisition.
At present, in the prior art, a data processing method for big data mainly establishes a storage file according to collected data items by fixedly distributing a data storage space, does not distinguish the number of measurement points actually distributed by a power equipment collection terminal, and uniformly distributes the space according to the maximum measurement point.
In summary, the existing data processing method has the problem of serious waste of storage space.
Disclosure of Invention
In view of the above, the present invention provides a data processing method, an apparatus and an electronic device, so as to alleviate the problem of the existing data processing method that the storage space is wasted seriously, and reduce the expense of the data storage space.
In a first aspect, an embodiment of the present invention provides a data processing method, where an acquisition task of a distribution room and measurement points included in the acquisition task are predetermined, and a record table is allocated to the measurement points; the method comprises the following steps:
judging whether the target measuring point is in the measuring point storage range or not; the measuring point storage range is used for representing the number of the measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the method further includes:
if the target measuring point is not in the measuring point storage range, determining an acquisition task corresponding to the target measuring point;
and deleting the data of all the measuring points in the acquisition task corresponding to the target measuring point.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the method further includes: acquiring a data item OAD for a target of a target measurement point;
judging whether the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point;
and if the target acquisition data item OAD is not in the recording capacity range of the recording table corresponding to the target measurement point, deleting the earliest recorded acquisition data item OAD in the recording table corresponding to the target measurement point, and writing the target acquisition data item OAD into the recording table.
With reference to the second possible implementation manner of the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the method further includes:
and if the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point, writing the target acquisition data item OAD into the recording table.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where the step of predetermining an acquisition task of a coverage area and a measurement point included in the acquisition task, and allocating a record table to the measurement point includes:
creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs;
creating a record table of the measuring points; the recording table is used for recording the collected data item OAD of the measuring point;
and associating the record table with the measuring point.
With reference to the fourth possible implementation manner of the first aspect, the embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where the keyword includes an acquisition time scale, a measurement point, and an acquisition data item OAD.
With reference to the first aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, where each measurement point carries a number identifier, and the step of determining whether the target measurement point is within a measurement point storage range includes:
and judging whether the target measuring point is in the measuring point storage range or not based on the number identification of the target measuring points.
In a second aspect, an embodiment of the present invention further provides a data processing apparatus, including:
the acquisition task of a predetermined platform area and the measurement points included in the acquisition task, the apparatus includes:
the judging module is used for judging whether the target measuring point is in the measuring point storage range or not; the measuring point storage range is used for representing the number of the measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
and the storage module is used for storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point if the target measuring point is in the measuring point storage range.
With reference to the second aspect, an embodiment of the present invention provides a first possible implementation manner of the second aspect, where the apparatus further includes:
the determining module is used for determining an acquisition task corresponding to the target measuring point when the target measuring point is not in the measuring point storage range;
and the deleting module is used for deleting the data of all the measuring points in the acquisition task corresponding to the target measuring point.
In a third aspect, an embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the data processing method when executing the computer program.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the data processing method described above.
The embodiment of the invention has the following beneficial effects: according to the data processing method, the data processing device, the electronic equipment and the computer readable storage medium, the acquisition task of the distribution room and the measurement points included in the acquisition task are predetermined, and a record table is allocated to the measurement points; by first determining whether the target measurement point is within a measurement point storage range; the measuring point storage range is used for representing the number of the measuring points which can be stored in the station area; the target measuring point is one of the measuring points of the platform area; and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point. Therefore, the technical scheme provided by the embodiment of the invention combines the service and field task use environments to carry out data storage optimization processing, efficiently compresses the expenditure of data storage space, is beneficial to reducing the expenditure of data storage space, and solves the problem that the existing data processing method has serious waste of storage space.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flow chart of a data processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating another data processing method according to an embodiment of the present invention;
FIG. 3 is a first flowchart of a data processing method according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a data processing apparatus according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, two data processing methods for big data are mainly used in the prior art, one method is to establish a storage file according to collected data items by fixedly distributing data storage space, not to distinguish the number of measurement points actually distributed by a power equipment collection terminal, and uniformly distribute space according to the maximum measurement point, and the scheme has the advantages that the data storage logic is simple and efficient, but the defects are serious waste of data space and large redundancy, particularly under the condition of storing multiple data OADs, the data are collected firstly and stored firstly, so that the OADs of the data collected later have no available space, the data are seriously lost, in addition, the data can not be cleared according to the specified measurement points, and only the data can be completely cleared according to the measurement points of the whole station area; according to the scheme 2, the data acquisition is carried out according to the executed tasks, each table is stored as one record, and the acquired data items are packaged. Meanwhile, under the condition of changing the number of measurement points, when data storage is around the tail, the storage coverage is not completely updated, or the coverage exceeds a plurality of records, but a part of the number of the measurement points is reserved, so that abnormal data retrieval is caused.
Based on this, the data processing method, the data processing device and the electronic device provided by the embodiment of the invention combine the service and the field task using environment to perform data storage optimization processing, efficiently compress the expenditure of the data storage space, are beneficial to reducing the expenditure of the data storage space, and alleviate the problem that the storage space is seriously wasted in the existing data processing method. Meanwhile, a judgment mechanism under abnormal data storage is added, so that efficient and stable data storage is really achieved, and external normal acquisition of the data of the power equipment terminal is facilitated.
To facilitate understanding of the embodiment, a detailed description will be given to a data processing method disclosed in the embodiment of the present invention.
The first embodiment is as follows:
the embodiment of the invention provides a data processing method, which is applied to the field of power station area acquisition and is executed by electronic equipment in the corresponding field, wherein the electronic equipment can be a power equipment acquisition terminal, a processing terminal, a controller of the acquisition terminal or a controller of the processing terminal and the like.
Specifically, as shown in fig. 1, the method determines in advance an acquisition task of a distribution room and measurement points included in the acquisition task, and allocates a record table to the measurement points; the method comprises the following steps:
step S102, judging whether the target measuring point is in the measuring point storage range;
the measuring point storage range is used for representing the number of the measuring points which can be stored in the station area; the target measurement point is one of the measurement points of the station area.
And step S104, if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point.
The acquisition data here comprises the acquisition data item OAD.
It should be noted that each of the collection tasks may include one or more measurement points, and the corresponding relationship between the collection task and the measurement points may be set according to the field requirements; the record lists of all the measuring points of each task share one task file; the tasks are independent from one another.
In an alternative embodiment, the step of predetermining the acquisition task of the station area and the measurement points included in the acquisition task may be implemented by: according to the data acquisition scheme (also called service or service type), the acquisition tasks of the station area and the measurement points allocated to each acquisition task are determined.
In an optional embodiment, the step of predetermining an acquisition task of a distribution room and a measurement point included in the acquisition task, and allocating a record table to the measurement point includes:
1. creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs;
the services comprise real-time services, freezing services, event services and the like; the service identifier may be a service name, which may be, for example, a number, a letter, or a combination thereof, to characterize the service; of course, the service identifier may also be expressed in other manners or combinations, and is not limited in particular here.
In an alternative embodiment, the keywords include the acquisition time scale, the measurement point, and the acquisition data item OAD.
In an optional embodiment, the step of creating the data file of the collection task is mainly performed by the following steps:
a, data files are created according to collection TASKs (TASK1, TASK2 … and TASKn), when the data files are created, a collection data scheme (real-time type service, freezing type service, event type service and the like) needs to be appointed, and keywords cover collection time scales (success, starting and storage), a measurement point TSA and collection data items OAD;
specifically, the service identifier may be embodied in the name of the data file; the keywords may be embodied in subfiles or file contents of the data file; the data file can be a folder or a file; when the data file may be a folder, the keywords may be subfiles under the folder; and when the data file may be a file (e.g., an Excel file), the key may be a subfile of the file (e.g., a sheet worksheet);
2. creating a record table of the measuring points; the recording table is used for recording the collected data item OAD of the measuring point; the OAD here is an abbreviation of an Object Attribute Descriptor (Object Attribute Descriptor). For the meaning, reference is made to the prior art and no further description is given here.
When creating the record table of the measuring point, the record table can be created in the data file directly; it is also possible to create the record list and transfer (copy, cut or mirror) it to the data file.
3. And associating the record table with the measuring point.
Each measuring point corresponds to one record table, and the record tables of all the measuring points of each task share one task file; for example, each measurement point TSA1, TSA2 …, TSAn corresponds to one record table REC1, REC2 …, RECn, respectively, each record table containing all the acquired data items OAD data of the task acquisition plan, and finally links all the records together.
In an alternative embodiment, the record tables of each measurement point are independent of each other, that is, the creation of each record table is independent of any other record table, and the file size is dynamically allocated without being limited by the number of the measurement points in the cell.
In an optional implementation manner, each acquisition task is independent from another acquisition task, that is, each acquisition task TASKn covers all the record lists RECn under the task, and is spliced in a task file, and is not affected by other tasks or the depth of an acquisition data scheme (service).
In an optional implementation manner, each measurement point carries a number identifier, and the number identifier is used for facilitating counting, identifying and judging the measurement points; the quantity identifier may be, for example, a serial number or a reference number represented in the form of a number (either a subscript number or a superscript number), and specifically, a quantity identifier may be allocated to each measurement point when the measurement point is included in the acquisition task;
the step S102 of determining whether the target measurement point is within the measurement point storage range at this time may be performed by:
1) and judging whether the target measuring point is in the measuring point storage range or not based on the number identification of the target measuring points.
Wherein the measurement point storage range is used for representing the number of measurement points which can be stored in a fixed space in the platform area, such as 100 measurement points;
specifically, the number identifier of the target measurement point is compared with a measurement point storage threshold to generate a comparison result, and then whether the target measurement point is in the measurement point storage range is determined according to the comparison result, for example, if the comparison result indicates that the number identifier of the target measurement point is in the measurement point storage threshold, it is determined that the target measurement point is in the measurement point storage range, otherwise, it is determined that the target measurement point is not in the measurement point storage range.
The data processing method provided by the embodiment of the invention comprises the steps of predetermining an acquisition task of a distribution room and measurement points included in the acquisition task, and distributing a record table for the measurement points; by first determining whether the target measurement point is within a measurement point storage range; the measuring point storage range is used for representing the number of the measuring points which can be stored in the station area; the target measuring point is one of the measuring points of the platform area; and if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point. Compared with the scheme in the prior art, the method combines the service and the field task use environment to perform data storage optimization processing, efficiently compresses the expenditure of data storage space, is beneficial to reducing the expenditure of data storage space, and solves the problem that the storage space is seriously wasted in the existing data processing method.
Example two:
referring to fig. 2, an embodiment of the present invention provides another data processing method, which determines in advance an acquisition task of a distribution room and measurement points included in the acquisition task, and allocates a record table to the measurement points, where the method includes:
step S202, judging whether the target measuring point is in the measuring point storage range;
wherein the measuring point storage range is used for representing the number of the measuring points which can be stored in the platform area; the target measuring point is one of the measuring points of the platform area;
and step S204, if the target measuring point is in the measuring point storage range, storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point.
Through the step S204, when the target measuring point is not in the measuring point storage range, the storage space is fixed at the moment, and dynamic allocation is not executed, so that an acceptable space is adopted to replace efficient and stable retrieval conditions; i.e. to facilitate data retrieval and viewing.
Step S206, if the target measuring point is not in the measuring point storage range, determining an acquisition task corresponding to the target measuring point; and deleting the data of all the measuring points in the acquisition task corresponding to the target measuring point.
For step S206, specifically, in the case that the mapping quantity point is not in the measurement point storage range, the data of all measurement points in the data file corresponding to the collection task is deleted by determining the collection task corresponding to the target measurement point, where the data of all measurement points in the data file corresponding to the collection task includes the record table corresponding to the measurement point and the collection data item OAD recorded therein.
Through step S206, the problem of abnormal data retrieval due to incomplete coverage points is avoided.
In the data processing method provided by the embodiment of the invention, when the measuring point is changed, for example, the measuring point of the distribution room is increased, the fixed value (namely, the storage range of the measuring point) is referred, namely, the storage space is fixed in the range of a certain measuring point (Pn _ Min-Pn _ Max), the dynamic allocation is not executed, and the acceptable space is adopted to replace the efficient and stable retrieval condition; if the measuring point is out of the range of (Pn _ Min-Pn _ Max), deleting the data of all measuring points (all measuring points included in the acquisition task) corresponding to the acquisition task according to the acquisition task corresponding to the changed measuring point, and avoiding the abnormal data retrieval caused by incomplete coverage points.
Considering the case of how to store data in consideration of the limited recording space of each recording table, referring to fig. 3, in an alternative embodiment, for a target acquisition data item OAD of a target measurement point, the method further includes:
step S302, judging whether the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point;
the target acquisition data item OAD may be understood as one of acquisition data items OAD obtained by acquiring data of the target measurement point; the acquisition data item OAD may comprise an acquisition time, data content, and may also comprise a time of transmission to the log, a time of storage to the log, etc.
The above capacity range may be understood as the number of collected data items OAD that the record table can store, and may also be understood as the byte size that the record table can store.
Step S304, if the target collected data item OAD is not within the recording capacity range of the recording table corresponding to the target measurement point, delete the earliest recorded collected data item OAD in the recording table corresponding to the target measurement point, and write the target collected data item OAD into the recording table.
Through step S304, if the storage depth is full, i.e. the tail rounding is started, rolling back to the earliest record, performing overlay filling according to the fixed area, recording the latest storage time point, and removing the current depth history record.
In step S306, if the target collected data item OAD is within the recording capacity range of the recording table corresponding to the target measurement point, the target collected data item OAD is written into the recording table.
Specifically, the record table records data in chronological order, and therefore, writing the target collected data item OAD into the record table herein means writing the target collected data item OAD into the record table after the previous collected data item OAD (the one closest to the collection time) and recording the latest storage time point.
According to the data processing method provided by the embodiment of the invention, data storage optimization processing is carried out by combining service and field task use environments, the expenditure of data storage space is efficiently compressed, and a judgment mechanism under abnormal data storage is introduced, so that efficient and stable data storage is really realized, and the external normal acquisition of the terminal data of the power equipment is facilitated.
Compared with the traditional storage method, the method mainly has the following advantages:
1. the fixed storage and the dynamic storage are switched, the acquisition and storage efficiency of the power equipment terminal is improved, the space expenditure is saved, and the retrieval data is stable and reliable;
2. the data retrieval is convenient, the OAD of the specified collected data item can be retrieved according to the specified measurement point TSA, and the OAD record of the corresponding collected data item can be cleared according to the specified measurement point TSA;
3. under the condition of tail winding, a self-maintenance mechanism is provided, so that abnormal data can be prevented from being generated (such as data mutation or empty retrieval);
4. under the condition of multitask and multi-OAD reading, each assessment data item can be stored completely.
Example three:
referring to fig. 4, an embodiment of the present invention provides a data processing apparatus, which determines in advance an acquisition task of a distribution room and a measurement point included in the acquisition task, where the apparatus includes:
a judging module 401, configured to judge whether the target measurement point is within a measurement point storage range; the measuring point storage range is used for representing the number of the measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
a storage module 402, configured to store the acquired data of the target measurement point in a record table corresponding to the target measurement point if the target measurement point is within the measurement point storage range.
In an alternative embodiment, the apparatus further comprises:
a determining module 403, configured to determine, when the target measurement point is not within the measurement point storage range, an acquisition task corresponding to the target measurement point;
a deleting module 404, configured to delete data of all measurement points in the acquisition task corresponding to the target measurement point.
In an alternative embodiment, the determining module 401 is further configured to acquire a data item OAD for a target of a target measurement point; judging whether the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point; if the target acquisition data item OAD is not in the recording capacity range of the recording table corresponding to the target measurement point, deleting the earliest recorded acquisition data item OAD in the recording table corresponding to the target measurement point, and writing the target acquisition data item OAD into the recording table;
in an optional embodiment, the determining module 401 is further configured to write the target collected data item OAD into the record table if the target collected data item OAD is within the record capacity range of the record table corresponding to the target measurement point.
In an optional embodiment, when an acquisition task of a distribution room and a measurement point included in the acquisition task are predetermined and a record table is allocated to the measurement point, the method includes: creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs; creating a record table of the measuring points; the recording table is used for recording the collected data item OAD of the measuring point; and associating the record table with the measuring point.
In an alternative embodiment, the keywords mentioned above include the acquisition time scale, the measurement point, and the acquisition data item OAD.
In an optional embodiment, each measurement point carries a number identifier, and the determining module 401 is configured to determine whether the target measurement point is in the measurement point storage range based on the number identifier of the target measurement point when determining whether the target measurement point is in the measurement point storage range.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus described above may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
The data processing device provided by the embodiment of the invention has the same technical characteristics as the data processing method provided by the embodiment, so that the same technical problems can be solved, and the same technical effects can be achieved.
In all examples shown and described herein, any particular value should be construed as merely exemplary, and not as a limitation, and thus other examples of example embodiments may have different values.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
An embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method when executing the computer program.
Referring to fig. 5, an electronic device 500 according to an embodiment of the present invention includes: the device comprises a processor 50, a memory 51, a bus 52 and a communication interface 53, wherein the processor 50, the communication interface 53 and the memory 51 are connected through the bus 52; the processor 50 is arranged to execute executable modules, such as computer programs, stored in the memory 51.
The Memory 51 may include a high-speed Random Access Memory (RAM) and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The communication connection between the network element of the system and at least one other network element is realized through at least one communication interface 53 (which may be wired or wireless), and the internet, a wide area network, a local network, a metropolitan area network, and the like can be used.
The bus 52 may be an ISA bus, PCI bus, EISA bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 5, but this does not indicate only one bus or one type of bus.
The memory 51 is used for storing a program, the processor 50 executes the program after receiving an execution instruction, and the method executed by the apparatus defined by the flow process disclosed in any of the foregoing embodiments of the present invention may be applied to the processor 50, or implemented by the processor 50.
The processor 50 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 50. The Processor 50 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 51, and the processor 50 reads the information in the memory 51 and completes the steps of the method in combination with the hardware thereof.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program executes the steps of the data processing method.
The computer program product for performing the data processing method provided in the embodiment of the present invention includes a computer-readable storage medium storing a nonvolatile program code executable by a processor, where instructions included in the program code may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment, and is not described herein again.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A data processing method is characterized in that an acquisition task of a distribution room and measurement points included in the acquisition task are predetermined, and a record table is allocated to the measurement points; the method comprises the following steps:
judging whether the target measuring point is in the measuring point storage range or not; wherein the measuring point storage range is used for representing the number of the measuring points which can be stored in the platform area; the target measuring point is one of the measuring points of the platform area;
and if the target measuring point is within the measuring point threshold range, storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point.
2. The method of claim 1, further comprising:
if the target measuring point is not in the measuring point storage range, determining an acquisition task corresponding to the target measuring point;
and deleting the data of all the measuring points in the acquisition task corresponding to the target measuring point.
3. The method of claim 1, further comprising:
acquiring a data item OAD for a target of a target measurement point;
judging whether the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point;
and if the target acquisition data item OAD is not in the recording capacity range of the recording table corresponding to the target measurement point, deleting the earliest recorded acquisition data item OAD in the recording table corresponding to the target measurement point, and writing the target acquisition data item OAD into the recording table.
4. The method of claim 3, further comprising:
and if the target acquisition data item OAD is in the recording capacity range of the recording table corresponding to the target measurement point, writing the target acquisition data item OAD into the recording table.
5. The method according to claim 1, wherein the step of predetermining acquisition tasks of the cell and measurement points included in the acquisition tasks and allocating a record table to the measurement points comprises:
creating a data file of an acquisition task, wherein the data file comprises a service identifier and a keyword of a service to which the acquisition task belongs;
creating a record table of the measuring points; the recording table is used for recording the collected data item OAD of the measuring point;
and associating the record table with the measuring point.
6. The method of claim 5, wherein the keywords comprise acquisition time scale, measurement point, and acquisition data item OAD.
7. The method according to claim 1, wherein each measurement point carries a quantity identifier, and the step of determining whether the target measurement point is within a measurement point storage range comprises:
and judging whether the target measuring point is in the measuring point storage range or not based on the number identification of the target measuring points.
8. A data processing apparatus characterized in that an acquisition task of a station area and measurement points included in the acquisition task are predetermined, the apparatus comprising:
the judging module is used for judging whether the target measuring point is in the measuring point storage range or not; the measuring point storage range is used for representing the number of the measuring points which can be stored in the platform area; wherein the target measurement point is one of the measurement points of the station area;
and the storage module is used for storing the acquired data of the target measuring point into a recording table corresponding to the target measuring point if the target measuring point is within the measuring point threshold range.
9. The apparatus of claim 8, further comprising:
the determining module is used for determining an acquisition task corresponding to the target measuring point when the target measuring point is not in the measuring point storage range;
and the deleting module is used for deleting the data of all the measuring points in the acquisition task corresponding to the target measuring point.
10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of any of the preceding claims 1 to 7 are implemented when the computer program is executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911341060.9A CN111061752B (en) | 2019-12-23 | 2019-12-23 | Data processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911341060.9A CN111061752B (en) | 2019-12-23 | 2019-12-23 | Data processing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111061752A true CN111061752A (en) | 2020-04-24 |
| CN111061752B CN111061752B (en) | 2023-12-08 |
Family
ID=70302552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911341060.9A Active CN111061752B (en) | 2019-12-23 | 2019-12-23 | Data processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111061752B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112084147A (en) * | 2020-09-10 | 2020-12-15 | 珠海美佳音科技有限公司 | Data storage method, data acquisition recorder and electronic equipment |
| CN112256697A (en) * | 2020-10-14 | 2021-01-22 | 宁波三星医疗电气股份有限公司 | Method for managing data of power acquisition terminal |
| CN112947326A (en) * | 2021-01-28 | 2021-06-11 | 深圳市科陆电子科技股份有限公司 | Fuzzy flexible platform power supply quality data processing method and device and storage medium |
| CN116630091A (en) * | 2023-07-20 | 2023-08-22 | 赛维斯智慧环境科技(山东)有限公司 | Industrial real-time data linkage analysis system |
| CN117389486A (en) * | 2023-12-13 | 2024-01-12 | 浙江国利信安科技有限公司 | Method, computing device and storage medium for real-time processing EPA network data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105656029A (en) * | 2016-01-26 | 2016-06-08 | 国网山东省电力公司青岛供电公司 | Method and device for determining load points outside power supply radius of low-voltage power supply region |
| CN106373372A (en) * | 2016-08-30 | 2017-02-01 | 成都博高信息技术股份有限公司 | Method and system for remotely reading meters |
| CN107908728A (en) * | 2017-11-14 | 2018-04-13 | 广东电网有限责任公司电力科学研究院 | A kind of storage of online monitoring data history value and access method |
| CN107957904A (en) * | 2017-11-21 | 2018-04-24 | 积成电子股份有限公司 | The power information acquisition tasks management method of exchange agreement based on object-oriented |
| CN109614447A (en) * | 2018-10-15 | 2019-04-12 | 国网新疆电力有限公司阿克苏供电公司 | A kind of intelligent electric meter divides the storage method, querying method and device of freezing data |
-
2019
- 2019-12-23 CN CN201911341060.9A patent/CN111061752B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105656029A (en) * | 2016-01-26 | 2016-06-08 | 国网山东省电力公司青岛供电公司 | Method and device for determining load points outside power supply radius of low-voltage power supply region |
| CN106373372A (en) * | 2016-08-30 | 2017-02-01 | 成都博高信息技术股份有限公司 | Method and system for remotely reading meters |
| CN107908728A (en) * | 2017-11-14 | 2018-04-13 | 广东电网有限责任公司电力科学研究院 | A kind of storage of online monitoring data history value and access method |
| CN107957904A (en) * | 2017-11-21 | 2018-04-24 | 积成电子股份有限公司 | The power information acquisition tasks management method of exchange agreement based on object-oriented |
| CN109614447A (en) * | 2018-10-15 | 2019-04-12 | 国网新疆电力有限公司阿克苏供电公司 | A kind of intelligent electric meter divides the storage method, querying method and device of freezing data |
Non-Patent Citations (2)
| Title |
|---|
| 郑安刚;巫钟兴;张乐群;: "面向对象的数据交换协议研究与应用", 电测与仪表, no. 24 * |
| 郭文生;韦万寿;李斌;呼松鹤;: "配电台区温度远程监测系统的开发及应用", 中国新技术新产品, no. 01 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112084147A (en) * | 2020-09-10 | 2020-12-15 | 珠海美佳音科技有限公司 | Data storage method, data acquisition recorder and electronic equipment |
| CN112256697A (en) * | 2020-10-14 | 2021-01-22 | 宁波三星医疗电气股份有限公司 | Method for managing data of power acquisition terminal |
| CN112947326A (en) * | 2021-01-28 | 2021-06-11 | 深圳市科陆电子科技股份有限公司 | Fuzzy flexible platform power supply quality data processing method and device and storage medium |
| CN112947326B (en) * | 2021-01-28 | 2022-09-06 | 深圳市科陆电子科技股份有限公司 | Fuzzy flexible platform power supply quality data processing method and device and storage medium |
| CN116630091A (en) * | 2023-07-20 | 2023-08-22 | 赛维斯智慧环境科技(山东)有限公司 | Industrial real-time data linkage analysis system |
| CN116630091B (en) * | 2023-07-20 | 2023-10-13 | 赛维斯智慧环境科技(山东)有限公司 | Industrial real-time data linkage analysis system |
| CN117389486A (en) * | 2023-12-13 | 2024-01-12 | 浙江国利信安科技有限公司 | Method, computing device and storage medium for real-time processing EPA network data |
| CN117389486B (en) * | 2023-12-13 | 2024-04-19 | 浙江国利信安科技有限公司 | Method, computing device and storage medium for real-time processing EPA network data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111061752B (en) | 2023-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111061752A (en) | Data processing method and device and electronic equipment | |
| CN108683720B (en) | Container cluster service configuration method and device | |
| CN111818112B (en) | Kafka system-based message sending method and device | |
| CN109669776B (en) | Detection task processing method, device and system | |
| CN112346829B (en) | Method and equipment for task scheduling | |
| CN111597158B (en) | Rolling method and device for log files, storage medium and terminal | |
| CN110825694A (en) | Data processing method, device, equipment and storage medium | |
| CN110737717B (en) | Database migration method and device | |
| CN112527746A (en) | Log storage method, device, equipment and storage medium | |
| CN111694505B (en) | Data storage management method, device and computer readable storage medium | |
| CN108255989A (en) | Picture storage method, device, terminal device and computer storage media | |
| CN109522273B (en) | Method and device for realizing data writing | |
| CN112650449B (en) | Method and system for releasing cache space, electronic device and storage medium | |
| CN112860412B (en) | Service data processing method and device, electronic equipment and storage medium | |
| CN109977074B (en) | HDFS-based LOB data processing method and device | |
| CN112463058A (en) | Fragmented data sorting method and device and storage node | |
| CN115993932A (en) | Data processing method, device, storage medium and electronic equipment | |
| CN114036104A (en) | Cloud filing method, device and system for re-deleted data based on distributed storage | |
| CN114896215A (en) | Metadata storage method and device | |
| CN108595122B (en) | Computer security management system based on local area network | |
| CN112148513B (en) | Method, device and storage medium for dumping single-point service data | |
| CN112162949A (en) | File management method, system, electronic equipment and storage medium | |
| CN112433888A (en) | Data processing method and device, storage medium and electronic equipment | |
| CN111143288A (en) | Data storage method, system and related device | |
| CN115081233B (en) | Flow simulation method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |