CN112507013A - Industrial equipment data storage method and device - Google Patents
Industrial equipment data storage method and device Download PDFInfo
- Publication number
- CN112507013A CN112507013A CN202110167843.0A CN202110167843A CN112507013A CN 112507013 A CN112507013 A CN 112507013A CN 202110167843 A CN202110167843 A CN 202110167843A CN 112507013 A CN112507013 A CN 112507013A
- Authority
- CN
- China
- Prior art keywords
- file
- data
- storage
- industrial equipment
- storing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method and a device for storing industrial equipment data. The method comprises the following steps: acquiring at least one industrial equipment original data file; when the original data file of the at least one industrial device is monitored to be changed, processing the original data file of the at least one industrial device to generate at least one storage file; storing the at least one storage file in a data storage system. The scheme of the invention realizes the separation of manual operation, reduces resource consumption, improves the timeliness of file conversion, and simultaneously prevents data loss caused by the missing processing of the data file.
Description
Technical Field
The invention relates to the technical field of industrial equipment big data processing, in particular to a method and a device for storing industrial equipment data.
Background
Data collected from each station needs to be stored by using a file (e.g. request) or a database with a specified format, however, the data file from the station does not necessarily need to be the file format to be stored, secondary processing is needed, and after the data file is successfully stored, updating and saving of statistical information of the data and the like need to be completed in a storage system of the data file.
In the prior art, data collected from a station cannot be effectively stored, and the storage efficiency is low.
Disclosure of Invention
The invention aims to provide a method and a device for storing industrial equipment data. The problems that data collected from a station cannot be effectively stored and the storage efficiency is low are solved, the technical effects of manual operation separation, resource consumption reduction, file conversion timeliness improvement and data loss caused by missing processing of data files are achieved, and meanwhile the technical effects of data loss are prevented.
In order to solve the technical problems, the technical scheme of the invention is as follows:
the invention provides a storage method of industrial equipment data, which comprises the following steps:
acquiring at least one industrial equipment original data file;
when the original data file of the at least one industrial device is monitored to be changed, processing the original data file of the at least one industrial device to generate at least one storage file;
storing the at least one storage file in a data storage system.
Optionally, the raw data file of the industrial device includes at least one of the following:
a sensor data file;
and (5) a model analysis result file.
Optionally, when it is monitored that the at least one industrial device raw data file is changed, processing the at least one industrial device data file to generate at least one storage file, including:
storing the at least one industrial equipment original data file in a data file monitoring directory;
when the original data file of the industrial equipment under the data file monitoring directory is changed, a file change log is generated;
and processing the at least one industrial equipment original data file according to the file change log to generate at least one storage file.
Optionally, processing the at least one industrial device data file according to the file change log to generate at least one storage file, including:
storing the file change log into a message queue;
and performing data format conversion processing on the files in the message queue to generate at least one storage file.
Optionally, performing data format conversion processing on the file in the message queue to generate at least one storage file, including:
acquiring a configuration file corresponding to each type of file according to the type of at least one file in the message queue;
and according to the configuration file, carrying out format conversion on the type of file in the message queue to generate at least one storage file.
Optionally, the file change log includes: absolute storage path of the file and operation information of the file.
Optionally, the method for storing industrial device data further includes: and if the file under the data file monitoring directory is a storage file, generating an instruction for not performing data format conversion processing.
Optionally, the method for storing industrial device data further includes: and carrying out data statistics according to the storage file to obtain a statistical file.
The invention provides a storage device of industrial equipment data, comprising:
the acquisition module is used for acquiring at least one industrial equipment original data file;
the processing module is used for processing the at least one industrial equipment original data file to generate at least one storage file when monitoring that the at least one industrial equipment original data file is changed;
and the storage module is used for storing the at least one storage file in a data storage system.
The present invention also provides a computer-readable storage medium storing instructions which, when executed on a computer, cause the computer to perform the method as described above.
The scheme of the invention at least comprises the following beneficial effects:
according to the scheme, at least one industrial equipment original data file is obtained; when the original data file of the at least one industrial device is monitored to be changed, processing the original data file of the at least one industrial device to generate at least one storage file; storing the at least one storage file in a data storage system. The original data file can be automatically stored, the problems that the data collected from a station cannot be effectively stored and the storage efficiency is low are solved, the technical effects of manual operation separation, resource consumption reduction, file conversion timeliness improvement and data loss caused by missing processing of the data file are achieved, and meanwhile the technical effects of data loss are prevented.
Drawings
FIG. 1 is a schematic flow chart diagram of a method for storing industrial equipment data according to an embodiment of the invention;
FIG. 2 is a schematic diagram illustrating a storage principle of a storage method of industrial equipment data according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a flow chart of a specific implementation of a method for storing industrial equipment data according to an embodiment of the invention;
FIG. 4 is a diagram illustrating an implementation of a method for storing data of an industrial device according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a data file monitoring directory in a data storage method of an industrial device according to an embodiment of the present invention;
FIG. 6 is a block diagram of an industrial equipment data storage device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As shown in fig. 1, an embodiment of the present invention provides a method for storing industrial device data, including:
and step 13, storing the at least one storage file in a data storage system.
According to the embodiment of the invention, when the original data file of the industrial equipment is changed, the original data file of the industrial equipment is processed to generate the at least one storage file and is stored, the original data file can be automatically stored, the problems that the data collected from a field station cannot be effectively stored and the storage efficiency is low are solved, the technical effects of separating from manual operation, reducing resource consumption, improving timeliness of file conversion and preventing data loss caused by the missing processing of the data file are realized.
As shown in fig. 2, in a specific embodiment, the original data files generated by the industrial device 1, the industrial device 2, and the industrial device 3 are respectively a file 1, a file 2, a file 3, and the like, and when the original data file is monitored to be changed, the original data file is subjected to format conversion of the data file and stored in a corresponding time sequence database in a form of a storage file, and finally, a batch export process is provided for a user to use.
In an optional embodiment of the present invention, the raw data file of the industrial device in step 11 includes at least one of the following: a sensor data file; and (5) a model analysis result file. Here, the raw data file of the industrial device is only an example, and is not limited to the sensor data file and the model analysis result file, and may be raw data files of other industrial devices.
In this embodiment, the sensor data file and the model analysis result file are subjected to data file format conversion processing by the monitor, and are finally stored in the data storage system.
In an alternative embodiment of the present invention, step 12 includes:
step 121, storing the at least one industrial equipment original data file in a data file monitoring directory;
step 122, when the original data file of the industrial equipment under the data file monitoring directory is changed, a file change log is generated;
and step 123, processing the at least one industrial equipment original data file according to the file change log to generate at least one storage file.
In the embodiment, at least one industrial equipment original data file is stored in a data file monitoring directory, so that a monitor is triggered to work, the monitor generates a file change log when monitoring that the industrial equipment original data file in the data file monitoring directory is changed, and the at least one industrial equipment original data file is processed according to the file change log to generate at least one storage file; and further may store the storage file in a data storage system.
Here, the monitor may include: the file system monitoring system comprises a file system monitoring A, a message queue B and a file processor C, wherein the file system monitoring A can specifically use file monitoring tools such as common-io sdk, timed polling file systems, inotify-tools and the like; when the file is changed, the monitoring tool directly outputs the changed file path and the changed mode in a triggering mode, so that the changed data file can be processed more timely. The log message queue B may use message queues such as "redis", "mq", "kafka", etc., and the file processor C is preferably a Consumer.
The structure of the file change log may include: an absolute storage path of a file and operation information of the file, i.e., "file absolute path", "-", "file operation", file operations such as CLOSE _ WRITE, CLOSE | DELETE | CREATE, etc.;
in a specific embodiment, a sample of log information is as follows:
/fileSys/repo_data/raw-CREATE,ISDIR；
/fileSys/repo_data/raw/gendata_dev1.csv-CLOSE_WRITE,CLOSE；
/fileSys/repo_data/raw/gendata_dev2.csv-CLOSE_WRITE,CLOSE；
/fileSys/repo_data/raw/gendata_dev3.csv-CLOSE_WRITE,CLOSE；
in an alternative embodiment of the present invention, step 123 includes:
step 1231, storing the file change log in a message queue;
step 1232, perform data format conversion processing on the files in the message queue, and generate at least one storage file.
Here, the message queue may use a message queue such as "redis", "mq", "kafka", etc., so that the integrity of data storage may be secured.
In an alternative embodiment of the present invention, step 1232 may comprise:
acquiring a configuration file corresponding to each type of file according to the type of at least one file in the message queue;
and according to the configuration file, carrying out format conversion on the type of file in the message queue to generate at least one storage file.
In this embodiment, a file change log (i.e., a file in a message queue) in a message queue is consumed, a file path and an operation are obtained, a configuration file in a data file monitoring directory where the file is located is further obtained, the file is analyzed according to a rule of configuration of the configuration file, and the file is stored according to a storage mode in the configuration;
here, the types of files may include more kinds of files such as csv, excel, sqlite, and the like; each type of file corresponds to one configuration file, and the configuration files corresponding to various types of files can be provided, so that the storage processing of various types of files can be realized.
In an optional embodiment of the present invention, the method for storing industrial device data may further include:
and step 14, if the files in the data file monitoring directory are monitored to be storage files, generating an instruction for not performing data format conversion processing.
In this embodiment, if the file under the data file monitoring directory is monitored to be the converted storage file, the data format conversion processing is not performed, so that the data processing efficiency is improved.
In an optional embodiment of the present invention, the method for storing industrial device data may further include:
and step 15, performing data statistics according to the storage file to obtain a statistical file.
In the embodiment, data statistics can be further performed on the storage files in the data storage system to obtain the statistical files, so that the statistical requirements of users are met, statistics is not performed based on the original data files, and the statistical efficiency is improved.
The following describes a specific implementation process of the above method with reference to fig. 3 to 5:
the data file monitoring directory receives sensor data files, model analysis result files and the like from the industrial equipment, wherein as shown in fig. 4 and 5, the data file monitoring directory may include a plurality of monitoring directories, and each monitoring directory may store a plurality of data files of one type and configuration files corresponding to the data files of the type; the types of data files may include: csv, excel, and sqlite, among others. In an optional implementation manner, the monitoring directory includes a monitoring directory 1, a monitoring directory 2, and a monitoring directory 3, where the monitoring directory 1 stores at least one data file with a file type a and a configuration file a corresponding to the file type a, the monitoring directory 2 stores at least one data file with a file type B and a configuration file B corresponding to the file type B, and the monitoring directory 3 stores at least one data file with a file type C and a configuration file C corresponding to the file type C.
Monitoring a file system of the monitor, and triggering the monitor to generate a file change log after monitoring that a file in a data file monitoring directory is changed; putting the file change log in a message queue to wait for consumption processing; a file processor of the monitor consumes the changed files in the log queue, calls a file conversion processing logic to perform format conversion processing on the data files, generates storage files and stores the storage files in a data storage system;
and the data storage system completes the batch import process and provides the batch import process for users to use.
Furthermore, the catalog statistics can be carried out based on the storage files in the data storage system, and the statistical files are generated, so that the statistical efficiency is improved.
According to the embodiment of the invention, when the change of the file under the data file monitoring directory is monitored, the monitor is automatically triggered to generate and store the storage file, the manual operation is separated, and the operation is completed through one process, so that the resource consumption is reduced; meanwhile, after the data file is changed, the subsequent operation is completed in a triggering mode, so that the timeliness of file conversion is improved; furthermore, a file change log is managed by using a message queue, and after the monitoring is stopped and restarted, the data file changed in the stopping time period can be continuously processed, so that the data loss caused by the missing processing of the data file is prevented; the conversion and storage processing of the multi-type data files can be realized by configuring the configuration files of the multi-type files in the data file monitoring directory.
As shown in fig. 6, the present invention also provides an industrial equipment data storage device 60, including:
an obtaining module 61, configured to obtain at least one original data file of an industrial device;
the processing module 62 is configured to process the at least one industrial device raw data file to generate at least one storage file when it is monitored that the at least one industrial device raw data file is changed;
a storage module 63, configured to store the at least one storage file in a data storage system.
Optionally, the raw data file of the industrial device includes at least one of the following: a sensor data file; and (5) a model analysis result file.
Optionally, when it is monitored that the at least one industrial device raw data file is changed, processing the at least one industrial device data file to generate at least one storage file, including:
storing the at least one industrial equipment original data file in a data file monitoring directory;
when the original data file of the industrial equipment under the data file monitoring directory is changed, a file change log is generated;
and processing the at least one industrial equipment original data file according to the file change log to generate at least one storage file.
Optionally, processing the at least one industrial device data file according to the file change log to generate at least one storage file, including:
storing the file change log into a message queue;
and performing data format conversion processing on the files in the message queue to generate at least one storage file.
Optionally, performing data format conversion processing on the file in the message queue to generate at least one storage file, including:
acquiring a configuration file corresponding to each type of file according to the type of at least one file in the message queue;
and according to the configuration file, carrying out format conversion on the type of file in the message queue to generate at least one storage file.
Optionally, the file change log includes: absolute storage path of the file and operation information of the file.
Optionally, in the storage device of the industrial device data, the processing module is further configured to: and if the file under the data file monitoring directory is a storage file, generating an instruction for not performing data format conversion processing.
Optionally, in the storage device of the industrial device data, the processing module is further configured to: and carrying out data statistics according to the storage file to obtain a statistical file.
It should be noted that the apparatus in this embodiment is an apparatus corresponding to the method shown in fig. 1, and the implementation manners in the above embodiments are all applicable to the embodiment of the apparatus, and the same technical effects can be achieved. It should be noted that, the apparatus provided in the embodiment of the present invention can implement all the method steps implemented by the method embodiment and achieve the same technical effect, and detailed descriptions of the same parts and beneficial effects as the method embodiment in this embodiment are omitted here.
Embodiments of the present invention also provide a processor-readable storage medium having stored thereon processor-executable instructions for causing a processor to perform the method as described above. All the implementation manners in the above method embodiment are applicable to this embodiment, and the same technical effect can be achieved.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
Furthermore, it is to be noted that in the device and method of the invention, it is obvious that the individual components or steps can be decomposed and/or recombined. These decompositions and/or recombinations are to be regarded as equivalents of the present invention. Also, the steps of performing the series of processes described above may naturally be performed chronologically in the order described, but need not necessarily be performed chronologically, and some steps may be performed in parallel or independently of each other. It will be understood by those skilled in the art that all or any of the steps or elements of the method and apparatus of the present invention may be implemented in any computing device (including processors, storage media, etc.) or network of computing devices, in hardware, firmware, software, or any combination thereof, which can be implemented by those skilled in the art using their basic programming skills after reading the description of the present invention.
Thus, the objects of the invention may also be achieved by running a program or a set of programs on any computing device. The computing device may be a general purpose device as is well known. The object of the invention is thus also achieved solely by providing a program product comprising program code for implementing the method or the apparatus. That is, such a program product also constitutes the present invention, and a storage medium storing such a program product also constitutes the present invention. It is to be understood that the storage medium may be any known storage medium or any storage medium developed in the future. It is further noted that in the apparatus and method of the present invention, it is apparent that each component or step can be decomposed and/or recombined. These decompositions and/or recombinations are to be regarded as equivalents of the present invention. Also, the steps of executing the series of processes described above may naturally be executed chronologically in the order described, but need not necessarily be executed chronologically. Some steps may be performed in parallel or independently of each other.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. A method of storing industrial device data, comprising:
acquiring at least one industrial equipment original data file;
when the original data file of the at least one industrial device is monitored to be changed, processing the original data file of the at least one industrial device to generate at least one storage file;
storing the at least one storage file in a data storage system.
2. The method for storing industrial equipment data according to claim 1, wherein the industrial equipment raw data file comprises at least one of:
a sensor data file;
and (5) a model analysis result file.
3. The method for storing industrial equipment data according to claim 1, wherein when the at least one industrial equipment original data file is monitored to be changed, the at least one industrial equipment data file is processed to generate at least one storage file, and the method comprises the following steps:
storing the at least one industrial equipment original data file in a data file monitoring directory;
when the original data file of the industrial equipment under the data file monitoring directory is changed, a file change log is generated;
and processing the at least one industrial equipment original data file according to the file change log to generate at least one storage file.
4. The method for storing industrial device data according to claim 3, wherein the processing the at least one industrial device data file according to the file change log to generate at least one storage file comprises:
storing the file change log into a message queue;
and performing data format conversion processing on the files in the message queue to generate at least one storage file.
5. The method for storing industrial equipment data according to claim 4, wherein performing data format conversion processing on the files in the message queue to generate at least one storage file comprises:
acquiring a configuration file corresponding to each type of file according to the type of at least one file in the message queue;
and according to the configuration file, carrying out format conversion on the type of file in the message queue to generate at least one storage file.
6. The method of claim 4, wherein the file change log comprises: absolute storage path of the file and operation information of the file.
7. The method for storing industrial equipment data according to claim 1, further comprising:
and if the file under the data file monitoring directory is a storage file, generating an instruction for not performing data format conversion processing.
8. The method for storing industrial equipment data according to claim 1, further comprising:
and carrying out data statistics according to the storage file to obtain a statistical file.
9. An apparatus for storing industrial equipment data, comprising:
the acquisition module is used for acquiring at least one industrial equipment original data file;
the processing module is used for processing the at least one industrial equipment original data file to generate at least one storage file when monitoring that the at least one industrial equipment original data file is changed;
and the storage module is used for storing the at least one storage file in a data storage system.
10. A computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110167843.0A CN112507013B (en) | 2021-02-07 | 2021-02-07 | Industrial equipment data storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110167843.0A CN112507013B (en) | 2021-02-07 | 2021-02-07 | Industrial equipment data storage method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112507013A true CN112507013A (en) | 2021-03-16 |
| CN112507013B CN112507013B (en) | 2021-07-02 |
Family
ID=74952830
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110167843.0A Active CN112507013B (en) | 2021-02-07 | 2021-02-07 | Industrial equipment data storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112507013B (en) |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5566332A (en) * | 1990-03-27 | 1996-10-15 | International Business Machines Corporation | Method and combination for minimizing data conversions when data is transferred between a first database storing data in a first format and a second database storing data in a second format |
| CN106302517A (en) * | 2016-09-09 | 2017-01-04 | 深圳市智物联网络有限公司 | The control method of a kind of industrial equipment, system and terminal |
| CN106713487A (en) * | 2017-01-16 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| CN107180116A (en) * | 2017-06-28 | 2017-09-19 | 努比亚技术有限公司 | A kind of data synchronizing processing method, mobile terminal and computer-readable recording medium |
| CN107885791A (en) * | 2017-10-19 | 2018-04-06 | 北京工业大数据创新中心有限公司 | A kind of sensing data Hierarchical storage apparatus and method |
| US20180275902A1 (en) * | 2017-03-26 | 2018-09-27 | Oracle International Corporation | Rule-based modifications in a data storage appliance monitor |
| CN108763387A (en) * | 2018-05-20 | 2018-11-06 | 湖北九州云仓科技发展有限公司 | Big data fusion method, electronic equipment, storage medium and the system of heterogeneous platform |
| CN108804613A (en) * | 2018-05-30 | 2018-11-13 | 国网山东省电力公司经济技术研究院 | A kind of Various database real time fusion system and its fusion method |
| CN110309165A (en) * | 2019-07-04 | 2019-10-08 | 江苏满运软件科技有限公司 | Processing method, device, storage medium and the electronic equipment of databases comparison content |
| CN110457256A (en) * | 2019-08-01 | 2019-11-15 | 大众问问(北京)信息科技有限公司 | Date storage method, device, computer equipment and storage medium |
| CN110674213A (en) * | 2019-08-30 | 2020-01-10 | 中国人民财产保险股份有限公司 | Data synchronization method and device |
| CN111324648A (en) * | 2020-01-21 | 2020-06-23 | 北京工业大数据创新中心有限公司 | Method and device for processing time sequence data |
| CN111625517A (en) * | 2020-04-29 | 2020-09-04 | 山东国华时代投资发展有限公司 | New energy real-time data processing method and device based on change storage |
| CN111752910A (en) * | 2020-06-24 | 2020-10-09 | 上海微盟企业发展有限公司 | Data synchronization method, system and related device for heterogeneous platform |
| CN111930529A (en) * | 2020-10-09 | 2020-11-13 | 上海富友支付服务股份有限公司 | Data synchronization method, module and system based on message queue and micro-service |
| CN112214453A (en) * | 2020-09-14 | 2021-01-12 | 上海微亿智造科技有限公司 | Large-scale industrial data compression storage method, system and medium |
| CN112231402A (en) * | 2020-10-14 | 2021-01-15 | 广东亿迅科技有限公司 | Real-time synchronization method, device, equipment and storage medium for heterogeneous data |
-
2021
- 2021-02-07 CN CN202110167843.0A patent/CN112507013B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5566332A (en) * | 1990-03-27 | 1996-10-15 | International Business Machines Corporation | Method and combination for minimizing data conversions when data is transferred between a first database storing data in a first format and a second database storing data in a second format |
| CN106302517A (en) * | 2016-09-09 | 2017-01-04 | 深圳市智物联网络有限公司 | The control method of a kind of industrial equipment, system and terminal |
| CN106713487A (en) * | 2017-01-16 | 2017-05-24 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| US20180275902A1 (en) * | 2017-03-26 | 2018-09-27 | Oracle International Corporation | Rule-based modifications in a data storage appliance monitor |
| CN107180116A (en) * | 2017-06-28 | 2017-09-19 | 努比亚技术有限公司 | A kind of data synchronizing processing method, mobile terminal and computer-readable recording medium |
| CN107885791A (en) * | 2017-10-19 | 2018-04-06 | 北京工业大数据创新中心有限公司 | A kind of sensing data Hierarchical storage apparatus and method |
| CN108763387A (en) * | 2018-05-20 | 2018-11-06 | 湖北九州云仓科技发展有限公司 | Big data fusion method, electronic equipment, storage medium and the system of heterogeneous platform |
| CN108804613A (en) * | 2018-05-30 | 2018-11-13 | 国网山东省电力公司经济技术研究院 | A kind of Various database real time fusion system and its fusion method |
| CN110309165A (en) * | 2019-07-04 | 2019-10-08 | 江苏满运软件科技有限公司 | Processing method, device, storage medium and the electronic equipment of databases comparison content |
| CN110457256A (en) * | 2019-08-01 | 2019-11-15 | 大众问问(北京)信息科技有限公司 | Date storage method, device, computer equipment and storage medium |
| CN110674213A (en) * | 2019-08-30 | 2020-01-10 | 中国人民财产保险股份有限公司 | Data synchronization method and device |
| CN111324648A (en) * | 2020-01-21 | 2020-06-23 | 北京工业大数据创新中心有限公司 | Method and device for processing time sequence data |
| CN111625517A (en) * | 2020-04-29 | 2020-09-04 | 山东国华时代投资发展有限公司 | New energy real-time data processing method and device based on change storage |
| CN111752910A (en) * | 2020-06-24 | 2020-10-09 | 上海微盟企业发展有限公司 | Data synchronization method, system and related device for heterogeneous platform |
| CN112214453A (en) * | 2020-09-14 | 2021-01-12 | 上海微亿智造科技有限公司 | Large-scale industrial data compression storage method, system and medium |
| CN111930529A (en) * | 2020-10-09 | 2020-11-13 | 上海富友支付服务股份有限公司 | Data synchronization method, module and system based on message queue and micro-service |
| CN112231402A (en) * | 2020-10-14 | 2021-01-15 | 广东亿迅科技有限公司 | Real-time synchronization method, device, equipment and storage medium for heterogeneous data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112507013B (en) | 2021-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109861844B (en) | Cloud service problem fine-grained intelligent tracing method based on logs | |
| CN106682213B (en) | Internet of things task customizing method and system based on Hadoop platform | |
| CN110427252B (en) | Task scheduling method, device and storage medium based on task dependency relationship | |
| US20180011742A1 (en) | Job scheduling management | |
| US11314808B2 (en) | Hybrid flows containing a continous flow | |
| CN106354817B (en) | Log processing method and device | |
| CN111339073A (en) | Real-time data processing method and device, electronic equipment and readable storage medium | |
| CN111984390A (en) | Task scheduling method, device, equipment and storage medium | |
| CN106780149A (en) | A kind of equipment real-time monitoring system based on timed task scheduling | |
| CN111897548A (en) | Front-end resource publishing method and device, electronic equipment and computer storage medium | |
| CN108829505A (en) | A kind of distributed scheduling system and method | |
| CN112817720A (en) | Visual workflow scheduling method and device and electronic equipment | |
| CN103077192A (en) | Data processing method and system thereof | |
| CN111563131A (en) | Database entity relation generation method and device, computer equipment and storage medium | |
| CN115567370A (en) | Automatic alarm method, storage medium and system based on real-time event data | |
| CN107153679B (en) | Extraction statistical method and system for semi-structured big data | |
| CN112507013B (en) | Industrial equipment data storage method and device | |
| CN115905371A (en) | Data trend analysis method, device and equipment and computer readable storage medium | |
| US11681721B2 (en) | Systems and methods for spark lineage data capture | |
| CN112015623B (en) | Report data processing method, device, equipment and readable storage medium | |
| CN115794545A (en) | Automatic processing method of operation and maintenance data and related equipment thereof | |
| CN104731900A (en) | Hive scheduling method and device | |
| CN113407430A (en) | Single index parameter acquisition method and device based on application performance monitoring | |
| WO2020013909A1 (en) | Block-based prediction for manufacturing environments | |
| CN113760489B (en) | Resource allocation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |