CN114079668A - Information acquisition and arrangement method and system based on internet big data - Google Patents
Information acquisition and arrangement method and system based on internet big data Download PDFInfo
- Publication number
- CN114079668A CN114079668A CN202210062901.8A CN202210062901A CN114079668A CN 114079668 A CN114079668 A CN 114079668A CN 202210062901 A CN202210062901 A CN 202210062901A CN 114079668 A CN114079668 A CN 114079668A
- Authority
- CN
- China
- Prior art keywords
- data
- new
- new data
- source end
- cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention relates to an information acquisition and arrangement method and system based on internet big data, wherein the system needs to be built before the system works. At least two or more client sides are arranged, a source end data acquisition end is embedded in each client side, and a data preprocessing module is embedded in the source end data acquisition end; setting a data server, configuring the data server to have a data server cache end and a shared cache end, and then establishing communication connection between the client and the data server. The communication connection between the client and the data server adopts a communication wake-up and use mode; namely, the data preprocessing module wakes up the connection between the communication channel and the data server through the synchronous task processing thread. The target data can be traced, all the target data are cached and stored in a sharing mode, the storage capacity is strong, the data can be modified at any time, the demand response to the data change is more timely, and the global flexibility is realized.
Description
Technical Field
The invention relates to the technical field of internet big data, in particular to an information acquisition and arrangement method and system based on internet big data.
Background
The traditional informatization construction basically takes business as guidance, and the original manual process is automated and efficient by using a computer technology. The information systems are often integrated by application programs and corresponding database systems, which are not communicated with each other, and gradually form enterprise data islands.
With the increasingly updated internet of things and the continuous excavation of big data, in some fields, data exchange and fusion between data islands are started to be realized, so that more data opinions which can be referred to are provided for different enterprises, when data excavation is carried out, a tracking system between an acquisition end and a storage end is often required to be established so as to be capable of carrying out retrieval analysis on data of different ends, at present, when new business is required, one-time data extraction is carried out from each source system, and a series of complicated steps such as department coordination, system account opening, data dictionaries and the like are involved. And common tools are based on a batch periodic drawing mode, some service scenes with high real-time requirements on data are difficult to realize, reusability is avoided, and a large amount of manpower is needed to be spent on resynchronization or a synchronization program is needed to be modified to realize each time a new requirement or a requirement is changed.
Disclosure of Invention
In view of the above, the present invention provides an information collecting and organizing method and system based on internet big data to solve the problems in the background art.
In order to achieve the purpose, the invention provides the following technical scheme:
the information acquisition and arrangement method based on the internet big data comprises the following steps:
when new data are generated at different source ends, a data preprocessing module embedded in the source end writes the new data in a first attribute value of the source end;
the data server captures the new data by using the synchronous data acquisition unit and taking the timestamp as a mark, and transmits the new data to a cache end of the data server;
establishing a plurality of task chains at the cache end of the data server, and establishing a mapping table between the task chains and the source end, so that one source end corresponds to one task chain;
the task chain extracts new data corresponding to a cache end of the data server according to a timestamp, when a new segment of new data is extracted by the task chain, a new record is correspondingly generated and sent to a processing link, the processing link calls the new data in the task chain according to the new record, the new data is filtered in a processing module, the new data with empty content is filtered, then the new data is converted into structured data to form target data, the target data is stored in a data cache layer of a sharing end, a link mark is formed on the sharing end, and the link mark is used for verifying the target data of the data cache layer.
Further, when new data is generated at the source end, a new data generation event is acquired through a trigger built in the source end, the new data generation event triggers a data preprocessing module to call the new data from a database of the source end and read a first attribute value of the source end at the same time, and the data preprocessing module takes the first attribute value of the source end and the time of new data generation as a second attribute value of the new data; meanwhile, the data preprocessing module wakes up the connection between the communication channel and the data server through the synchronous task processing thread.
Furthermore, after the connection between the data server and the communication channel is awakened, the new data with the second attribute value is captured by taking the timestamp as a mark according to the synchronous task processing thread and is transmitted to the cache end of the data server.
Further, the link identifier is used to verify target data of the data cache layer, and specifically includes:
after the link identification starts a check task, target data is inquired according to the link identification and new data generated by the corresponding source end, and a database of the source end and a data cache layer of the sharing end are traversed simultaneously by a method of reading and comparing at the same time to check the consistency of the data link.
The invention also provides an information acquisition and arrangement system based on the internet big data, which comprises the following components:
the method comprises the following steps that a plurality of clients are used as a source end, and when new data are generated at the source end, a data preprocessing module embedded in the source end writes the new data by using a first attribute value of the source end as a reference value for new data attribute writing;
the data server is connected with the client and comprises a plurality of synchronous data collectors and a data server cache end;
the data server cache end is provided with a plurality of task chains established according to the client, a processing link formed based on the task chains and a processing module, and the data server also comprises a sharing end corresponding to the data server cache end;
the data server captures the new data by using a synchronous data acquisition unit and taking a timestamp as a mark, and transmits the new data to a cache end of the data server;
the task chain extracts new data corresponding to the cache end of the data server according to the time stamp, when a new segment of new data is extracted by the task chain, a new record is correspondingly generated and sent to the processing link, the processing link calls the new data in the task chain according to the new record, the new data is filtered and converted in the processing module to form target data, and the target data is stored in the data cache layer of the sharing end.
Furthermore, the processing module is provided with a filtering unit and a conversion unit;
the filtering unit is used for filtering new data with empty content;
the conversion unit is used for converting the new data which is filtered by the filtering unit into structured data to form target data.
Further, after target data are stored, the sharing end forms a link identifier based on the target data, and the link identifier is used for verifying the target data of the data cache layer.
Furthermore, the data preprocessing module calls the new data from the database of the client and reads the first attribute value of the source end at the same time, and the data preprocessing module takes the first attribute value of the source end and the time generated by the new data as the second attribute value of the new data; meanwhile, the data preprocessing module wakes up the connection between the communication channel and the data server through the synchronous task processing thread.
Furthermore, the data server captures the new data with the second attribute value by taking the timestamp as a mark according to the synchronous task processing thread and transmits the captured new data to the cache end of the data server.
Further, the link identifier is used for querying the target data according to the link identifier and the new data generated by the corresponding source end, and the database of the source end and the data cache layer of the sharing end are traversed simultaneously by a method of reading and comparing at the same time to check the consistency of the data link.
When different clients generate new data, the new data is marked so as to be convenient for tracing, in the whole process, a task chain can also form a corresponding new record when extracting the new data, a processing link calls the new data in the task chain according to the new record, the new data is filtered and converted in a processing module to form target data and the target data is stored in a data cache layer of a sharing end, a corresponding link identification is generated, the link identification is used for inquiring the target data according to the link identification and the corresponding new data generated by the source end, and a method for reading and comparing is used for traversing a database of the source end and the data cache layer of the sharing end simultaneously to carry out data link consistency check.
In the above, when new data is generated at the source end, a new data generation event is acquired through a trigger built in the source end, the new data generation event triggers a data preprocessing module to retrieve the new data from a database of the source end and simultaneously read a first attribute value of the source end, the data preprocessing module takes the first attribute value of the source end and the time of new data generation as a second attribute value of the new data, and meanwhile, the data preprocessing module wakes up connection between a communication channel and a data server through a synchronous task processing thread. Therefore, the invention can automatically capture data, and uniformly arrange and store the data only by linking and communicating the client and the data server, thereby facilitating the back-end analysis to capture the data.
In the above, the big data information collecting and sorting system provided by the invention does not need human intervention, and the new data can be captured by the synchronous data collector with the timestamp as a mark and transmitted to the data server cache end, so as to obtain real-time data and analyze timeliness of data use.
In the above, the target data can be traced, and all the target data are cached and stored in a shared manner, so that the storage capacity is strong, the modification at any time is supported, and the demand response to the data change is more timely and has global flexibility.
Drawings
FIG. 1 is a schematic diagram of the framework of the present invention;
fig. 2 is a schematic diagram of a framework in an embodiment of the invention.
Detailed Description
The present invention is described in detail below with reference to the accompanying drawings, which refer to fig. 1 to 2.
The invention provides an information acquisition and arrangement method based on internet big data, which specifically comprises the following steps:
when the source end has new data generation, a data preprocessing module embedded in the source end writes the new data by using a first attribute value of the source end; specifically, when new data is generated at the source end, a new data generation event is acquired through a trigger built in the source end, the new data generation event triggers a data preprocessing module to call the new data from a database of the source end and read a first attribute value of the source end at the same time, and the data preprocessing module takes the first attribute value of the source end and the time of new data generation as a second attribute value of the new data; meanwhile, the data preprocessing module wakes up the connection between the communication channel and the data server through a synchronous task processing thread;
and when the connection between the data server and the communication channel is awakened, capturing the new data with the second attribute value by taking the timestamp as a mark according to the synchronous task processing thread, and transmitting the captured new data to a cache end of the data server.
Establishing a plurality of task chains at the cache end of the data server, and establishing a mapping table between the task chains and the source end, so that one source end corresponds to one task chain;
the method includes the steps that a task chain extracts new data corresponding to a cache end of a data server according to a timestamp, when each new data is extracted by the task chain, a new record is correspondingly generated and sent to a processing link, the processing link calls the new data in the task chain according to the new record, the new data is filtered in a processing module, the new data with empty content is filtered, then the new data is converted into structured data to form target data, the target data is stored in a data cache layer of a sharing end, a link mark is formed on the sharing end, and the link mark is used for verifying the target data of the data cache layer, and specifically includes the following steps:
after the link identification starts a check task, target data is inquired according to the link identification and new data generated by the corresponding source end, and a database of the source end and a data cache layer of the sharing end are traversed simultaneously by a method of reading and comparing at the same time to check the consistency of the data link.
In order to facilitate the implementation of the method, the application provides an information acquisition and arrangement system based on internet big data, which comprises the following steps:
the method comprises the following steps that a plurality of clients are used as a source end, and when new data are generated at the source end, a data preprocessing module embedded in the source end writes the new data by using a first attribute value of the source end as a reference value for new data attribute writing; specifically, the data preprocessing module calls the new data from the database of the client and reads a first attribute value of the source end at the same time, and the data preprocessing module takes the first attribute value of the source end and the time generated by the new data as a second attribute value of the new data; meanwhile, the data preprocessing module wakes up the connection between the communication channel and the data server through the synchronous task processing thread.
In the above, when new data is generated at the source end, a new data generation event is acquired through a trigger built in the source end, the new data generation event triggers a data preprocessing module to retrieve the new data from a database of the source end and simultaneously read a first attribute value of the source end, the data preprocessing module takes the first attribute value of the source end and the time of new data generation as a second attribute value of the new data, and meanwhile, the data preprocessing module wakes up connection between a communication channel and a data server through a synchronous task processing thread. Therefore, the invention can automatically capture data, and uniformly arrange and store the data only by linking and communicating the client and the data server, thereby facilitating the back-end analysis to capture the data.
The data server is connected with the client and comprises a plurality of synchronous data collectors and a data server cache end; specifically, the data server captures the new data with the second attribute value by using the timestamp as a mark according to the synchronous task processing thread and transmits the captured new data to the cache end of the data server. The big data information acquisition and arrangement system provided by the invention does not need human intervention, and can capture the new data by taking the timestamp as a mark through the synchronous data acquisition unit and transmit the captured new data to the cache end of the data server so as to acquire real-time data and analyze the timeliness of data use.
In the above, the data server cache end has a plurality of task chains established according to the client, a processing link formed based on the task chains, and a processing module, and the data server further includes a sharing end corresponding to the data server cache end;
the data server captures the new data by using a synchronous data acquisition unit and taking a timestamp as a mark, and transmits the new data to a cache end of the data server;
the task chain extracts new data corresponding to the cache end of the data server according to the time stamp, when a new segment of new data is extracted by the task chain, a new record is correspondingly generated and sent to the processing link, the processing link calls the new data in the task chain according to the new record, the new data is filtered and converted in the processing module to form target data, and the target data is stored in the data cache layer of the sharing end.
In the above, the processing module has a filtering unit and a converting unit;
the filtering unit is used for filtering new data with empty content;
the conversion unit is used for converting the new data which is filtered by the filtering unit into structured data to form target data.
In the above, after the target data is stored, the sharing end forms a link identifier based on the target data, and the link identifier is used for verifying the target data of the data cache layer. When different clients generate new data, the new data is marked so as to be convenient for tracing, in the whole process, a task chain can also form a corresponding new record when extracting the new data, a processing link calls the new data in the task chain according to the new record, the new data is filtered and converted in a processing module to form target data and the target data is stored in a data cache layer of a sharing end, a corresponding link identification is generated, the link identification is used for inquiring the target data according to the link identification and the corresponding new data generated by the source end, and a method for reading and comparing is used for traversing a database of the source end and the data cache layer of the sharing end simultaneously to carry out data link consistency check.
Through the data link consistency check, the target data can be traced, all the target data are cached and stored in a sharing mode, the storage capacity is strong, the data can be modified at any time, the data change demand response is timely, and the global flexibility is realized.
The specific principle is as follows: the invention provides an information acquisition and arrangement system based on internet big data, which needs to be built before the system works.
At least two or more client sides are arranged, a source end data acquisition end is embedded in each client side, and a data preprocessing module is embedded in the source end data acquisition end;
setting a data server, configuring the data server to have a data server cache end and a shared cache end, and then establishing communication connection between the client and the data server.
The communication connection between the client and the data server adopts a communication wake-up and use mode; namely, the data preprocessing module wakes up the connection between the communication channel and the data server through the synchronous task processing thread.
After the construction is completed, when new data is generated at the source end, the data preprocessing module embedded in the source end writes the new data into the source end according to the first attribute value of the source end; specifically, when new data is generated at the source end, a new data generation event is acquired through a trigger built in the source end, the new data generation event triggers a data preprocessing module to call the new data from a database of the source end and read a first attribute value of the source end at the same time, and the data preprocessing module takes the first attribute value of the source end and the time of new data generation as a second attribute value of the new data; meanwhile, the data preprocessing module wakes up the connection between the communication channel and the data server through a synchronous task processing thread;
and when the connection between the data server and the communication channel is awakened, capturing the new data with the second attribute value by taking the timestamp as a mark according to the synchronous task processing thread, and transmitting the captured new data to a cache end of the data server.
Establishing a plurality of task chains at the cache end of the data server, and establishing a mapping table between the task chains and the source end, so that one source end corresponds to one task chain;
the method includes the steps that a task chain extracts new data corresponding to a cache end of a data server according to a timestamp, when each new data is extracted by the task chain, a new record is correspondingly generated and sent to a processing link, the processing link calls the new data in the task chain according to the new record, the new data is filtered in a processing module, the new data with empty content is filtered, then the new data is converted into structured data to form target data, the target data is stored in a data cache layer of a sharing end, a link mark is formed on the sharing end, and the link mark is used for verifying the target data of the data cache layer, and specifically includes the following steps:
after the link identification starts a check task, target data is inquired according to the link identification and new data generated by the corresponding source end, and a database of the source end and a data cache layer of the sharing end are traversed simultaneously by a method of reading and comparing at the same time to check the consistency of the data link.
The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts of the present invention. The foregoing is only a preferred embodiment of the present invention, and it should be noted that there are objectively infinite specific structures due to the limited character expressions, and it will be apparent to those skilled in the art that a plurality of modifications, decorations or changes may be made without departing from the principle of the present invention, and the technical features described above may be combined in a suitable manner; such modifications, variations, combinations, or adaptations of the invention using its spirit and scope, as defined by the claims, may be directed to other uses and embodiments.
Claims (10)
1. The information acquisition and arrangement method based on the internet big data is characterized by comprising the following steps:
when new data are generated at different source ends, a data preprocessing module embedded in the source end writes the new data in a first attribute value of the source end;
the data server captures the new data by using the synchronous data acquisition unit and taking the timestamp as a mark, and transmits the new data to a cache end of the data server;
establishing a plurality of task chains at the cache end of the data server, and establishing a mapping table between the task chains and the source end, so that one source end corresponds to one task chain;
the task chain extracts new data corresponding to a cache end of the data server according to a timestamp, when a new segment of new data is extracted by the task chain, a new record is correspondingly generated and sent to a processing link, the processing link calls the new data in the task chain according to the new record, the new data is filtered in a processing module, the new data with empty content is filtered, then the new data is converted into structured data to form target data, the target data is stored in a data cache layer of a sharing end, a link mark is formed on the sharing end, and the link mark is used for verifying the target data of the data cache layer.
2. The method for collecting and arranging information based on internet big data according to claim 1, wherein when new data is generated at the source end, a new data generation event is obtained through a trigger built in the source end, the new data generation event triggers a data preprocessing module to call the new data from a database of the source end and read a first attribute value of the source end at the same time, and the data preprocessing module takes the first attribute value of the source end and the time of generating the new data as a second attribute value of the new data; meanwhile, the data preprocessing module wakes up the connection between the communication channel and the data server through the synchronous task processing thread.
3. The method for collecting and organizing information based on internet big data according to claim 1 or 2, wherein after the connection between the data server and the communication channel is awakened, the new data with the second attribute value is captured by taking a timestamp as a mark according to a synchronous task processing thread and is transmitted to a cache end of the data server.
4. The method for collecting and organizing information based on internet big data according to claim 1, wherein the link identifier is used for verifying target data of a data cache layer, and specifically comprises:
after the link identification starts a check task, target data is inquired according to the link identification and new data generated by the corresponding source end, and a database of the source end and a data cache layer of the sharing end are traversed simultaneously by a method of reading and comparing at the same time to check the consistency of the data link.
5. Information acquisition arrangement system based on internet big data, its characterized in that includes:
the method comprises the following steps that a plurality of clients are used as a source end, and when new data are generated at the source end, a data preprocessing module embedded in the source end writes the new data by using a first attribute value of the source end as a reference value for new data attribute writing;
the data server is connected with the client and comprises a plurality of synchronous data collectors and a data server cache end;
the data server cache end is provided with a plurality of task chains established according to the client, a processing link formed based on the task chains and a processing module, and the data server also comprises a sharing end corresponding to the data server cache end;
the data server captures the new data by using a synchronous data acquisition unit and taking a timestamp as a mark, and transmits the new data to a cache end of the data server;
the task chain extracts new data corresponding to the cache end of the data server according to the time stamp, when a new segment of new data is extracted by the task chain, a new record is correspondingly generated and sent to the processing link, the processing link calls the new data in the task chain according to the new record, the new data is filtered and converted in the processing module to form target data, and the target data is stored in the data cache layer of the sharing end.
6. The internet big data based information acquisition and arrangement system according to claim 5, wherein the processing module has a filtering unit and a converting unit;
the filtering unit is used for filtering new data with empty content;
the conversion unit is used for converting the new data which is filtered by the filtering unit into structured data to form target data.
7. The system as claimed in claim 5, wherein the sharing end forms a link identifier based on the target data after the target data is stored, and the link identifier is used for verifying the target data of the data caching layer.
8. The system according to claim 5, wherein the data preprocessing module retrieves the new data from the database of the client and reads the first attribute value of the source, and the data preprocessing module takes the first attribute value of the source and the time of the new data generation as the second attribute value of the new data; meanwhile, the data preprocessing module wakes up the connection between the communication channel and the data server through the synchronous task processing thread.
9. The system for collecting and organizing information based on internet big data according to claim 5, wherein the data server captures the new data with the second attribute value by taking a timestamp as a mark according to a synchronous task processing thread and transmits the new data to a data server cache.
10. The system of claim 7, wherein the link identifier is configured to query target data according to the link identifier and new data generated by the source end, and perform data link consistency check by traversing a database of the source end and a data cache layer of the sharing end simultaneously by a method of reading and comparing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210062901.8A CN114079668B (en) | 2022-01-20 | 2022-01-20 | Information acquisition and arrangement method and system based on internet big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210062901.8A CN114079668B (en) | 2022-01-20 | 2022-01-20 | Information acquisition and arrangement method and system based on internet big data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114079668A true CN114079668A (en) | 2022-02-22 |
| CN114079668B CN114079668B (en) | 2022-04-08 |
Family
ID=80284724
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210062901.8A Active CN114079668B (en) | 2022-01-20 | 2022-01-20 | Information acquisition and arrangement method and system based on internet big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114079668B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645928A (en) * | 2009-08-26 | 2010-02-10 | 成都市华为赛门铁克科技有限公司 | Content resource caching method, device and system |
| US20100138612A1 (en) * | 2007-08-01 | 2010-06-03 | Hangzhou H3C Technologies Co., Ltd. | System and method for implementing cache sharing |
| US20170116581A1 (en) * | 2015-10-26 | 2017-04-27 | Ajit S. Shah | Systems and methods for implementing structured asynchronous and synchronous group interaction with automatic assistance over user selected media |
| CN106776780A (en) * | 2016-11-23 | 2017-05-31 | 中国科学院软件研究所 | Data exchange and shared method and system in a kind of cloud environment |
| WO2017193739A1 (en) * | 2016-05-10 | 2017-11-16 | 中兴通讯股份有限公司 | Data sharing method and apparatus |
| CN111198914A (en) * | 2019-12-12 | 2020-05-26 | 山西云时代技术有限公司 | Whole database real-time data acquisition method based on oracle database filing log |
| WO2021055078A1 (en) * | 2019-09-16 | 2021-03-25 | Oracle International Corporation | Applying rules to client updates on shared records to trigger system-generated updates |
| CN113742357A (en) * | 2021-08-25 | 2021-12-03 | 国核电力规划设计研究院有限公司 | Method and system for automatically collecting and associating cross-platform design data |
-
2022
- 2022-01-20 CN CN202210062901.8A patent/CN114079668B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100138612A1 (en) * | 2007-08-01 | 2010-06-03 | Hangzhou H3C Technologies Co., Ltd. | System and method for implementing cache sharing |
| CN101645928A (en) * | 2009-08-26 | 2010-02-10 | 成都市华为赛门铁克科技有限公司 | Content resource caching method, device and system |
| US20170116581A1 (en) * | 2015-10-26 | 2017-04-27 | Ajit S. Shah | Systems and methods for implementing structured asynchronous and synchronous group interaction with automatic assistance over user selected media |
| WO2017193739A1 (en) * | 2016-05-10 | 2017-11-16 | 中兴通讯股份有限公司 | Data sharing method and apparatus |
| CN106776780A (en) * | 2016-11-23 | 2017-05-31 | 中国科学院软件研究所 | Data exchange and shared method and system in a kind of cloud environment |
| WO2021055078A1 (en) * | 2019-09-16 | 2021-03-25 | Oracle International Corporation | Applying rules to client updates on shared records to trigger system-generated updates |
| CN111198914A (en) * | 2019-12-12 | 2020-05-26 | 山西云时代技术有限公司 | Whole database real-time data acquisition method based on oracle database filing log |
| CN113742357A (en) * | 2021-08-25 | 2021-12-03 | 国核电力规划设计研究院有限公司 | Method and system for automatically collecting and associating cross-platform design data |
Non-Patent Citations (2)
| Title |
|---|
| JIAHUI LV等: "Application on Information Island with Information Visualization and Software Engineering", 《2018 5TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI)》 * |
| 王天亮等: "基于共享数据库的数据共享技术", 《计算机工程与设计》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114079668B (en) | 2022-04-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108052681B (en) | Method and system for synchronizing structured data between relational databases | |
| CN103914485A (en) | System and method for remotely collecting, retrieving and displaying application system logs | |
| CN102637214B (en) | Method and system for synchronizing general data among database services | |
| CN105824744A (en) | Real-time log collection and analysis method on basis of B2B (Business to Business) platform | |
| CN103455896B (en) | With no paper assembling Quality Control method based on Internet of Things | |
| CN110968629A (en) | Cross-hierarchy heterogeneous data aggregation-based unified information resource management method and system | |
| CN102880790B (en) | Based on standardization job on-the-spot system and the work flow of PDA pattern | |
| CN115269515B (en) | Processing method for searching specified target document data | |
| CN112559634A (en) | Big data management system based on computer cloud computing | |
| CN114238388A (en) | Heterogeneous data collection and retrieval system based on multiple protocols | |
| CN104506624A (en) | Socializing information management system and management method | |
| CN104361128A (en) | Data synchronization method of PC (Personnel Computer) end and mobile terminal based on hydraulic polling business | |
| CN114079668B (en) | Information acquisition and arrangement method and system based on internet big data | |
| CN112598142A (en) | Wind turbine generator overhaul work quality examination assisting method and system | |
| CN116644136A (en) | Data acquisition method, device, equipment and medium for increment and full data | |
| CN114820000A (en) | Intelligent product traceability management system | |
| CN114003774A (en) | A big data information collection system of electric power for wisdom city | |
| CN109165203A (en) | Large public building energy consumption data based on Hadoop framework stores analysis method | |
| CN106855877A (en) | A kind of synchronous method for replicating of big data | |
| CN112653768B (en) | Social server-end-simulating structure | |
| CN111274885A (en) | Market customer trajectory tracking and information acquisition system based on face recognition technology | |
| CN112306992A (en) | Big data platform based on internet | |
| CN112699977B (en) | Intelligent acquisition system and acquisition method for handwriting records of railway vehicle | |
| CN110515955A (en) | Storage, querying method, system, electronic equipment and the storage medium of data | |
| CN116644039B (en) | Automatic acquisition and analysis method for online capacity operation log based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |