CN107562790B - Method and system for realizing batch warehousing of data processing - Google Patents

Method and system for realizing batch warehousing of data processing Download PDF

Info

Publication number
CN107562790B
CN107562790B CN201710641234.8A CN201710641234A CN107562790B CN 107562790 B CN107562790 B CN 107562790B CN 201710641234 A CN201710641234 A CN 201710641234A CN 107562790 B CN107562790 B CN 107562790B
Authority
CN
China
Prior art keywords
data
sql script
memory
data processing
computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710641234.8A
Other languages
Chinese (zh)
Other versions
CN107562790A (en
Inventor
拜山峰
高林武
毕永东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Linkdood Technologies SdnBhd
Original Assignee
Linkdood Technologies SdnBhd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Linkdood Technologies SdnBhd filed Critical Linkdood Technologies SdnBhd
Priority to CN201710641234.8A priority Critical patent/CN107562790B/en
Publication of CN107562790A publication Critical patent/CN107562790A/en
Application granted granted Critical
Publication of CN107562790B publication Critical patent/CN107562790B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method for realizing batch warehousing of data processing, which comprises the following steps: starting a data processing service, and then analyzing and storing the SQL script into a memory; configuring the analyzed SQL script according to the interface form; classifying data in the requests according to interface forms; pushing the classified data into a queue; matching the configured SQL script with data; and splicing the data with the same interface form with the configured SQL script. The method of the invention solves the problem that the number of the concurrent requests of the server is too high, so that the throughput of the server for processing the data is increased, and the problems of abnormal interruption and unsafe data processing of the concurrent data processing of the server are solved.

Description

Method and system for realizing batch warehousing of data processing
Technical Field
The present invention relates to the field of database storage, and more particularly, to a method and system for processing data and performing batch storage.
Background
In modern information systems, a large amount of data is often required to be stored in a centralized manner according to actual business needs, and a database system is an application system capable of achieving the purpose. A database is a repository built on computer storage devices that organizes, stores, and manages data according to a data structure. In short, the user can be regarded as an electronic file cabinet, namely a place for storing electronic files, and can add, intercept, update, delete and the like to the data in the files.
In the prior art, the data collection and writing into the database usually adopt a synchronization mode, and the problem and the disadvantage of the mode of realizing data synchronization at the database level are as follows:
1. if the data is in a high concurrency condition, data loss can be caused by inconsistent reading and writing (fast reading and slow writing);
2. and data is synchronously inserted, an interface can return only after the data is processed, and the system has slow response, low throughput and low concurrency.
Disclosure of Invention
In view of this, an object of the embodiments of the present invention is to provide a method and a system for implementing batch warehousing of data processing, which can solve the problem that the number of concurrent requests of a server interface is too high, increase the throughput of data processing of the server, and solve the problems of abnormal interruption and unsafe data processing of concurrent data processing of the server.
Based on the above purpose, an aspect of the embodiments of the present invention provides a method for implementing batch warehousing of data processing, where the method includes the following steps:
starting a data processing service, and then analyzing and storing the SQL script into a memory;
configuring the analyzed SQL script according to the interface form;
classifying data in the plurality of requests according to the interface forms;
pushing the classified data into a queue;
matching the configured SQL script with the data; and
and splicing the data with the same interface form with the configured SQL script.
In some embodiments, the SQL script is parsed with an asynchronous thread.
In some embodiments, the SQL script is parsed into SqlElement objects and the SqlElement objects are stored in memory.
In some embodiments, each interface type corresponds to a reporting structure of service data.
In some embodiments, the data pushed into the queue is polled and parsed, and the configured SQL script is matched with the data according to the interface form.
In some embodiments, the data with the same interface morphology is spliced into one SQL statement for storage.
On the other hand, the embodiment of the invention also provides a system for realizing batch warehousing of data processing, and the system executes the method.
In another aspect of the embodiments of the present invention, there is also provided a computer device, including a memory, at least one processor, and a computer program stored on the memory and executable on the processor, where the processor executes the program to perform the method.
In another aspect of the embodiments of the present invention, a computer-readable storage medium is further provided, which stores a computer program, and when the computer program is executed by a processor, the computer program performs the above method.
In another aspect of the embodiments of the present invention, there is also provided a computer program product including a computer program stored on a computer-readable storage medium, the computer program including instructions which, when executed by a computer, cause the computer to perform the above method.
The invention has the following beneficial technical effects: according to the method and the system for realizing data processing batch warehousing provided by the embodiment of the invention, by using the technical scheme that the data are spliced into one SQL statement warehouse in a batch processing mode, the data can be warehoused in batch under the condition of high concurrent requests, the throughput of the server side for processing the data is increased, and the problems of abnormal interruption and unsafe data processing in the concurrent data processing of the server side can be solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic flow diagram of a method according to one embodiment of the present invention;
FIG. 2 is a flow diagram of a high concurrent asynchronous processing of data warehousing according to one embodiment of the present invention;
FIG. 3 is a system design architecture diagram according to one embodiment of the present invention;
fig. 4 is a schematic hardware structure diagram of an embodiment of a computer device for executing the method provided by the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it is understood that "first" and "second" are only used for convenience of description and should not be construed as limiting the embodiments of the present invention, and the descriptions thereof in the following embodiments are omitted.
Based on the above object, a first aspect of the embodiments of the present invention provides an embodiment of a method for implementing batch warehousing of data processing, which can solve the problem that the number of concurrent requests of a server interface is too high, so that the throughput of processing data by the server is increased, and can solve the problems of abnormal interruption of processing concurrent data and unsafe data processing by the server. FIG. 1 shows a flow diagram of a method according to an embodiment of the invention.
The method may comprise the steps of:
step S101, starting data processing service, and then analyzing and storing the SQL script into a memory. It should be noted that, when each service of the client is processed, it is first ensured that the data processing service of the server is normally started, and then the data can be reported, and then the SQL script corresponding to each type of product can be analyzed and stored in the memory by the SqlElement object. Wherein, preferably, the SQL script is analyzed by adopting an asynchronous thread. The structure of the SQL script is as follows:
Figure BDA0001365948930000041
step S102, configuring the parsed SQL script according to the interface forms, wherein each interface form corresponds to a reporting structure of the service data. The SQL script corresponding to the interface form is configured to classify each type of interface, the internal configuration of the SQL script is consistent with the interface transmission parameter, and the service logic of the type of interface is attached. The interface morphology is shown in the following table:
Figure 2
step S103, classifying the data in the plurality of requests according to the interface form, and it should be noted that, when the number of concurrent requests of the server is higher, the server may forward the request to a data processing server that processes fewer concurrent tasks at the time through the TCP service and the UDP service.
And step S104, pressing the classified data into a queue, wherein preferably, after the data reported by the client is checked, the data is pressed into the queue through LinkedBlockingQueue < String [ ] >, and polling is performed when the data is matched with the SQL script.
And S105, matching the configured SQL script with data, wherein preferably, polling analysis is carried out on the data pressed into the queue, the configured SQL script is matched with the request data according to an agreed MaxCode (for example, 00FF0A00) and MinCode (for example, 00016004), and after matching, the SQL statement starts to be spliced through an existing SqlElement object in the memory.
And step S106, splicing the data with the same interface form with the configured SQL script. And after the interface form of the reported data is matched with the SQL script, splicing the data and the SQL script. The concatenated SQL statements are, for example, insert to table names (column1, column 2..) values (value1, value 2.), (value3, value 4.).
It can be seen from the foregoing embodiments that, the method for implementing data processing batch warehousing provided in the embodiments of the present invention optimizes the problem of synchronous data warehousing processing of each previous frame, and by using a technical scheme of batching and splicing data into one SQL statement for warehousing in a batch processing manner, the method can implement data batch warehousing under the condition of high concurrent requests, increase the throughput of data processing of the server, and solve the problems of abnormal interruption and unsafe data processing of concurrent data processing of the server.
Fig. 2 is a schematic flow chart of high-concurrency asynchronous processing of data warehousing according to an embodiment of the present invention.
Firstly, the server receives the client request data and checks the correctness of the data, and then returns the client information. And (3) pushing the high-concurrency request data into the queue by using LinkedBlockingqueue < String [ ] >, preferably, the internal structure of the queue is MaxCode, MinCode and specifically reported JSON data, the JSON data comprises verification of the JSON format of the reported data, and if the verification is passed, asynchronously returning a client data verification result.
Then, a corresponding Event node is generated and added to the SQL script, as follows:
Figure BDA0001365948930000061
next, the polling of the data of the queue is started, and the SQL statement is spliced. Detecting data pushed into a queue, matching the data pushed into the queue to a corresponding SqlElement object through MaxCode + MinCode after polling, respectively comparing key and value of srcData with key and value of the SqlElement object, and splicing the field to a position corresponding to the field to be inserted into the insertion statement if the two values are the same, for example: insert to tableNAme (k1, k2, k3 …) values (v1, v2, v3 …), (v2-1, v2-2, v3-3 …). And at this moment, asynchronously processing the client request data, and executing SQL to achieve the concurrent insertion effect after the SQL sentence is perfectly spliced.
Based on the above object, a second aspect of the embodiments of the present invention provides an embodiment of a system for implementing batch warehousing of data processing, which can solve the problem that the number of concurrent requests of a server interface is too high, so that the throughput of processing data by the server is increased, and can solve the problems of abnormal interruption of processing concurrent data and unsafe data processing by the server. The system performs the method described above.
The system for realizing data processing batch warehousing provided by the embodiment of the invention optimizes the problem of synchronous data warehousing processing of each frame in the past, and can realize data batch warehousing under the condition of high concurrent requests by using the technical scheme of splicing data into one SQL statement warehouse in a batch processing mode, so that the throughput of data processing of a server is increased, and the problems of abnormal interruption and unsafe data processing of concurrent data processing of the server can be solved.
It should be particularly noted that the embodiment of the system described above employs the embodiment of the method described above to specifically describe the working process of each module, and those skilled in the art can easily think that these modules are applied to other embodiments of the method.
FIG. 3 is a block diagram of a system design architecture according to one embodiment of the present invention.
An example architecture of the system of the present invention may be divided into a primary service area and a proxy service area. Wherein the primary service area may include: authorization services, address services, configuration services, caching services, and the like. The proxy service area mainly comprises a primary service, a forwarding service and a secondary service. The primary service may include a service upgrade service, an operation and maintenance monitoring service, and the like. The forwarding service may include a TCP forwarding service and a UDP forwarding service. The secondary services may include 28 types of services such as policy distribution services, data processing services, client upgrade services, patch services, blocking services, scanning services, peer-to-peer services, and the like. The data processing service is mainly used for verifying and warehousing data reported by the client. Under the condition that the concurrency ratio of the server side is higher, the server side can forward the request to the data processing server side which processes the concurrent tasks less at the moment through the TCP forwarding service and the UDP forwarding service.
In view of the above object, a third aspect of the embodiments of the present invention proposes an embodiment of a computer apparatus for performing the method.
The computer device comprises a memory, at least one processor and a computer program stored on the memory and executable on the processor, the processor executing any of the above methods when the program is executed.
Fig. 4 is a schematic hardware structure diagram of an embodiment of a computer device for executing the method according to the present invention.
Taking the computer device shown in fig. 4 as an example, the computer device includes a processor 401 and a memory 402, and may further include: an input device 403 and an output device 404.
The processor 401, the memory 402, the input device 403 and the output device 404 may be connected by a bus or other means, and fig. 4 illustrates an example of a connection by a bus.
The memory 402, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules corresponding to the methods described in the embodiments of the present application. The processor 401 executes various functional applications and data processing of the server by running the nonvolatile software programs, instructions and modules stored in the memory 402, that is, the method for realizing batch warehousing of data processing of the above-described method embodiments is realized.
The memory 402 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of a system that implements data processing batch warehousing, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 402 may optionally include memory located remotely from processor 401, which may be connected to local modules via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 403 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the system. The output device 404 may include a display device such as a display screen.
Program instructions/modules corresponding to the methods are stored in the memory 402 and when executed by the processor 401, perform the methods of any of the method embodiments described above.
Any embodiment of the computer device may achieve the same or similar effects as any corresponding method embodiment described above.
In view of the above object, a fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, where computer-executable instructions are stored, and the computer-executable instructions can execute the method in any of the above method embodiments and the system implementing any of the above system embodiments. Embodiments of the computer-readable storage medium may achieve the same or similar effects of any of the aforementioned method and system embodiments corresponding thereto.
In view of the above object, a fifth aspect of the embodiments of the present invention proposes a computer program product, which includes a computer program stored on a computer-readable storage medium, the computer program including instructions that, when executed by a computer, cause the computer to perform the method in any of the method embodiments described above and to implement the system in any of the system embodiments described above. Embodiments of the computer program product may achieve the same or similar effects as any of the aforementioned method and system embodiments corresponding thereto.
Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like. Embodiments of the computer program may achieve the same or similar effects as any of the preceding method embodiments to which it corresponds.
In addition, the systems, devices and the like disclosed in the embodiments of the present invention may be various electronic terminal devices, such as a mobile phone, a Personal Digital Assistant (PDA), a tablet computer (PAD), a smart television and the like, or may be large terminal devices, such as a server and the like, and therefore the scope of protection disclosed in the embodiments of the present invention should not be limited to a specific type of system, device.
Furthermore, the method disclosed according to an embodiment of the present invention may also be implemented as a computer program executed by a CPU, and the computer program may be stored in a computer-readable storage medium. The computer program, when executed by the CPU, performs the above-described functions defined in the method disclosed in the embodiments of the present invention.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) described herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.
The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions described herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP, and/or any other such configuration.
The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.
In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a," "an," "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of an embodiment of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.

Claims (9)

1. A method for realizing data processing batch warehousing is characterized by comprising the following steps:
starting a data processing service, and then analyzing and storing the SQL script into a memory;
configuring the analyzed SQL script according to the interface form;
classifying data in the plurality of requests according to the interface forms;
pushing the classified data into a queue;
matching the configured SQL script with the data; and
and splicing the data with the same interface form with the configured SQL script.
2. The method of claim 1, wherein the SQL script is parsed using asynchronous threads.
3. The method of claim 1, wherein the SQL script is parsed into SqlElement objects and the SqlElement objects are stored in memory.
4. The method of claim 1, wherein each interface type corresponds to a reporting structure of service data.
5. The method of claim 1, wherein the data pushed into the queue is polled and the configured SQL script is matched to the data according to the interface modality.
6. The method of claim 1, wherein the data with the same interface morphology is merged into one SQL statement.
7. A system for implementing data processing batch warehousing, characterized by performing the method of any one of claims 1-6.
8. A computer device comprising a memory, at least one processor and a computer program stored on the memory and executable on the processor, characterized in that the processor performs the method according to any of claims 1-6 when executing the program.
9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-6.
CN201710641234.8A 2017-07-31 2017-07-31 Method and system for realizing batch warehousing of data processing Active CN107562790B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710641234.8A CN107562790B (en) 2017-07-31 2017-07-31 Method and system for realizing batch warehousing of data processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710641234.8A CN107562790B (en) 2017-07-31 2017-07-31 Method and system for realizing batch warehousing of data processing

Publications (2)

Publication Number Publication Date
CN107562790A CN107562790A (en) 2018-01-09
CN107562790B true CN107562790B (en) 2020-05-01

Family

ID=60974720

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710641234.8A Active CN107562790B (en) 2017-07-31 2017-07-31 Method and system for realizing batch warehousing of data processing

Country Status (1)

Country Link
CN (1) CN107562790B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110580185B (en) * 2018-06-07 2023-10-31 中兴通讯股份有限公司 Data preprocessing method, device and storage medium
CN111831379B (en) * 2020-07-15 2023-06-30 中车大连机车车辆有限公司 Online dynamic data batch processing and displaying method and vehicle-mounted display screen device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412972A (en) * 2013-07-01 2013-11-27 北京理工大学 Method for packaging and integrating simulation models of distributed simulation platform of aircraft
CN104158757A (en) * 2014-08-21 2014-11-19 福建星海通信科技有限公司 GPS (Global Positioning System) data loading and processing method and system
CN105930511A (en) * 2016-05-12 2016-09-07 深圳市傲天科技股份有限公司 Answer big data subscription platform

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7089266B2 (en) * 2003-06-02 2006-08-08 The Board Of Trustees Of The Leland Stanford Jr. University Computer systems and methods for the query and visualization of multidimensional databases
CN102945256B (en) * 2012-10-18 2016-02-03 福建省海峡信息技术有限公司 Magnanimity SQL statement merges the method and device sorted out
CN103116595B (en) * 2012-10-24 2016-08-10 中国电力科学研究院 Implementation method towards the SCADA historical data distributed storage of electrical network
CN106294423A (en) * 2015-05-25 2017-01-04 阿里巴巴集团控股有限公司 Data base divides wiring method and the device of table
CN105205122A (en) * 2015-09-11 2015-12-30 烽火通信科技股份有限公司 Telecommunication service retrieval method based on data synchronization
CN105740344A (en) * 2016-01-25 2016-07-06 中国科学院计算技术研究所 Sql statement combination method and system independent of database

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412972A (en) * 2013-07-01 2013-11-27 北京理工大学 Method for packaging and integrating simulation models of distributed simulation platform of aircraft
CN104158757A (en) * 2014-08-21 2014-11-19 福建星海通信科技有限公司 GPS (Global Positioning System) data loading and processing method and system
CN105930511A (en) * 2016-05-12 2016-09-07 深圳市傲天科技股份有限公司 Answer big data subscription platform

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于SOA的企业管理信息系统的设计;张锐;《中国优秀硕士学位论文全文数据库信息科技辑》;20110415(第04期);I138-574 *

Also Published As

Publication number Publication date
CN107562790A (en) 2018-01-09

Similar Documents

Publication Publication Date Title
US10579831B2 (en) Verification of data set components using digitally signed probabilistic data structures
EP3915017B1 (en) Aggregation analysis and remediation of data invalidations
US11714812B2 (en) System for augmenting and joining multi-cadence datasets
US20190372880A1 (en) Deserialization service
US11983169B2 (en) Optimization of database write operations by combining and parallelizing operations based on a hash value of primary keys
WO2019014598A1 (en) Citation and attribution management methods and systems
CN107562790B (en) Method and system for realizing batch warehousing of data processing
CN110647423B (en) Method, device and readable medium for creating storage volume mirror image based on application
CN111563199A (en) Data processing method and device
CN111309264B (en) Method, system, device and medium for making directory quota compatible with snapshot
CN113157480A (en) Error information processing method, device, storage medium and terminal
RU2677563C2 (en) Information display method, terminal and server
CN110780855A (en) Method, device and system for uniformly managing and controlling interface
CN110569089A (en) Plug-in expansion method, device and storage medium for management platform
CN111723007B (en) Test case merging method, system, equipment and medium
US10452637B1 (en) Migration of mutable data sets between data stores
CN110688355A (en) Method and device for changing container state
US11663211B2 (en) Data retrieval systems and methods
CN109067726B (en) Identification method and device for station building system, electronic equipment and storage medium
CN110601905A (en) Fault detection method and device
CN111339184A (en) Hive synchronization method, system, equipment and medium
CN111090432A (en) Interface processing method and device and electronic equipment
US20170374129A1 (en) Sending and requesting feed
CN111382130A (en) Content submission method and device and electronic equipment
TWI816875B (en) Data synchronous query method, device, computer device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant