CN112256709A - Data reading method, system and equipment under special machine system - Google Patents
Data reading method, system and equipment under special machine system Download PDFInfo
- Publication number
- CN112256709A CN112256709A CN202011045177.5A CN202011045177A CN112256709A CN 112256709 A CN112256709 A CN 112256709A CN 202011045177 A CN202011045177 A CN 202011045177A CN 112256709 A CN112256709 A CN 112256709A
- Authority
- CN
- China
- Prior art keywords
- data
- api
- buffer area
- special machine
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data reading method, a system and equipment under a special machine system, which comprises the following steps: a java NIO module is used at a management end to establish a data buffer area for a database, establish service analysis and provide a corresponding API (application programming interface); the host sends an application service request to the management terminal through the API; the management terminal starts application service, the database writes corresponding data into a data buffer area, and the data buffer area sends the corresponding data to the host through the API. The invention exists in an independent cache service, provides an API interface at a management end, communicates with the application in a socket mode, effectively relieves the pressure of the database, improves the processing speed of the system on the aspect of application deployment taking the database as the center and supports more terminal hosts.
Description
Technical Field
The invention relates to the technical field of data reading, in particular to a data reading method, a data reading system and data reading equipment under a special machine system.
Background
Under a special machine system, the traditional scheme of a protection product is that each terminal host is on-line managed, the managed end performs unified management, and under the condition that the magnitude of the host is not high, the managed end manages data in a database centralization mode.
However, when the number of hosts increases, the mode load of the management end centering on the database is serious, the business logic completely depends on the processing capacity of the database, and the processing bottleneck is obvious. In design, we can use internet solutions for reference, and add caching technologies such as NOSQL between application and database, for example, redis, but the existing caching technology has the defects of complex configuration and low compatibility under the whole special machine system, and a mature solution and product of the caching technology are not available for a while.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a method, a system, and a device for reading data in a special machine system, in which a cache technology implemented in a java manner is adopted, and the cache technology can be effectively embedded between an application layer and a database layer of a management end by means of the cross-platform characteristics of java, so as to implement data caching of the special machine.
In order to achieve the purpose, the invention is realized by the following technical scheme: a data reading method under a special machine system comprises the following steps:
a java NIO module is used at a management end to establish a data buffer area for a database, establish service analysis and provide a corresponding API (application programming interface);
the host sends an application service request to the management terminal through the API;
the management terminal starts application service, the database writes corresponding data into a data buffer area, and the data buffer area sends the corresponding data to the host through the API.
Further, after the management terminal starts the application service, if the application service is a query service, the API interface directly sends the data in the data buffer to the host; if the application service is data updating, data inserting or data deleting service, the host computer directly writes corresponding data into the database through the API interface and updates the data buffer area.
Further, the data in the data buffer is stored in a key-value form.
Further, the data in the data buffer area is stored in any self-defined data structure form.
Further, if the management end is the only management end, the API interface is connected with the application service through the socket to perform data transmission.
Further, if the management end is a plurality of management ends, the management ends are deployed in a distributed manner, each management end is used as a node and is provided with a node table, and when any management end is appointed to update the cache and other operations, all nodes are notified to perform cache updating in respective data buffer areas in a broadcasting mode.
Correspondingly, the invention also discloses a data reading system under the special machine system, which comprises:
the cache service creating unit is used for creating a data buffer area for the database by using a java NIO module at the management end, and establishing service analysis and providing a corresponding API (application programming interface);
the request sending unit is used for sending an application service request to the management terminal through the API interface at the host;
and the data reading unit is used for starting application service at the management end, the database writes corresponding data into the data buffer area, and the data buffer area sends the corresponding data to the host through the API.
Correspondingly, the invention also discloses a data reading device under the special machine system, which comprises:
a memory for storing a computer program;
a processor for implementing the steps of the data reading method under the special machine system as described in any one of the above when the computer program is executed.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention extracts the independent service on the basis of JVM cache, has higher decoupling property with the application, and the independent service can support different management end applications.
2. The invention is realized by java, the java is used as a technical bottom language of the cache, the portability is natural, the trouble of adapting to different operating systems and CPUs is reduced, and the invention has the advantage of rapid development in a special machine system.
3. The invention adopts pure memory operation, effectively relieves the database pressure, improves the system processing speed and supports more terminal hosts on the application deployment taking the database as the center.
Therefore, compared with the prior art, the invention has prominent substantive features and remarkable progress, and the beneficial effects of the implementation are also obvious.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a flow chart of the method of the present invention.
Fig. 2 is a system block diagram of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made with reference to the accompanying drawings.
The data reading method under the special machine system shown in fig. 1 includes the following steps:
s1: and a java NIO module is used at the management end to create a data buffer area for the database, establish service analysis and provide a corresponding API.
The communication service is realized through NIO of java, an API interface for interacting with a host is provided, data is stored in a data buffer in a key-value mode, a data structure can be customized for storage, and the flexibility is high.
According to the number of management terminals and actual requirements, the deployment modes can be divided into two types: standalone deployment and distributed deployment. The single machine deployment is simple, only the API needs to be exposed to the outside, and the application is connected through the socket. The distributed deployment can divide the cache into a plurality of nodes, each management end is a node, each node maintains a set of node table, and when the designated node updates the cache and other operations, each node is informed to update the cache in time through broadcasting and other modes. Distributed deployment may improve the robustness of the overall caching system.
S2: and the host sends an application service request to the management terminal through the API interface.
The types of application services sent by the host include: query type service, data updating service, data inserting service and data deleting service.
S3: the management terminal starts application service, the database writes corresponding data into a data buffer area, and the data buffer area sends the corresponding data to the host through the API.
When the application service is started, the data information to be cached in the database is firstly pulled and written into the data buffer area, and the cached data and the database data are synchronized at the moment. When the application service has service processing, the query service can directly pull the cache data, and the data updating, data inserting and data deleting services can directly write the updated data into the database and update the cache, so that the consistency of the database and the cache is achieved. Here, access to the database is reduced, thereby improving the throughput of the application.
Correspondingly, as shown in fig. 2, the present invention also discloses a data reading system under the special machine system, including:
the cache service creating unit is used for creating a data buffer area for the database by using a java NIO module at the management end, and establishing service analysis and providing a corresponding API (application programming interface);
the request sending unit is used for sending an application service request to the management terminal through the API interface at the host;
and the data reading unit is used for starting application service at the management end, the database writes corresponding data into the data buffer area, and the data buffer area sends the corresponding data to the host through the API.
Correspondingly, the invention also discloses a data reading device under the special machine system, which comprises:
a memory for storing a computer program;
a processor for implementing the steps of the data reading method under the special machine system as described in any one of the above when the computer program is executed.
Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in the form of a software product, where the computer software product is stored in a storage medium, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and the like, and the storage medium can store program codes, and includes instructions for enabling a computer terminal (which may be a personal computer, a server, or a second terminal, a network terminal, and the like) to perform all or part of the steps of the method in the embodiments of the present invention. The same and similar parts in the various embodiments in this specification may be referred to each other. Especially, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant points can be referred to the description in the method embodiment.
In the embodiments provided by the present invention, it should be understood that the disclosed system, system and method can be implemented in other ways. For example, the above-described system embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, systems or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit.
Similarly, each processing unit in the embodiments of the present invention may be integrated into one functional module, or each processing unit may exist physically, or two or more processing units are integrated into one functional module.
The invention is further described with reference to the accompanying drawings and specific embodiments. It should be understood that these examples are for illustrative purposes only and are not intended to limit the scope of the present invention. Further, it should be understood that various changes or modifications of the present invention may be made by those skilled in the art after reading the teaching of the present invention, and these equivalents also fall within the scope of the present application.
Claims (8)
1. A data reading method under a special machine system is characterized by comprising the following steps:
a java NIO module is used at a management end to establish a data buffer area for a database, establish service analysis and provide a corresponding API (application programming interface);
the host sends an application service request to the management terminal through the API;
the management terminal starts application service, the database writes corresponding data into a data buffer area, and the data buffer area sends the corresponding data to the host through the API.
2. The data reading method under the special machine architecture according to claim 1, characterized in that: after the management terminal starts the application service, if the application service is a query service, the API interface directly sends the data in the data buffer area to the host; if the application service is data updating, data inserting or data deleting service, the host computer directly writes corresponding data into the database through the API interface and updates the data buffer area.
3. The data reading method under the special machine architecture according to claim 1, characterized in that: the data in the data buffer is stored in a key-value form.
4. The method for reading data under the special machine architecture according to claim 1, wherein the data in the data buffer is stored in any custom data structure.
5. The data reading method under the special machine system according to claim 1, wherein if the management end is the only management end, the API interface performs data transmission with the application service through socket connection.
6. The data reading method under the special machine system according to claim 1, wherein if the management end is a plurality of management ends, the management ends are deployed in a distributed manner, each management end is provided with a node table as a node, and when any management end is specified to update the cache and the like, all nodes are notified to perform cache update in respective data buffers in a broadcast manner.
7. A data reading system under a special machine architecture, comprising:
the cache service creating unit is used for creating a data buffer area for the database by using a java NIO module at the management end, and establishing service analysis and providing a corresponding API (application programming interface);
the request sending unit is used for sending an application service request to the management terminal through the API interface at the host;
and the data reading unit is used for starting application service at the management end, the database writes corresponding data into the data buffer area, and the data buffer area sends the corresponding data to the host through the API.
8. A data reading apparatus under a special machine architecture, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the data reading method under the special machine architecture according to any one of claims 1 to 6 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011045177.5A CN112256709B (en) | 2020-09-28 | 2020-09-28 | Data reading method, system and equipment under special machine system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011045177.5A CN112256709B (en) | 2020-09-28 | 2020-09-28 | Data reading method, system and equipment under special machine system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112256709A true CN112256709A (en) | 2021-01-22 |
| CN112256709B CN112256709B (en) | 2023-06-20 |
Family
ID=74233397
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011045177.5A Active CN112256709B (en) | 2020-09-28 | 2020-09-28 | Data reading method, system and equipment under special machine system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112256709B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101303656A (en) * | 2008-06-06 | 2008-11-12 | 中国科学院计算技术研究所 | Java application program remote direct memory access method |
| CN106155643A (en) * | 2015-03-27 | 2016-11-23 | 上海天戏网络技术有限公司 | A kind of mobile phone network game engine based on JAVA_NIO technology |
| CN108009029A (en) * | 2017-11-30 | 2018-05-08 | 中电福富信息科技有限公司 | Method and system based on the data cached decoupling persistence of Ignite grids |
| CN109033130A (en) * | 2018-06-04 | 2018-12-18 | 温州市图盛科技有限公司 | A kind of block chain electric power data storage system |
| CN109656956A (en) * | 2018-12-14 | 2019-04-19 | 浪潮软件集团有限公司 | A kind of method and device for realizing operation system data centralization caching |
| CN111339139A (en) * | 2020-02-21 | 2020-06-26 | 广州市百果园信息技术有限公司 | Data processing method, device, equipment and storage medium |
-
2020
- 2020-09-28 CN CN202011045177.5A patent/CN112256709B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101303656A (en) * | 2008-06-06 | 2008-11-12 | 中国科学院计算技术研究所 | Java application program remote direct memory access method |
| CN106155643A (en) * | 2015-03-27 | 2016-11-23 | 上海天戏网络技术有限公司 | A kind of mobile phone network game engine based on JAVA_NIO technology |
| CN108009029A (en) * | 2017-11-30 | 2018-05-08 | 中电福富信息科技有限公司 | Method and system based on the data cached decoupling persistence of Ignite grids |
| CN109033130A (en) * | 2018-06-04 | 2018-12-18 | 温州市图盛科技有限公司 | A kind of block chain electric power data storage system |
| CN109656956A (en) * | 2018-12-14 | 2019-04-19 | 浪潮软件集团有限公司 | A kind of method and device for realizing operation system data centralization caching |
| CN111339139A (en) * | 2020-02-21 | 2020-06-26 | 广州市百果园信息技术有限公司 | Data processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112256709B (en) | 2023-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103607428B (en) | A kind of method and apparatus for accessing shared drive | |
| CN105677251B (en) | Storage system based on Redis cluster | |
| CN112636992B (en) | Dynamic routing method, device, equipment and storage medium | |
| CN113806300B (en) | Data storage method, system, device, equipment and storage medium | |
| WO2019041670A1 (en) | Method, device and system for reducing frequency of functional page requests, and storage medium | |
| CN114564339A (en) | Disk image file cross-platform migration method and system | |
| CN117591450B (en) | Data processing system, method, equipment and medium | |
| CN103744626A (en) | Data writing method based on memory replacement | |
| CN112256709A (en) | Data reading method, system and equipment under special machine system | |
| EP4120060A1 (en) | Method and apparatus of storing data,and method and apparatus of reading data | |
| CN106776372A (en) | Emulation data access method and device based on FPGA | |
| CN113051244B (en) | Data access method and device, and data acquisition method and device | |
| CN115562871A (en) | Memory allocation management method and device | |
| CN115509563A (en) | Mirror image file manufacturing method, device, equipment and medium | |
| CN113961566A (en) | Transaction flow processing method and system | |
| CN114490540A (en) | Data storage method, medium, device and computing equipment | |
| CN109960460B (en) | Distributed storage system | |
| CN105376273A (en) | Standard cloud service interface and standard cloud service method | |
| CN111143083B (en) | Data transmission method and device, storage medium and electronic device | |
| CN112583616B (en) | Internet of things equipment, Internet of things platform and method for accessing Internet of things platform | |
| CN113535478B (en) | Data backup method and device, storage medium and electronic equipment | |
| CN114745438B (en) | Cache data processing method, device and system of multi-data center and electronic equipment | |
| CN113392152B (en) | Method, electronic device and computer program product for updating information | |
| CN117742990A (en) | Efficient network equipment statistical data management and acquisition method | |
| CN118035230A (en) | User parameter table operation method, device and storage medium capable of configuring data structure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |