CN110287248A - A kind of data read-write method and system - Google Patents
A kind of data read-write method and system Download PDFInfo
- Publication number
- CN110287248A CN110287248A CN201910441151.3A CN201910441151A CN110287248A CN 110287248 A CN110287248 A CN 110287248A CN 201910441151 A CN201910441151 A CN 201910441151A CN 110287248 A CN110287248 A CN 110287248A
- Authority
- CN
- China
- Prior art keywords
- server
- data
- memory database
- database
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000006855 networking Effects 0.000 claims abstract description 60
- 230000002688 persistence Effects 0.000 claims abstract description 36
- 238000012544 monitoring process Methods 0.000 claims abstract description 14
- 230000004044 response Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 13
- 238000003860 storage Methods 0.000 abstract description 6
- 238000005516 engineering process Methods 0.000 description 17
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 238000009826 distribution Methods 0.000 description 5
- RTZKZFJDLAIYFH-UHFFFAOYSA-N Diethyl ether Chemical compound CCOCC RTZKZFJDLAIYFH-UHFFFAOYSA-N 0.000 description 4
- 230000008901 benefit Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 241000700605 Viruses Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000002155 anti-virotic effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a kind of data read-write method and systems.One specific embodiment of this method includes: that will be managed in the memory database on data write-in memory database server using server-side server；It will be in the message queue in the management data write-in Message Queuing server in memory database using memory database server；It will be in the data persistence database on the management data write-in data persistence server in message queue using Message Queuing server.On the one hand, it is managed the write-in and reading of data using the memory database of data persistence can be carried out to the data that it is stored, improves the storage speed and reading speed of management data.On the other hand, it is ensured that in server failure or management Data Data will not be lost when restarting, and improve the storing process of management data and the stability of reading process.And then promote the operational efficiency and stability of view networking monitoring network management scheduling system.
Description
Technical field
The present invention relates to computer fields, and in particular to view networking arenas more particularly to data read-write method and system.
Background technique
The real-time network networked to can be realized HD video real-time Transmission is regarded, pushing numerous Internet applications to high definition view
Frequencyization, high definition are face-to-face.It is used to carry out the operating condition of the equipment in view networking depending on networking monitoring network management scheduling system
Monitoring, the equipment in management view networking, the resource in scheduling view networking.In order to which the operating condition to the equipment in view networking carries out
Monitoring, the equipment in management view networking, the resource in scheduling view networking need the fortune with the equipment in view networking based on magnanimity
Market condition is monitored, manages and is analyzed depending on related management datas such as the equipment in networking, the resources in scheduling view networking,
Operating condition depending on the equipment in networking is monitored, manages the equipment in view networking, the resource in scheduling view networking.It is logical
Often, the quantity for managing data, which can achieve, reaches millions, therefore, straight to the speed of storage and the reading of the management data of magnanimity
Connect the operational efficiency for influencing view networking monitoring network management scheduling system.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind
A kind of data read-write method, a kind of data read-write system to solve the above problems.
To solve the above-mentioned problems, the embodiment of the invention provides a kind of data read-write methods, comprising: utilizes the service
Hold server that will manage in the memory database on data write-in memory database server, wherein the memory database is
The data that can be stored carry out the memory database of data persistence；It will be described interior using the memory database server
In the message queue in management data write-in Message Queuing server in deposit data library；Utilize the Message Queuing Services
Device will be in the data persistence database on the management data write-in data persistence server in the message queue.
The embodiment of the invention also provides a kind of data read-write systems, comprising: server-side server is configured as to manage
Data are written in the memory database on memory database server, wherein the memory database is that can be stored
The memory database of data progress data persistence；Memory database server, being configured as will be in the memory database
In message queue in the management data write-in Message Queuing server；Message Queuing server is configured as disappearing described
It ceases in the data persistence database on the management data write-in data persistence server in queue.
The embodiment of the present invention includes following advantages:
On the one hand, data are managed using the memory database of data persistence can be carried out to the data that it is stored
Write-in and reading, improve the storage speed and reading speed of management data.On the other hand, it is ensured that in server failure or again
Data Data is managed in the case of opening to be lost, and the storing process of management data and the stability of reading process are improved.
And then promote the operational efficiency and stability of view networking monitoring network management scheduling system.
Detailed description of the invention
Fig. 1 is a kind of networking schematic diagram of view networking of the invention；
Fig. 2 is a kind of hardware structural diagram of node server of the invention；
Fig. 3 is a kind of hardware structural diagram of access switch of the invention；
Fig. 4 is the hardware structural diagram that a kind of Ethernet association of the invention turns gateway；
Fig. 5 is a kind of flow chart of data read-write method provided in an embodiment of the present invention；
Fig. 6 is a kind of structural schematic diagram of data read-write system provided in an embodiment of the present invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real
Applying mode, the present invention is described in further detail.
It is the important milestone of network Development depending on networking, is a real-time network, can be realized HD video real-time Transmission,
Push numerous Internet applications to HD video, high definition is face-to-face.
Real-time high-definition video switching technology is used depending on networking, it can be such as high in a network platform by required service
Clear video conference, Intellectualized monitoring analysis, emergency command, digital broadcast television, delay TV, the Web-based instruction, shows video monitoring
Field live streaming, VOD program request, TV Mail, individual character records (PVR), Intranet (manages) channel by oneself, intelligent video Broadcast Control, information publication
All be incorporated into a system platform etc. services such as tens of kinds of videos, voice, picture, text, communication, data, by TV or
Computer realizes that high-definition quality video plays.
Embodiment in order to enable those skilled in the art to better understand the present invention is introduced to depending on networking below:
Depending on networking, applied portion of techniques is as described below:
Network technology (Network Technology)
Traditional ethernet (Ethernet) is improved depending on the network technology innovation networked, with potential huge on network
First video flow.It is exchanged different from simple network packet packet switch (Packet Switching) or lattice network
(Circuit Switching) meets Streaming demand using Packet Switching depending on networking technology.Depending on skill of networking
Art has flexible, the simple and low price of packet switch, is provided simultaneously with the quality and safety assurance of circuit switching, realizes the whole network friendship
Change the seamless connection of formula virtual circuit and data format.
Switching technology (Switching Technology)
Two advantages of asynchronous and packet switch that Ethernet is used depending on networking eliminate Ethernet under the premise of complete compatible and lack
It falls into, has the end-to-end seamless connection of the whole network, direct user terminal, directly carrying IP data packet.User data is in network-wide basis
It is not required to any format conversion.It is the more advanced form of Ethernet depending on networking, is a real-time exchange platform, can be realized at present mutually
The whole network large-scale high-definition realtime video transmission that networking cannot achieve pushes numerous network video applications to high Qinghua, unitizes.
Server technology (Server Technology)
It is different from traditional server, its Streaming Media depending on the server technology in networking and unified video platform
Transmission be built upon it is connection-oriented on the basis of, data-handling capacity is unrelated with flow, communication time, single network layer energy
Enough transmitted comprising signaling and data.For voice and video business, handled depending on networking and unified video platform Streaming Media
Complexity many simpler than data processing, efficiency substantially increase hundred times or more than traditional server.
Reservoir technology (Storage Technology)
The ultrahigh speed reservoir technology of unified video platform in order to adapt to the media content of vast capacity and super-flow and
Using state-of-the-art real time operating system, the programme information in server instruction is mapped to specific hard drive space, media
Content is no longer pass through server, and moment is directly delivered to user terminal, and user waits typical time less than 0.2 second.It optimizes
Sector distribution greatly reduces the mechanical movement of hard disc magnetic head tracking, and resource consumption only accounts for the 20% of the internet ad eundem IP, but
The concurrent flow greater than 3 times of traditional disk array is generated, overall efficiency promotes 10 times or more.
Network security technology (Network Security Technology)
Depending on the structural design networked by servicing independent licence system, equipment and the modes such as user data is completely isolated every time
The network security problem that puzzlement internet has thoroughly been eradicated from structure, does not need antivirus applet, firewall generally, has prevented black
The attack of visitor and virus, structural carefree secure network is provided for user.
It services innovative technology (Service Innovation Technology)
Business and transmission are fused together by unified video platform, whether single user, private user or a net
The sum total of network is all only primary automatic connection.User terminal, set-top box or PC are attached directly to unified video platform, obtain rich
The multimedia video service of rich colorful various forms.Unified video platform is traditional to substitute with table schema using " menu type "
Complicated applications programming, considerably less code, which can be used, can be realized complicated application, realize the new business innovation of " endless ".
Networking depending on networking is as described below:
It is a kind of central controlled network structure depending on networking, which can be Tree Network, Star network, ring network etc. class
Type, but centralized control node is needed to control whole network in network on this basis.
As shown in Figure 1, being divided into access net and Metropolitan Area Network (MAN) two parts depending on networking.
The equipment of access mesh portions can be mainly divided into 3 classes: node server, access switch, terminal (including various machines
Top box, encoding board, memory etc.).Node server is connected with access switch, and access switch can be with multiple terminal phases
Even, and it can connect Ethernet.
Wherein, node server is the node that centralized control functions are played in access net, can control access switch and terminal.
Node server can directly be connected with access switch, can also directly be connected with terminal.
Similar, the equipment of metropolitan area mesh portions can also be divided into 3 classes: metropolitan area server, node switch, node serve
Device.Metropolitan area server is connected with node switch, and node switch can be connected with multiple node servers.
Wherein, node server is the node server for accessing mesh portions, i.e. node server had both belonged to access wet end
Point, and belong to metropolitan area mesh portions.
Metropolitan area server is the node that centralized control functions are played in Metropolitan Area Network (MAN), can control node switch and node serve
Device.Metropolitan area server can be directly connected to node switch, can also be directly connected to node server.
It can be seen that be entirely a kind of central controlled network structure of layering depending on networking network, and node server and metropolitan area
The network controlled under server can be the various structures such as tree-shaped, star-like, cyclic annular.
Visually claim, access mesh portions can form unified video platform (part in virtual coil), and multiple unified videos are flat
Platform can form view networking；Each unified video platform can be interconnected by metropolitan area and wide area depending on networking.
Classify depending on networked devices
1.1 embodiment of the present invention can be mainly divided into 3 classes: server depending on the equipment in networking, interchanger (including ether
Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).Metropolitan Area Network (MAN) can be divided on the whole depending on networking
(or national net, World Wide Web etc.) and access net.
1.2 equipment for wherein accessing mesh portions can be mainly divided into 3 classes: node server, access switch (including ether
Net association turns gateway), terminal (including various set-top boxes, encoding board, memory etc.).
The specific hardware structure of each access network equipment are as follows:
Node server:
As shown in Fig. 2, mainly including Network Interface Module 201, switching engine module 202, CPU module 203, disk array
Module 204；
Wherein, Network Interface Module 201, the Bao Jun that CPU module 203, disk array module 204 are come in enter switching engine
Module 202；Switching engine module 202 look into the operation of address table 205 to the packet come in, to obtain the navigation information of packet；
And the packet is stored according to the navigation information of packet the queue of corresponding pack buffer 206；If the queue of pack buffer 206 is close
It is full, then it abandons；All pack buffer queues of 202 poll of switching engine module, are forwarded: 1) end if meeting the following conditions
It is less than that mouth sends caching；2) the queue package counting facility is greater than zero.Disk array module 204 mainly realizes the control to hard disk, packet
Include the operation such as initialization, read-write to hard disk；CPU module 203 be mainly responsible for access switch, terminal (not shown) it
Between protocol processes, to address table 205 (including descending protocol packet address table, uplink protocol package address table, data packet addressed table)
Configuration, and, the configuration to disk array module 204.
Access switch:
As shown in figure 3, mainly including Network Interface Module (downstream network interface module 301, uplink network interface module
302), switching engine module 303 and CPU module 304；
Wherein, the packet (upstream data) that downstream network interface module 301 is come in enters packet detection module 305；Packet detection mould
Whether mesh way address (DA), source address (SA), type of data packet and the packet length of the detection packet of block 305 meet the requirements, if met,
It then distributes corresponding flow identifier (stream-id), and enters switching engine module 303, otherwise abandon；Uplink network interface mould
The packet (downlink data) that block 302 is come in enters switching engine module 303；The data packet that CPU module 304 is come in enters switching engine
Module 303；Switching engine module 303 look into the operation of address table 306 to the packet come in, to obtain the navigation information of packet；
If the packet into switching engine module 303 is that downstream network interface is gone toward uplink network interface, in conjunction with flow identifier
(stream-id) packet is stored in the queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
It abandons；If the packet into switching engine module 303 is not that downstream network interface is gone toward uplink network interface, according to packet
Navigation information is stored in the data packet queue of corresponding pack buffer 307；If the queue of the pack buffer 307 is close full,
Then abandon.
All pack buffer queues of 303 poll of switching engine module, may include two kinds of situations:
If the queue is that downstream network interface is gone toward uplink network interface, meets the following conditions and be forwarded: 1)
It is less than that the port sends caching；2) the queue package counting facility is greater than zero；3) token that rate control module generates is obtained；
If the queue is not that downstream network interface is gone toward uplink network interface, meets the following conditions and is forwarded:
1) it is less than to send caching for the port；2) the queue package counting facility is greater than zero.
Rate control module 308 is configured by CPU module 304, to all downlink networks in programmable interval
Interface generates token toward the pack buffer queue that uplink network interface is gone, to control the code rate of forwarded upstream.
CPU module 304 is mainly responsible for the protocol processes between node server, the configuration to address table 306, and,
Configuration to rate control module 308.
Ethernet association turns gateway:
As shown in figure 4, mainly including Network Interface Module (downstream network interface module 401, uplink network interface module
402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, Bao Huan
Storage 407 and MAC adding module 409, MAC removing module 410.
Wherein, the data packet that downstream network interface module 401 is come in enters packet detection module 405；Packet detection module 405 is examined
Ethernet mac DA, ethernet mac SA, Ethernet length or frame type, the view networking mesh way address of measured data packet
DA, whether meet the requirements depending on networking source address SA, depending on networking data Packet type and packet length, corresponding stream is distributed if meeting
Identifier (stream-id)；Then, MAC DA, MAC SA, length or frame type are subtracted by MAC removing module 410
(2byte), and enter corresponding receive and cache, otherwise abandon；
Downstream network interface module 401 detects the transmission caching of the port, according to the view of packet networking mesh if there is Bao Ze
Address D A knows the ethernet mac DA of corresponding terminal, adds the ethernet mac DA of terminal, Ethernet assists the MAC for turning gateway
SA, Ethernet length or frame type, and send.
The function that Ethernet association turns other modules in gateway is similar with access switch.
Terminal:
It mainly include Network Interface Module, Service Processing Module and CPU module；For example, set-top box mainly connects including network
Mouth mold block, video/audio encoding and decoding engine modules, CPU module；Encoding board mainly includes Network Interface Module, video encoding engine
Module, CPU module；Memory mainly includes Network Interface Module, CPU module and disk array module.
The equipment of 1.3 metropolitan area mesh portions can be mainly divided into 2 classes: node server, node switch, metropolitan area server.
Wherein, node switch mainly includes Network Interface Module, switching engine module and CPU module；Metropolitan area server mainly includes
Network Interface Module, switching engine module and CPU module are constituted.
2, networking data package definition is regarded
2.1 access network data package definitions
Access net data packet mainly include following sections: destination address (DA), source address (SA), reserve bytes,
payload(PDU)、CRC。
As shown in the table, the data packet for accessing net mainly includes following sections:
| DA | SA | Reserved | Payload | CRC |
Wherein:
Destination address (DA) is made of 8 bytes (byte), and first character section indicates type (such as the various associations of data packet
Discuss packet, multicast packet, unicast packet etc.), be up to 256 kinds of possibility, the second byte to the 6th byte is metropolitan area net address,
Seven, the 8th bytes are access net address；
Source address (SA) is also to be made of 8 bytes (byte), is defined identical as destination address (DA)；
Reserve bytes are made of 2 bytes；
The part payload has different length according to the type of different datagrams, is if it is various protocol packages
64 bytes are 32+1024=1056 bytes if it is single group unicast packets words, are not restricted to above 2 kinds certainly；
CRC is made of 4 bytes, and calculation method follows the Ethernet CRC algorithm of standard.
2.2 Metropolitan Area Network (MAN) packet definitions
The topology of Metropolitan Area Network (MAN) is pattern, may there is 2 kinds, connection even of more than two kinds, i.e. node switching between two equipment
It can all can exceed that 2 kinds between machine and node server, node switch and node switch, node switch and node server
Connection.But the metropolitan area net address of metropolitan area network equipment is uniquely, to close to accurately describe the connection between metropolitan area network equipment
System, introduces parameter in embodiments of the present invention: label, uniquely to describe a metropolitan area network equipment.
(Multi-Protocol Label Switch, multiprotocol label are handed over by the definition of label and MPLS in this specification
Change) label definition it is similar, it is assumed that between equipment A and equipment B there are two connection, then data packet from equipment A to equipment B just
There are 2 labels, data packet also there are 2 labels from equipment B to equipment A.Label is divided into label, outgoing label, it is assumed that data packet enters
The label (entering label) of equipment A is 0x0000, and the label (outgoing label) when this data packet leaves equipment A may reform into
0x0001.The networking process of Metropolitan Area Network (MAN) is to enter network process under centralized control, also means that address distribution, the label of Metropolitan Area Network (MAN)
Distribution be all to be dominated by metropolitan area server, node switch, node server be all passively execute, this point with
The label distribution of MPLS is different, and the distribution of the label of MPLS is the result that interchanger, server are negotiated mutually.
As shown in the table, the data packet of Metropolitan Area Network (MAN) mainly includes following sections:
| DA | SA | Reserved | Label | Payload | CRC |
That is destination address (DA), source address (SA), reserve bytes (Reserved), label, payload (PDU), CRC.Its
In, the format of label, which can refer to, such as gives a definition: label is 32bit, wherein high 16bit retains, only with low 16bit, its position
Set is between the reserve bytes and payload of data packet.
With reference to Fig. 5, the flow chart of data read-write method provided in an embodiment of the present invention is shown, can specifically include as follows
Step:
Step 501, the memory database on data write-in memory database server will be managed using server-side server
In.
In the present invention, it can be used for the operation feelings to the equipment in view networking depending on networking monitoring network management scheduling system
Condition is monitored, manages the resource that equipment, scheduling view in view networking are networked.
In the present invention, management data are to be monitored, managed in view networking to the operating condition depending on the equipment in networking
Equipment, data needed for resource etc. of scheduling view networking.
It in the present invention, include server-side depending on networking monitoring network management scheduling system, depending on networking monitoring network management tune
The server-side of degree system can be deployed with server cluster, and the server in server cluster can be referred to as server-side service
Device.Server-side server can receive for acquisition management data equipment transmission by being adopted for the equipment of acquisition management data
The management data collected.
In the present invention, the memory number on data write-in memory database server can will be managed by server-side server
According in library.
In the present invention, memory database is that the data that can be stored carry out the memory database of data persistence.
Can be at interval of preset duration or every a certain number of management data of write-in, the number stored having using memory database
The management data in memory database data library are written to hard disk according to the function for the memory database for carrying out data persistence, from
And persistence is carried out to management data.
In some embodiments, the memory database on memory database server is Redis database.Redis data
Library has the function of that the data that can be stored carry out data persistence.Redis database can at interval of preset duration or
Every a certain amount of data of write-in, can use the function for the management data in Redis database and are written to hard disk, thus, it is right
The management data being written in Redis database carry out data persistence.
Step 502, the write-in of the management data in memory database message team is written to using memory database server
In message queue on column server.
In the present invention, the memory number on data write-in memory database server will managed using server-side server
After in library, the management number that memory database server will be written in memory database by server-side server can use
According in the message queue in write-in Message Queuing server.
In the present invention, writing data into data persistence database using message queue is due in high concurrent environment
Under, request often blocks, for example, the request of the write-in data type such as a large amount of insert request, update request is same
When reach data persistence database such as MySQL, can directly result in countless row lock table locks or even last-minute plea can accumulate
It is more, to trigger too many connections mistakes.Using message queue is used, asking for type can be written with asynchronous process
It asks, to alleviate the pressure of database.
In some embodiments, message queue is Message Queue, is being write using server-side server by data are managed
After entering in the memory database on memory database server, can use memory database server will be by server-side service
Device is written in the Message Queue in the write-in of the management data in memory database Message Queuing server.
Step 503, the write-in data persistence of the management data in message queue is written to using Message Queuing server
In data persistence database on server.
In the present invention, disappear in the management data write-in being written in memory database using memory database server
After ceasing in the message queue on queue server, can use Message Queuing server will be written by memory database server
Management data into message queue are written in the data persistence database on data persistence server.
In some embodiments, the data persistence database on data persistence server is MySQL database.In benefit
The message team in the write-in of the management data in memory database Message Queuing server is written to memory database server
After in column, it can use the management data that Message Queuing server will be written in message queue by memory database server
It is written in the MySQL database on data persistence server.
In some embodiments, when needing to read management data, to be supervised to the operating condition depending on the equipment in networking
It, can be by server-side server from memory database server when control, the equipment in management view networking, the resource of scheduling view networking
On memory database in read out and need the management data that read.
Data read-write method provided in an embodiment of the present invention illustrated below:
With memory database for Redis database, for message queue is Message Queue, network depending on networking monitoring
The server-side of management scheduling system is deployed with server-side server cluster, and each server-side server is connect with Redis server,
Redis server is connect with MQ server, and MQ server is connect with MySQL server.Operation has Redis on Redis server
Database, operation has Message Queue on MQ server, and operation has MySQL database on MySQL server.
When needing to be written a certain number of management data, a certain number of management data are written server-side server
Redis database, then, the certain amount that will be written to by server-side server in Redis database by Redis server
Management data be written in Message Queue, finally, by MQ server Message will be written to by Redis server
A certain number of management data in Queue are written in MySQL database.When needing to read management data, by servicing
End server reads out the management data for needing to read from Redis database.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
With reference to Fig. 6, the structural schematic diagram of data read-write system provided in an embodiment of the present invention is shown.Data read-write system
It may include: server-side server 601, memory database server 602, Message Queuing server 603.Wherein, server-side takes
Business device 601 is configured as that the memory database on data write-in memory database server will be managed using server-side server
In, wherein memory database is that the data that can be stored carry out the memory database of data persistence；Memory database clothes
Business device 602 is configured as that message queue is written in the management data in the memory database using the memory database server
In message queue on server；Message Queuing server 603 is configured as utilizing the Message Queuing server by the message team
In the data persistence database on management data write-in data persistence server in column.
In some embodiments, server-side server is configured to: in response to data read request, from memory number
The management data read according to needs are read out in the memory database on the server of library.
In some embodiments, memory database is Redis database.
In some embodiments, data persistence database is MySQL database.
In some embodiments, message queue is Message Queue.
For system embodiments, since it is basically similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these
Computer program instructions are set to general purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals
Standby processor is to generate a machine, so that being held by the processor of computer or other programmable data processing terminal devices
Capable instruction generates for realizing in one or more flows of the flowchart and/or one or more blocks of the block diagram
The device of specified function.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing terminal devices
In computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates packet
The manufacture of command device is included, which realizes in one side of one or more flows of the flowchart and/or block diagram
The function of being specified in frame or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable data processing terminal devices, so that
Series of operation steps are executed on computer or other programmable terminal equipments to generate computer implemented processing, thus
The instruction executed on computer or other programmable terminal equipments is provided for realizing in one or more flows of the flowchart
And/or in one or more blocks of the block diagram specify function the step of.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
A kind of data read-write method provided by the present invention, a kind of data read-write system are described in detail above,
Used herein a specific example illustrates the principle and implementation of the invention, and the explanation of above embodiments is only used
In facilitating the understanding of the method and its core concept of the invention；At the same time, for those skilled in the art, according to the present invention
Thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not be construed as
Limitation of the present invention.
Claims (10)
1. a kind of data read-write method is applied to view networking monitoring network management and dispatches system, the view networking monitoring networking pipe
Managing scheduling system includes: server-side server, which comprises
It will be managed in the memory database on data write-in memory database server using the server-side server, wherein
The memory database is that the data that can be stored carry out the memory database of data persistence；
Message Queuing Services are written into the management data in the memory database using the memory database server
In message queue on device；
Data persistence server is written into the management data in the message queue using the Message Queuing server
On data persistence database in.
2. according to the method described in claim 1, the method also includes:
The server-side server is in response to data read request, from the memory database on the memory database server
Read out the management data for needing to read.
3. according to the method described in claim 2, the memory database is Redis database.
4. according to the method described in claim 3, the data persistence database is MySQL database.
5. according to the method described in claim 4, the message queue is Message Queue.
6. a kind of data read-write system, comprising:
Server-side server is configured as to manage in the memory database on data write-in memory database server, wherein
The memory database is that the data that can be stored carry out the memory database of data persistence；
Memory database server is configured as the management data in memory database Message Queuing Services are written
In message queue on device；
Message Queuing server is configured as the management data in message queue data persistence server is written
On data persistence database in.
7. system according to claim 6, server-side server is configured to:
In response to data read request, read out what needs were read from the memory database on the memory database server
Manage data.
8. system according to claim 7, the memory database is Redis database.
9. system according to claim 8, the data persistence database is MySQL database.
10. system according to claim 9, the message queue is Message Queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910441151.3A CN110287248A (en) | 2019-05-24 | 2019-05-24 | A kind of data read-write method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910441151.3A CN110287248A (en) | 2019-05-24 | 2019-05-24 | A kind of data read-write method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110287248A true CN110287248A (en) | 2019-09-27 |
Family
ID=68002659
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910441151.3A Pending CN110287248A (en) | 2019-05-24 | 2019-05-24 | A kind of data read-write method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110287248A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111145420A (en) * | 2020-01-03 | 2020-05-12 | 杭州视联动力技术有限公司 | Remote number calling method and device, electronic equipment and storage medium |
| CN117311916A (en) * | 2023-11-29 | 2023-12-29 | 中山大学 | Data processing method, system, device and storage medium for identity authentication |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103886079A (en) * | 2014-03-26 | 2014-06-25 | 北京京东尚科信息技术有限公司 | Data processing method and system |
| CN108345635A (en) * | 2017-12-29 | 2018-07-31 | 广州品唯软件有限公司 | A kind of Billing System and bill generation processing method of High Availabitity |
| CN108632331A (en) * | 2017-08-28 | 2018-10-09 | 北京视联动力国际信息技术有限公司 | A kind of installation method and device regarding working application |
| CN108898463A (en) * | 2018-07-02 | 2018-11-27 | 山东大学 | A kind of network business system for farm products and its building method, operation method of high concurrent |
| CN108958789A (en) * | 2018-05-20 | 2018-12-07 | 湖北九州云仓科技发展有限公司 | A kind of parallel streaming calculation method, electronic equipment, storage medium and system |
| CN109151061A (en) * | 2018-09-28 | 2019-01-04 | 视联动力信息技术股份有限公司 | A kind of date storage method and device |
| CN109445965A (en) * | 2018-11-07 | 2019-03-08 | 北京明朝万达科技股份有限公司 | By the Redis and MySQL message treatment method realized and equipment |
| CN109634988A (en) * | 2018-10-29 | 2019-04-16 | 视联动力信息技术股份有限公司 | A kind of monitoring polling method and device |
-
2019
- 2019-05-24 CN CN201910441151.3A patent/CN110287248A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103886079A (en) * | 2014-03-26 | 2014-06-25 | 北京京东尚科信息技术有限公司 | Data processing method and system |
| CN108632331A (en) * | 2017-08-28 | 2018-10-09 | 北京视联动力国际信息技术有限公司 | A kind of installation method and device regarding working application |
| CN108345635A (en) * | 2017-12-29 | 2018-07-31 | 广州品唯软件有限公司 | A kind of Billing System and bill generation processing method of High Availabitity |
| CN108958789A (en) * | 2018-05-20 | 2018-12-07 | 湖北九州云仓科技发展有限公司 | A kind of parallel streaming calculation method, electronic equipment, storage medium and system |
| CN108898463A (en) * | 2018-07-02 | 2018-11-27 | 山东大学 | A kind of network business system for farm products and its building method, operation method of high concurrent |
| CN109151061A (en) * | 2018-09-28 | 2019-01-04 | 视联动力信息技术股份有限公司 | A kind of date storage method and device |
| CN109634988A (en) * | 2018-10-29 | 2019-04-16 | 视联动力信息技术股份有限公司 | A kind of monitoring polling method and device |
| CN109445965A (en) * | 2018-11-07 | 2019-03-08 | 北京明朝万达科技股份有限公司 | By the Redis and MySQL message treatment method realized and equipment |
Non-Patent Citations (2)
| Title |
|---|
| CSDN: "Redis与Mysql通信", 《HTTPS://BLOG.CSDN.NET/HPB21/ARTICLE/DETAILS/7852934》 * |
| SEGMENTFAULT: "redis如何实现一个消息队列并将数据持久化到数据库？", 《HTTPS://SEGMENTFAULT.COM/Q/1010000002793792/A-1020000002794106》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111145420A (en) * | 2020-01-03 | 2020-05-12 | 杭州视联动力技术有限公司 | Remote number calling method and device, electronic equipment and storage medium |
| CN111145420B (en) * | 2020-01-03 | 2022-04-12 | 杭州视联动力技术有限公司 | Remote number calling method and device, electronic equipment and storage medium |
| CN117311916A (en) * | 2023-11-29 | 2023-12-29 | 中山大学 | Data processing method, system, device and storage medium for identity authentication |
| CN117311916B (en) * | 2023-11-29 | 2024-03-22 | 中山大学 | Data processing method, system, device and storage medium for identity authentication |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108075920B (en) | A kind of management method and system regarding networked terminals | |
| CN109617956A (en) | A kind of data processing method and device | |
| CN110475102A (en) | A kind of monitoring data processing method and system based on view networking | |
| CN110225083A (en) | Data push method and device based on view networking | |
| CN109284265A (en) | A kind of date storage method and system | |
| CN108307212A (en) | A kind of file order method and device | |
| CN108234178A (en) | A kind of method and apparatus for being managed collectively menu file | |
| CN108206927B (en) | A kind of meeting synchronous method and device | |
| CN110062194A (en) | A kind of processing method of audio, video data, device and device and storage medium | |
| CN110048903A (en) | A kind of association turns gateway status monitoring method and device | |
| CN109151061A (en) | A kind of date storage method and device | |
| CN110287248A (en) | A kind of data read-write method and system | |
| CN108989850A (en) | A kind of video playing control method and control system | |
| CN110022500A (en) | A kind of loss treating method and device | |
| CN110109823A (en) | A kind of application program repairing method and device | |
| CN109922297A (en) | Call method and device | |
| CN110035307A (en) | A kind of fragment storage method and device | |
| CN110048911A (en) | A kind of Cascading Methods and server based on view networking | |
| CN109922302A (en) | Conference reservation information acquisition method, system, equipment and machine readable media | |
| CN109698790A (en) | A kind of storage method and system regarding networking data | |
| CN109067895A (en) | A kind of method and apparatus remotely controlled | |
| CN108881965B (en) | A kind of server processes operating method and device | |
| CN110166840A (en) | A kind of method for processing business, system and device | |
| CN110266768A (en) | A kind of data transmission method and system | |
| CN110365967A (en) | A kind of test method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190927 |