CN109460426A - A kind of system and method, the routing node of the classification storage based on MongoDB - Google Patents
A kind of system and method, the routing node of the classification storage based on MongoDB Download PDFInfo
- Publication number
- CN109460426A CN109460426A CN201811306809.1A CN201811306809A CN109460426A CN 109460426 A CN109460426 A CN 109460426A CN 201811306809 A CN201811306809 A CN 201811306809A CN 109460426 A CN109460426 A CN 109460426A
- Authority
- CN
- China
- Prior art keywords
- node
- data
- fragment
- mongodb
- routing node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The system for the classification storage based on MongoDB that the invention discloses a kind of, wherein, it include: routing node and multiple fragment nodes, wherein: the routing node, after operational order for receiving access data, a fragment node is selected to carry out data access according to the importance of data and the EMS memory occupation situation of fragment node；The fragment node, for carrying out data access.The method and routing node of a kind of classification storage based on MongoDB are also disclosed.MongoDB data-base cluster is set grading search by this programme, and wherein routing node only carries out store path forwarding, and fragment node executes specific data storage operations, improves the read-write efficiency of MongoDB data-base cluster.
Description
Technical field
The present invention relates to technical field of data storage, the system and method for espespecially a kind of classification storage based on MongoDB,
Routing node.
Background technique
Currently, with the continuous development of cloud computing and big data technology, the non-institutional number such as various pictures, audio, video
Increasing according to measuring, existing storage mode and storage system can no longer meet the requirement of growing data volume, data
Access efficiency is low.
Summary of the invention
The system for the classification storage based on MongoDB that in order to solve the above-mentioned technical problems, the present invention provides a kind of and side
Method, routing node, to realize efficient storage and retrieval to nonformatted data.
In order to reach the object of the invention, the system for the classification storage based on MongoDB that the present invention provides a kind of, wherein
It include: routing node and multiple fragment nodes, in which:
The routing node, after receiving the operational order for accessing data, according to the importance of data and fragment section
The EMS memory occupation situation of point selects a fragment node to carry out data access；
The fragment node, for carrying out data access.
Further, the system also includes:
Node memory monitoring unit, for monitoring the EMS memory occupation situation of each fragment node, by the data monitored reality
When feed back to the routing node.
Further, the system also includes:
Route backup node forms active-standby mode with the routing node, starts when the routing node breaks down.
Further, the system also includes:
Data backup node: it for periodically pulling the importance data stored in each fragment node, and stores.
A method of the classification storage based on MongoDB, wherein
Receive the operational order of access data；
A fragment node is selected to carry out data access according to the importance of data and the EMS memory occupation situation of fragment node.
Further, further includes:
The data of the EMS memory occupation situation of each fragment node of real-time reception, and store.
A kind of routing node, comprising: memory and processor；Wherein:
The memory, for saving the program for the classification storage based on MongoDB；
The processor executes the program for the classification storage based on MongoDB for reading, executes following behaviour
Make:
Receive the operational order of access data；
A fragment node is selected to carry out data access according to the importance of data and the EMS memory occupation situation of fragment node.
Further, further includes:
The data of the EMS memory occupation situation of each fragment node of real-time reception, and store.
The method of the embodiment of the present invention is by setting grading search, Road for the MongoDB data-base cluster of deployment
Store path forwarding is only carried out by node, fragment node executes specific data storage operations, improves MongoDB data base set
The read-write efficiency of group.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by specification, right
Specifically noted structure is achieved and obtained in claim and attached drawing.
Detailed description of the invention
Attached drawing is used to provide to further understand technical solution of the present invention, and constitutes part of specification, with this
The embodiment of application technical solution for explaining the present invention together, does not constitute the limitation to technical solution of the present invention.
Fig. 1 is a kind of schematic diagram of the system of classification storage based on MongoDB of the embodiment of the present invention；
Fig. 2 is a kind of flow chart of the method for classification storage based on MongoDB of the embodiment of the present invention；
Fig. 3 is the schematic diagram of the routing node of the embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention
Embodiment be described in detail.It should be noted that in the absence of conflict, in the embodiment and embodiment in the application
Feature can mutual any combination.
Step shown in the flowchart of the accompanying drawings can be in a computer system such as a set of computer executable instructions
It executes.Also, although logical order is shown in flow charts, and it in some cases, can be to be different from herein suitable
Sequence executes shown or described step.
MongoDB is a database based on distributed document storage, one between relational database and non-relationship number
According to the product between library, it is that function is most abundant in non-relational database, is most like relational database.It is unstructured in order to improve
The efficiency of data storage, the present embodiment proposes a kind of system of classification storage based on MongoDB, as shown in Figure 1, this implementation
The system of example may include: routing node and multiple fragment nodes, in which:
The routing node, after receiving the operational order for accessing data, according to the importance of data and fragment section
The EMS memory occupation situation of point selects a fragment node to carry out data access；
The fragment node, for carrying out data access, i.e., each specific node for carrying out unstructured data access can
To carry out real-time, interactive with routing node, node memory monitoring device.
In the method for the present embodiment, what routing node can be obtained according to the importance and node memory monitoring function of data
The memory of each fragment node loads occupancy situation, and dynamic reasonably distributes data access node.
The embodiment of the present invention is carried out by the way that routing node and fragment node are arranged in the MongoDB data-base cluster of deployment
Data staging access setting, wherein routing node only carries out store path forwarding, and fragment node executes specific data storage
Operation, to realize the efficient storage and retrieval to nonformatted data.
Optionally, a kind of system of classification storage based on MongoDB of the present embodiment can also include:
Node memory monitoring unit, for monitoring the EMS memory occupation situation of each fragment node, by the data monitored reality
When feed back to the routing node.When data access path determines for routing node provide optimal judgment basis (such as: it is interior
It is minimum to deposit occupancy, access efficiency highest).
Optionally, a kind of system of classification storage based on MongoDB of the present embodiment can also include:
Route backup node forms active-standby mode with the routing node, starts when the routing node breaks down.
Route backup node and routing node form active-standby mode, and when routing node, which breaks down, influences allomeric function, it is standby to start this
Part nodal function, realizes route search function same as routing node.
Optionally, a kind of system of classification storage based on MongoDB of the present embodiment can also include:
Data backup node: it for periodically pulling the importance data stored in each fragment node, and stores.It can protect
Demonstrate,prove the safety and integrality of data storage.
Fig. 2 is a kind of flow chart of the method for classification storage based on MongoDB of the embodiment of the present invention, as shown in Fig. 2,
The method of the present embodiment may include:
Step 101, routing node receive the operational order of access data；
Step 102, routing node select a fragment according to the importance of data and the EMS memory occupation situation of fragment node
Node carries out data access.
The embodiment of the present invention is carried out by the way that routing node and fragment node are arranged in the MongoDB data-base cluster of deployment
Data staging access setting, while active and standby setting is carried out to routing node and the significant data in fragment node is backed up；
Wherein routing node only carries out store path forwarding, and fragment node executes specific data storage operations, to realize to non-
The efficient storage and retrieval of format data.
Fig. 3 is the schematic diagram of the routing node of the embodiment of the present invention, as shown in figure 3, the routing node of the present embodiment includes:
Memory and processor, wherein
The memory, for saving the program for the classification storage based on MongoDB；
The processor executes the program for the classification storage based on MongoDB for reading, executes following behaviour
Make:
Receive the operational order of access data；
A fragment node is selected to carry out data access according to the importance of data and the EMS memory occupation situation of fragment node.
Optionally, can also include: each fragment node of real-time reception EMS memory occupation situation data, and store.
The embodiment of the invention also provides a kind of computer readable storage mediums, are stored with computer executable instructions,
The computer executable instructions are performed the method for realizing the classification storage based on MongoDB.
It will appreciated by the skilled person that whole or certain steps, system, dress in method disclosed hereinabove
Functional module/unit in setting may be implemented as software, firmware, hardware and its combination appropriate.In hardware embodiment,
Division between the functional module/unit referred in the above description not necessarily corresponds to the division of physical assemblies；For example, one
Physical assemblies can have multiple functions or a function or step and can be executed by several physical assemblies cooperations.Certain groups
Part or all components may be implemented as by processor, such as the software that digital signal processor or microprocessor execute, or by
It is embodied as hardware, or is implemented as integrated circuit, such as specific integrated circuit.Such software can be distributed in computer-readable
On medium, computer-readable medium may include computer storage medium (or non-transitory medium) and communication media (or temporarily
Property medium).As known to a person of ordinary skill in the art, term computer storage medium is included in for storing information (such as
Computer readable instructions, data structure, program module or other data) any method or technique in the volatibility implemented and non-
Volatibility, removable and nonremovable medium.Computer storage medium include but is not limited to RAM, ROM, EEPROM, flash memory or its
His memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storages, magnetic holder, tape, disk storage or other
Magnetic memory apparatus or any other medium that can be used for storing desired information and can be accessed by a computer.This
Outside, known to a person of ordinary skill in the art to be, communication media generally comprises computer readable instructions, data structure, program mould
Other data in the modulated data signal of block or such as carrier wave or other transmission mechanisms etc, and may include any information
Delivery media.
Claims (8)
1. a kind of system of the classification storage based on MongoDB characterized by comprising routing node and multiple fragment nodes,
Wherein:
The routing node, after the operational order for receiving access data, according to the importance of data and fragment node
EMS memory occupation situation selects a fragment node to carry out data access；
The fragment node, for carrying out data access.
2. system according to claim 1, which is characterized in that the system also includes:
Node memory monitoring unit, it is for monitoring the EMS memory occupation situation of each fragment node, the data monitored are anti-in real time
It feeds the routing node.
3. system according to claim 1, which is characterized in that the system also includes:
Route backup node forms active-standby mode with the routing node, starts when the routing node breaks down.
4. system according to claim 1, which is characterized in that the system also includes:
Data backup node: it for periodically pulling the importance data stored in each fragment node, and stores.
5. a kind of method of the classification storage based on MongoDB, which is characterized in that
Receive the operational order of access data；
A fragment node is selected to carry out data access according to the importance of data and the EMS memory occupation situation of fragment node.
6. system according to claim 5, which is characterized in that further include:
The data of the EMS memory occupation situation of each fragment node of real-time reception, and store.
7. a kind of routing node, comprising: memory and processor；It is characterized by:
The memory, for saving the program for the classification storage based on MongoDB；
The processor executes the program for the classification storage based on MongoDB for reading, performs the following operations:
Receive the operational order of access data；
A fragment node is selected to carry out data access according to the importance of data and the EMS memory occupation situation of fragment node.
8. routing node according to claim 7, which is characterized in that further include:
The data of the EMS memory occupation situation of each fragment node of real-time reception, and store.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811306809.1A CN109460426A (en) | 2018-11-05 | 2018-11-05 | A kind of system and method, the routing node of the classification storage based on MongoDB |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811306809.1A CN109460426A (en) | 2018-11-05 | 2018-11-05 | A kind of system and method, the routing node of the classification storage based on MongoDB |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109460426A true CN109460426A (en) | 2019-03-12 |
Family
ID=65609346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811306809.1A Pending CN109460426A (en) | 2018-11-05 | 2018-11-05 | A kind of system and method, the routing node of the classification storage based on MongoDB |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109460426A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111309805A (en) * | 2019-12-13 | 2020-06-19 | 华为技术有限公司 | Data reading and writing method and device for database |
| CN111966644A (en) * | 2020-08-12 | 2020-11-20 | 南方科技大学 | Supercomputer data storage method, device, system and storage medium |
| CN112685232A (en) * | 2021-01-11 | 2021-04-20 | 河南大学 | Computer backup data monitoring method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103731505A (en) * | 2014-01-17 | 2014-04-16 | 中国联合网络通信集团有限公司 | Data distributed storage method and system |
| CN105138615A (en) * | 2015-08-10 | 2015-12-09 | 北京思特奇信息技术股份有限公司 | Method and system for building big data distributed log |
| CN105389367A (en) * | 2015-11-12 | 2016-03-09 | 江苏省电力公司扬州供电公司 | Power network graphic multi-tense and multi-level distributed storage method based on Mongo database |
| CN108616581A (en) * | 2018-04-11 | 2018-10-02 | 深圳纳实大数据技术有限公司 | Data-storage system and method based on OLAP/OLTP mixing applications |
-
2018
- 2018-11-05 CN CN201811306809.1A patent/CN109460426A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103731505A (en) * | 2014-01-17 | 2014-04-16 | 中国联合网络通信集团有限公司 | Data distributed storage method and system |
| CN105138615A (en) * | 2015-08-10 | 2015-12-09 | 北京思特奇信息技术股份有限公司 | Method and system for building big data distributed log |
| CN105389367A (en) * | 2015-11-12 | 2016-03-09 | 江苏省电力公司扬州供电公司 | Power network graphic multi-tense and multi-level distributed storage method based on Mongo database |
| CN108616581A (en) * | 2018-04-11 | 2018-10-02 | 深圳纳实大数据技术有限公司 | Data-storage system and method based on OLAP/OLTP mixing applications |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111309805A (en) * | 2019-12-13 | 2020-06-19 | 华为技术有限公司 | Data reading and writing method and device for database |
| WO2021114848A1 (en) * | 2019-12-13 | 2021-06-17 | 华为技术有限公司 | Data reading and writing method and device for database |
| CN111309805B (en) * | 2019-12-13 | 2023-10-20 | 华为技术有限公司 | Data reading and writing method and device for database |
| US11868333B2 (en) | 2019-12-13 | 2024-01-09 | Huawei Technologies Co., Ltd. | Data read/write method and apparatus for database |
| CN111966644A (en) * | 2020-08-12 | 2020-11-20 | 南方科技大学 | Supercomputer data storage method, device, system and storage medium |
| CN112685232A (en) * | 2021-01-11 | 2021-04-20 | 河南大学 | Computer backup data monitoring method and system |
| CN112685232B (en) * | 2021-01-11 | 2022-03-01 | 河南大学 | Computer backup data monitoring method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109460426A (en) | A kind of system and method, the routing node of the classification storage based on MongoDB | |
| US8682903B2 (en) | System and method for synchronized content directories on cluster devices | |
| CN104216835B (en) | A kind of method and device for realizing internal memory fusion | |
| CN102158540A (en) | System and method for realizing distributed database | |
| US20160140235A1 (en) | Real-time distributed in memory search architecture | |
| US20130268644A1 (en) | Consistent ring namespaces facilitating data storage and organization in network infrastructures | |
| EP3125501A1 (en) | File synchronization method, server, and terminal | |
| CN105989123A (en) | Data synchronization method, apparatus and system | |
| CN108566291B (en) | Event processing method, server and system | |
| US10223435B2 (en) | Data transfer between multiple databases | |
| CN104615606A (en) | Hadoop distributed file system and management method thereof | |
| CN106095911A (en) | Search system and method for data synchronization | |
| CN106095871A (en) | A kind of method and device setting up data base directory structure | |
| CN107040576A (en) | Information-pushing method and device, communication system | |
| CN112597348A (en) | Method and device for optimizing big data storage | |
| CN110990356B (en) | Real-time automatic capacity expansion method and system for logical mirror image | |
| CN106599323B (en) | Method and device for realizing distributed pipeline in distributed file system | |
| US11250001B2 (en) | Accurate partition sizing for memory efficient reduction operations | |
| CN110704450A (en) | Method and device for realizing data processing, computer storage medium and terminal | |
| CN111737369B (en) | Method, device and storage medium for updating relationship map | |
| CN106528876B (en) | The information processing method and distributed information processing system of distributed system | |
| CN113297316A (en) | Method, device and system for realizing data synchronization | |
| CN106919574B (en) | Method for processing remote synchronous file in real time | |
| CN109408518A (en) | A kind of method and device of data storage | |
| CN113625952B (en) | Object storage method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190312 |
|
| RJ01 | Rejection of invention patent application after publication |