CN102413157A - Network storage system and network storage method - Google Patents

Network storage system and network storage method Download PDF

Info

Publication number
CN102413157A
CN102413157A CN2010102981920A CN201010298192A CN102413157A CN 102413157 A CN102413157 A CN 102413157A CN 2010102981920 A CN2010102981920 A CN 2010102981920A CN 201010298192 A CN201010298192 A CN 201010298192A CN 102413157 A CN102413157 A CN 102413157A
Authority
CN
China
Prior art keywords
module
data
storage
data buffer
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2010102981920A
Other languages
Chinese (zh)
Inventor
何书楷
吕世仁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JMICRON TECHNOLOGY Corp
Jmicron Tech Corp
Original Assignee
JMICRON TECHNOLOGY Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JMICRON TECHNOLOGY Corp filed Critical JMICRON TECHNOLOGY Corp
Priority to CN2010102981920A priority Critical patent/CN102413157A/en
Publication of CN102413157A publication Critical patent/CN102413157A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a network storage system and a network storage method which are used for improving the data write efficiency of a network storage service. The network storage system comprises a first module, a first data buffer area, a second module and a third module. According to the invention, the standard flow of file processing is made through omitting the traditional operation system when the data is stored, and the network storage system and network storage method provided by the invention can use new file processing procedures in the second module and the third module, thus the file processing flow in the traditional network storage system can be shortened greatly through the system and method provided by the invention, and the data write efficiency of the network storage service can be improved by more than 50%.

Description

Network storing system and network storage method
Technical field
The invention relates to a kind of network and store framework, refer to that especially data that network storing system and a kind of that a kind of data that can be used to promote a network store-service (Net Storage Service) write usefulness can be used to promote this network store-service write the network storage method of usefulness.
Background technology
The network storage server (network-attached storage is a kind of through network connections NAS), and through utilize that this file of Samba shares procotol carry out the storage facilities of file access so that computer system to be provided.Through a distributed framework; The network storage server can provide the network data shared mechanism of unlimited expansion capacity easily, as long as connect to network any node, the computer of various different operating systems; Just can pass through the network storage server; Enjoy conveniently file access service, therefore, the writing speed on the network storage server just becomes a very important problem.
Generally speaking, the data length that Ethernet (EtherNet) divides into groups is generally 1.5K hyte (wherein useful data can be the data length of 1~1460 hyte), and hard disk is to be the unit of data length with sector (sector); A sector approximately is 512 hytes; That is to say that the network storage server is different data formats through the data structure of the data that network terminal received with the data structure of the data that write to hard disk, therefore; In traditional technology; Can the data that received be recombinated in the operating system of network storing system, so that carry out the conversion of data format, for instance; Please refer to Fig. 1, Fig. 1 illustrated is a kind of simplification block schematic diagram of traditional network storing system 100.As shown in Figure 1; Document processing module 140, the first data buffer zones 110 that network storing system 100 includes one first data buffer zone 110, one second data buffer zone 120, one the 3rd data buffer zone 130 and an operating system are used for storing a storage data that is received through a network terminal, and this storage data includes the message box (for example DS1, DS2...) of a plurality of 1.5K hytes; Second data buffer zone 120 includes a plurality of memory pagings (Page0~Page14) for example; These a plurality of memory pagings are used for storing this storage data desire to write to a storage device 170 (a for example hard disk), as a user (network terminal machine 160 that for example Fig. 1 illustrated) in the time of will this storage data being write storage device 170, in the core layer (Kernel level) of operating system; This storage data (DS1, DS2...) can utilize ICP/IP protocol to be stored to first data buffer zone 110 through one first network terminal 150 from network terminal machine 160 earlier; Afterwards, in the application layer (Application level) of operating system, network storing system 100 can utilize an a processor (central processing unit (CPU) for example; For not being shown among the figure for purpose of brevity) this storage data copied to the 3rd data buffer zone 130 of network storing system 100; The 3rd data buffer zone 130 can temporary this storage data, by the time collected this storage data after, network storing system 100 is just recombinated this storage data; Afterwards; This processor can copy to this storage data in these a plurality of memory pagings of second data buffer zone 120, and then, network storing system 100 is handled the document processing module 140 that this storage data in the memory paging of second data buffer zone 120 sends operating system to; The document processing module 140 of operating system writes storage device 170 through one second network terminal 180 after handling again; Yet the document processing module 140 of operating system carries out the normal process of file process can use up long time, therefore; When using traditional network storing system 100; It is very poor that the data of network store-service (Net Storage Service) write usefulness, and for instance, the data of this network store-service write usefulness and have only 13MB/s.
Summary of the invention
In view of this; The data that one of the object of the invention is to provide network storing system that a kind of data that can be used to promote a network store-service (Net Storage Service) write usefulness and a kind of can be used to promote this network store-service write the network storage method of usefulness, to solve the above problems.
Disclose a kind of network storing system according to one aspect of the present invention; The data that this network storing system can be used to promote a network store-service write usefulness, and this network storing system includes: one first module, one first data buffer zone, one second module and a three module.Whether this first module is used to detect a network terminal has a storage data writing events to take place; This first data buffer zone is used to store a storage data that receives through this network terminal; This second module is coupled to this storage device, and is used for one first Data Format Transform of this storage data is one second data format compatible with this storage device; This three module is coupled to this first module, this first data buffer zone and this second module, and wherein this three module includes: one second data buffer zone is used to store this storage data of desiring to write to this storage device; When this first module detects this storage data writing events generation; This first module is notified this three module to control this first data buffer zone this storage data that it is stored and is write to this second data buffer zone; And this storage data that this three module will write this second data buffer zone directly is sent to this second module, and this second module will also write this storage device with this storage data for this second data format with this storage device compatibility from this first Data Format Transform of this storage data that this three module received.
Disclose a kind of network storage method on the other hand according to the present invention; The data that this network storage method can be used to promote a network store-service write usefulness; And this network storage method includes: one first module, one first data buffer zone, one second module and a three module are provided; Wherein this first data buffer zone is used to store a storage data that receives and desire to write to a storage device through a network terminal, and this three module includes one second data buffer zone; Whether utilize this first module to detect this network terminal has a storage data writing events to take place; When this first module detects this storage data writing events generation, utilize this first module to notify this three module to control this first data buffer zone this storage data that it is stored and write to this second data buffer zone in this three module; This second data buffer zone that utilizes this three module will write this storage data directly is sent to this second module; And utilize this second module from this first Data Format Transform of this storage data that this three module received to be and this second data format of this storage device compatibility, directly this storage data is write this storage device then.
Useful technique effect of the present invention is: the data that the network storing system and a kind of that a kind of data that can be used to promote a network store-service that the present invention disclosed write usefulness can be used to promote this network store-service write the network storage method of usefulness; Can when storage data, omit traditional operating system and do the normal process of file process; And only use module provided by the present invention to do the function that file stores; And network storing system of the present invention and network storage method can use new documentor in this second module and this three module; Thus; Network storing system provided by the present invention and network storage method just can shorten the file process flow process in traditional network storing system significantly; And then the data of this network store-service are write enhancing efficiency surpass more than percent 50, for instance, if use traditional network storing system and network storage method; The data of this network store-service write usefulness and have only 13MB/s; Yet if use network storing system of the present invention and network storage method, the data of this network store-service write usefulness and just can be risen to more than the 20MB/s significantly.
Description of drawings
Fig. 1 illustrated is a kind of simplification block schematic diagram of traditional network storing system.
Fig. 2 illustrated is the simplification block schematic diagram that data that one first embodiment of the present invention a kind of is used to promote a network store-service (Net Storage Service) write the network storing system of usefulness.
Fig. 3 illustrated is to summarize the schematic flow sheet of an embodiment that a kind of data that are used to promote a network store-service of the present invention write the network storage method of usefulness according to the function mode of above-mentioned network storing system.
Embodiment
In the middle of this specification and follow-up claims, used some vocabulary to censure specific element; Should understand and have common knowledge the knowledgeable in the affiliated field; Hardware manufacturer may be called same element with different nouns, and this specification and follow-up claims are not used as distinguishing the mode of element with the difference of title, but the criterion that is used as distinguishing with the difference of element on function; Be an open term mentioned " including " in the middle of specification and the follow-up claim in the whole text; So should be construed to " include but be not limited to ", in addition, " coupling " speech this be include any directly and the indirect means that are electrically connected; Therefore; Be coupled to one second device if describe one first device in the literary composition, then represent this first device can directly be electrically connected in this second device, or be electrically connected to this second device through other device or the intersegmental ground connection of connection hand.
Please refer to Fig. 2; Fig. 2 illustrated is the simplification block schematic diagram that data that one first embodiment of the present invention a kind of is used to promote a network store-service (Net Storage Service) write the network storing system 200 of usefulness; Wherein this network store-service is a kind of application program with network memory function; And network storing system 200 can be a network storage server (network-attached storage, NAS), a SAMBA server for example.As shown in Figure 2; Network storing system 200; Include: one first module 210, one first data buffer zone 220, one second module 230 and a three module 240; Wherein three module 240 includes one second data buffer zone 250; And first module 210 operates in an application layer (Application level) of an operating system of network storing system 200, and first data buffer zone 220, second module 230 and three module 240 operate in a core layer (Kernel level) of this operating system of network storing system 200.
Whether first module 210 is used to detect one first network terminal 260 has a storage data writing events to take place; Wherein network storing system 200 is connected to a network terminal machine 270 (network terminal machine 270 can be various electronic installations such as a personal computer or a notebook) through one first network terminal 260; Whether in other words, first module 210 is used to detect network terminal machine 270 has the action that storage data is write network storing system 200 through first network terminal 260.First data buffer zone 220 is coupled to first network terminal 260; And be used to store a storage data through first storage device 280 that network terminal 260 receives and desires to write to; For instance, this storage data can comprise message box DS1, the DS2... of a plurality of 1.5K hytes.Second data buffer zone 250 is used to store this storage data of desiring to write to storage device 280, and wherein storage device 280 is connected in network storing system 200 through one second network terminal 290, and storage device 280 can be a hard disk.
Second module 230 is coupled to storage device 280, and is used for one first Data Format Transform of this storage data is one second data format compatible with storage device 280; Three module 240 is coupled to first module 210, first data buffer zone 220 and second module 230; And when first module 210 detects this data writing events generation; First module 210 is notified three module 240 to control first data buffer zone, 220 these storage datas that it is stored and is write to second data buffer zone 250 in the three module 240; For instance; Second data buffer zone 250 can include a plurality of data buffer unit P0~P14; And each data buffer unit is a memory paging among a plurality of data buffer unit P0~P14; And first module 210 notify three module 240 to control a plurality of data buffer unit P0~P14 in second data buffer zone 250 that first data buffer zone, 220 these storage datas that it is stored write to three module 240; In addition, first data buffer zone 220 also can utilize direct memory access (DMA) (direct memory access, mode DMA) directly writes to a plurality of data buffer unit P0~P14 in second data buffer zone 250 with first data buffer zone, 220 these stored storage datas.This storage data that three module 240 will write second data buffer zone 250 is sent to second module 230, and second module 230 with this first Data Format Transform of this storage data for compatible these second data formats of storage device 280 and this storage data is write storage device 280.Note that at this above embodiments only illustrate as of the present invention, rather than restrictive condition of the present invention.
Please refer to Fig. 3, Fig. 3 illustrated is to summarize the schematic flow sheet of an embodiment that a kind of data that are used to promote a network store-service (Net Storage Service) of the present invention write the network storage method of usefulness according to the function mode of above-mentioned network storing system 200.If can obtain identical result substantially, then the step in the flow process not necessarily need be shone order shown in Figure 3 and carried out, and also not necessarily need be continuous, that is to say, can insert other step between these steps.In addition, note that network storage method of the present invention can utilize a software to realize, in other words, the network storage method that the present invention disclosed can be to be applied to a network storage server (network-attached storage, the software in NAS).Network storage method of the present invention includes the following step:
Step 300: beginning.
Step 310: one first module, one first data buffer zone, one second module and a three module are provided; Wherein this first data buffer zone is used to store a storage data that receives and desire to write to a storage device through a network terminal; And this three module includes one second data buffer zone; And this first module operation is in an application layer (Application level) of an operating system, and this first data buffer zone, this second module and this three module operate in a core layer (Kernel level) of this operating system.
Step 320: whether have a storage data writing events take place, if having, carry out step 330 if utilizing this first module to detect this network terminal; If do not have, carry out step 360.
Step 330: utilize this first module to notify this three module to control this first data buffer zone this storage data that it is stored and write to this second data buffer zone in this three module.
Step 340: this second data buffer zone that utilizes this three module will write this storage data directly is sent to this second module.
Step 350: utilizing this second module will be another data format compatible with a storage device from a Data Format Transform of this storage data that this three module received, and directly this storage data write this storage device then.
Step 360: finish.
In sum; The data that the network storing system and a kind of that a kind of data that can be used to promote a network store-service that the present invention disclosed write usefulness can be used to promote this network store-service write the network storage method of usefulness; Can when storage data, omit traditional operating system and do the normal process of file process; And only use module provided by the present invention to do the function that file stores, and network storing system of the present invention and network storage method can use new documentor in this second module and this three module, thus; Network storing system provided by the present invention and network storage method just can shorten the file process flow process in traditional network storing system significantly; And then the data of this network store-service are write enhancing efficiency surpass more than percent 50, for instance, if use traditional network storing system and network storage method; The data of this network store-service write usefulness and have only 13MB/s; Yet if use network storing system of the present invention and network storage method, the data of this network store-service write usefulness and just can be risen to more than the 20MB/s significantly.
The above is merely preferred embodiment of the present invention, and all change that is equal to or replacements of having done according to the scheme of spirit of the present invention and claims qualification all should belong to covering scope of the present invention.

Claims (14)

1. a network storing system is characterized in that, includes:
One first module, whether be used to detect a network terminal has a storage data writing events to take place;
One first data buffer zone is coupled to this network terminal, is used to store a storage data that receives and desire to write to a storage device through this network terminal;
One second module is coupled to this storage device, is used for one first Data Format Transform of this storage data is also write this storage device with this storage data for one second data format with this storage device compatibility; And
One three module is coupled to this first module, this first data buffer zone and this second module, and wherein this three module includes: one second data buffer zone is used to store this storage data of desiring to write to this storage device; When this first module detects this storage data writing events generation; This first module is notified this three module to control this first data buffer zone this storage data that it is stored and is write to this second data buffer zone; And this storage data that this three module will write this second data buffer zone directly is sent to this second module, and this second module will also write this storage device with this storage data for this second data format with this storage device compatibility from this first Data Format Transform of this storage data that this three module received.
2. network storing system according to claim 1 is characterized in that, this second data buffer zone includes a plurality of data buffer unit; And this first module is notified this three module to control this first data buffer zone this storage data that it is stored to write to this a plurality of data buffer unit.
3. network storing system according to claim 2 is characterized in that, each data buffer unit is a memory paging in these a plurality of data buffer unit.
4. network storing system according to claim 2 is characterized in that, this first data buffer zone is to utilize this directly that this first data buffer zone is stored storage data of mode of direct memory access (DMA) to write to these a plurality of data buffer unit.
5. network storing system according to claim 1; It is characterized in that; This first module operation is in an application layer of an operating system of this network storing system, and this first data buffer zone, this second data buffer zone, this second module and this three module operate in a core layer of this operating system of this network storing system.
6. network storing system according to claim 1 is characterized in that, this network storing system is a SAMBA server.
7. network storing system according to claim 1 is characterized in that, this storage device is a hard disk.
8. a network storage method is characterized in that, includes:
One first module, one first data buffer zone, one second module and a three module are provided; Wherein this first data buffer zone is used to store a storage data that receives and desire to write to a storage device through a network terminal, and this three module includes one second data buffer zone;
Whether utilize this first module to detect this network terminal has a storage data writing events to take place;
When this first module detects this storage data writing events generation, utilize this first module to notify this three module to control this first data buffer zone this storage data that it is stored and write to this second data buffer zone in this three module;
This second data buffer zone that utilizes this three module will write this storage data directly is sent to this second module; And
Utilizing this second module will be this second data format compatible with this storage device from this first Data Format Transform of this storage data that this three module received, directly this storage data write this storage device then.
9. network storage method according to claim 8 is characterized in that, this second data buffer zone includes a plurality of data buffer unit; And utilize this first module to notify this three module to control the step that this first data buffer zone this storage data that it is stored writes to this second data buffer zone to include in addition: utilize this first module to notify this three module to control this first data buffer zone this storage data that it is stored and write to this a plurality of data buffer unit.
10. network storage method according to claim 9 is characterized in that, each data buffer unit is a memory paging in these a plurality of data buffer unit.
11. network storage method according to claim 9 is characterized in that, this first data buffer zone is to utilize this directly that this first data buffer zone is stored storage data of mode of direct memory access (DMA) to write to these a plurality of data buffer unit.
12. network storage method according to claim 8; It is characterized in that; This first module operation is in an application layer of an operating system, and this first data buffer zone, this second data buffer zone, this second module and this three module operate in a core layer of this operating system.
13. network storage method according to claim 8 is characterized in that, this network storage method is applied to a SAMBA server.
14. network storage method according to claim 8 is characterized in that, this storage device is a hard disk.
CN2010102981920A 2010-09-21 2010-09-21 Network storage system and network storage method Pending CN102413157A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010102981920A CN102413157A (en) 2010-09-21 2010-09-21 Network storage system and network storage method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010102981920A CN102413157A (en) 2010-09-21 2010-09-21 Network storage system and network storage method

Publications (1)

Publication Number Publication Date
CN102413157A true CN102413157A (en) 2012-04-11

Family

ID=45915004

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010102981920A Pending CN102413157A (en) 2010-09-21 2010-09-21 Network storage system and network storage method

Country Status (1)

Country Link
CN (1) CN102413157A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080162795A1 (en) * 2006-12-28 2008-07-03 Genesys Logic, Inc. Hard disk cache device and method
US20080276032A1 (en) * 2004-08-27 2008-11-06 Junichi Iida Arrangements which write same data as data stored in a first cache memory module, to a second cache memory module
CN101833498A (en) * 2009-07-31 2010-09-15 北京伟晨豪嘉科技有限责任公司 Automatic detection system of embedded type system based on testing script technique

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080276032A1 (en) * 2004-08-27 2008-11-06 Junichi Iida Arrangements which write same data as data stored in a first cache memory module, to a second cache memory module
US20080162795A1 (en) * 2006-12-28 2008-07-03 Genesys Logic, Inc. Hard disk cache device and method
CN101833498A (en) * 2009-07-31 2010-09-15 北京伟晨豪嘉科技有限责任公司 Automatic detection system of embedded type system based on testing script technique

Similar Documents

Publication Publication Date Title
CN102223394B (en) Methods and servers to provide remote direct access of solid-state storage
US10162722B2 (en) Virtual machine aware replication method and system
CN103080918B (en) The interruption transmission of power optimization
US9558075B2 (en) Synthetic full backup generation
US8751547B2 (en) Multiple file system and/or multi-host single instance store techniques
US8935568B2 (en) System and method of replicating virtual machines for live migration between data centers
JP2005182781A (en) Persistent memory device for backup process checkpoint state
CN104603739A (en) Block-level access to parallel storage
CN102142032B (en) Method and system for reading and writing data of distributed file system
TW201508775A (en) Storage device and data processing method
TWI531901B (en) Data flush of group table
CN103955441A (en) Equipment management system, equipment management method and IO (Input/Output) expansion interface
CN103412822A (en) Operation method of non-volatile RAM, data operation method and relevant device
US8001303B2 (en) USB key emulation system to multiplex information
CN110633046A (en) Storage method and device of distributed system, storage equipment and storage medium
CN103885811A (en) Device, system and method for system-wide online migration of virtual machine system
CN103870762A (en) Partition accessing method and electronic equipment
CN104951528A (en) Data migration method and terminal
US20130024428A1 (en) Method and system for a fast full style system check using multithreaded read ahead
US9971532B2 (en) GUID partition table based hidden data store system
CN105068896A (en) Data processing method and device based on RAID backup
CN102413157A (en) Network storage system and network storage method
US20210124653A1 (en) Data write method and storage system
CN101493844B (en) Method and apparatus for implementing multiple main interfaces for embedded memory
US20180307684A1 (en) Method and Device for Reading and Writing Video Data in NAS Device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20120411