CN107291794A - A kind of method for improving database performance - Google Patents
A kind of method for improving database performance Download PDFInfo
- Publication number
- CN107291794A CN107291794A CN201710282888.6A CN201710282888A CN107291794A CN 107291794 A CN107291794 A CN 107291794A CN 201710282888 A CN201710282888 A CN 201710282888A CN 107291794 A CN107291794 A CN 107291794A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- equipment
- rear end
- headend equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/217—Database tuning
Abstract
The present invention relates to database field, a kind of method for improving database performance is disclosed, is comprised the following steps：(1) quantitative proportion of connection headend equipment and rear end equipment in database, headend equipment and rear end equipment is 1：4；(2) in reading database during data, searching target data first is carried out from headend equipment, such as fall short data are found in headend equipment, then read from rear end equipment, and write headend equipment simultaneously；Target data such as is found in headend equipment, then does not inquire about rear end equipment；(3) database is operated to the data of output.The present invention is by changing database bottom storage organization, and identical storage organization compares, and with same memory space, but uses lower cost, improves economic benefit；And the data reading mode in the present invention, improve several times reading performance and compatible existing hardware framework, as long as increase a little solid state hard disc can smooth upgrade, there is good durability and practical function in routine use.
Description
Technical field
The present invention relates to database field, more particularly to a kind of method for improving database performance.
Background technology
The performance of database is by processor, internal memory, the influence of IO many factors, wherein processor and internal memory can by compared with
Low cost changes addition hardware lifting.And the raising of IO performances, being increased sharply for cost can be brought with the increase of database, shadow
The principal element for ringing IO performances is the composition of bottom storage device.
The storage device that database bottom is used is generally divided into mechanical hard disk and the class of solid state hard disc two.Wherein, mechanical hard disk
With a long history, technology maturation is cheap, but it is long to there is the tracking time, the problem of random read-write poor performance；Solid state hard disc, bag
Containing SSD, NVME, Flash cards, the NVRAM of charged pool etc., inside is free of mechanical device and disc, and the tracking time is short, random read-write
Performance is strong, but price is high.
According to the common recognition of computer industry, under most scenes, the access frequency of data can all be followed " sixteen principles ".
I.e. 20% is dsc data, can often be read；80% is cold data, is seldom read, so it is low to there is data reading performance using redundancy
The problem of.
The content of the invention
The present invention improves database for the higher shortcoming of the liftings of IO in the prior art difficulty, cost there is provided one kind
The method of performance.
In order to solve the above-mentioned technical problem, the present invention is addressed by following technical proposals.
A kind of method for improving database performance, comprises the following steps：
(1) quantitative proportion of connection headend equipment and rear end equipment in database, headend equipment and rear end equipment is 1：4；
(2) in reading database during data, searching target data first is carried out from headend equipment, is such as found not in headend equipment
To target data, then read from rear end equipment, and write headend equipment simultaneously；Target data such as is found in headend equipment, then not
Inquire about rear end equipment；
(3) database is operated to the data of output, and operating process is：
1. the data of output such as can be searched out and read in headend equipment in database, and flag data is preceding column data,
Rear end equipment is not read then；
2. the data of output such as can not find in headend equipment in database, then find data in rear end equipment, after searching out,
Headend equipment is write the data into, and flag data is preceding column data, and legacy data is covered.
Preferably, rear end equipment equipment is mechanical hard disk；Headend equipment is solid state hard disc.
Preferably, in step (3), overwrite procedure is that the newest data of use time are placed on before queue most, and queue is most
The data markers are removed for failure if data afterwards such as overflow data internal memory.
The present invention is as a result of above technical scheme, with significant technique effect：The present invention is by changing database
Bottom storage organization, and identical storage organization compare, with same memory space, but use lower cost, improve through
Ji benefit；And the data reading mode in the present invention, several times reading performance and compatible existing hardware framework are improved, as long as
Increase a little solid state hard disc can smooth upgrade, in routine use have good durability and practical function.
Brief description of the drawings
Fig. 1 is a kind of schematic flow sheet for the method for improving database performance of the present invention.
Embodiment
The present invention is described in further detail with embodiment below in conjunction with the accompanying drawings.
As shown in figure 1, a kind of method for improving database performance, comprises the following steps：
(1) quantitative proportion of connection headend equipment and rear end equipment in database, headend equipment and rear end equipment is 1：4；
Rear end equipment equipment is mechanical hard disk；Headend equipment is solid state hard disc.
(2) in reading database during data, searching target data first is carried out from headend equipment, is such as found not in headend equipment
To target data, then read from rear end equipment, and write headend equipment simultaneously；Target data such as is found in headend equipment, then not
Inquire about rear end equipment；
(3) database is operated to the data of output, and operating process is：
1. the data of output such as can be searched out and read in headend equipment in database, and flag data is preceding column data,
Rear end equipment is not read then；
2. the data of output such as can not find in headend equipment in database, then find data in rear end equipment, after searching out,
Headend equipment is write the data into, and flag data is preceding column data, and legacy data is covered.
In step (3), overwrite procedure is that the newest data of use time are placed on before queue most, and the last data of queue are such as
Overflow data internal memory is then removed the data markers for failure.
The present invention is by changing database bottom storage organization, and identical storage organization compares, empty with identical storage
Between, but lower cost is used, improve economic benefit；And the data reading mode in the present invention, improve several times reading
Performance and compatible existing hardware framework, if increase a little solid state hard disc can smooth upgrade, have in routine use good
Good durability and practical function.
Embodiment 1
(1) bottom builds database using 10TB mechanical hard disks, and observation daily record application speed is 200k/s
(2) increase 1TB solid state hard discs, make and being read first from solid state hard disc during database access data, failing to find,
Then read from rear end equipment, and write headend equipment simultaneously；Now daily record application speed is still 200k/s.
(3) when the data in solid state hard disc gradually increase, the non-data reading speed accessed first reaches 30720k/s, first
The data of secondary access are still 200k/s.
(4) according to " sixteen principles ", data can be read in the case of 80% from solid state hard disc, performance obtains significant increase.
In a word, presently preferred embodiments of the present invention, all equalizations made according to scope of the present invention patent be the foregoing is only
Change and modification, should all belong to the covering scope of patent of the present invention.
Claims (3)
1. a kind of method for improving database performance, it is characterised in that comprise the following steps：
(1) quantitative proportion of connection headend equipment and rear end equipment in database, headend equipment and rear end equipment is 1：4；
(2) in reading database during data, searching target data first is carried out from headend equipment, is such as found in headend equipment less than mesh
Data are marked, then are read from rear end equipment, and write headend equipment simultaneously；Target data such as is found in headend equipment, then is not inquired about
Rear end equipment；
(3) database is operated to the data of output, and operating process is：
1. the data of output such as can be searched out and read in headend equipment in database, and flag data is preceding column data, then not
Read rear end equipment；
2. the data of output such as can not find in headend equipment in database, then data are found in rear end equipment, after searching out, by this
Data write headend equipment, and flag data is preceding column data, and legacy data is covered.
2. a kind of method for improving database performance according to claim 1, it is characterised in that：Rear end equipment equipment is machine
Tool hard disk；Headend equipment is solid state hard disc.
3. a kind of method for improving database performance according to claim 1, it is characterised in that：In step (3), covered
Journey is that the newest data of use time are placed on before queue most, by the data mark if queue last data such as overflow data internal memory
Failure is designated as to be removed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710282888.6A CN107291794A (en) | 2017-04-26 | 2017-04-26 | A kind of method for improving database performance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710282888.6A CN107291794A (en) | 2017-04-26 | 2017-04-26 | A kind of method for improving database performance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107291794A true CN107291794A (en) | 2017-10-24 |
Family
ID=60093923
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710282888.6A Pending CN107291794A (en) | 2017-04-26 | 2017-04-26 | A kind of method for improving database performance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107291794A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103279561A (en) * | 2013-06-13 | 2013-09-04 | 三珠数码软件开发（上海）有限公司 | Method for increasing random database data read-write speed |
| CN104462269A (en) * | 2014-11-24 | 2015-03-25 | 中国联合网络通信集团有限公司 | Isomerous database data exchange method and system |
| US20150379053A1 (en) * | 2009-04-14 | 2015-12-31 | International Business Machines Corporation | Managing database object placement on multiple storage devices |
-
2017
- 2017-04-26 CN CN201710282888.6A patent/CN107291794A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150379053A1 (en) * | 2009-04-14 | 2015-12-31 | International Business Machines Corporation | Managing database object placement on multiple storage devices |
| CN103279561A (en) * | 2013-06-13 | 2013-09-04 | 三珠数码软件开发（上海）有限公司 | Method for increasing random database data read-write speed |
| CN104462269A (en) * | 2014-11-24 | 2015-03-25 | 中国联合网络通信集团有限公司 | Isomerous database data exchange method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10921992B2 (en) | Method and system for data placement in a hard disk drive based on access frequency for improved IOPS and utilization efficiency | |
| US8161240B2 (en) | Cache management | |
| US10853238B2 (en) | Unaligned data coalescing | |
| EP4068070A1 (en) | Data storage method and apparatus, and storage system | |
| JP2849788B2 (en) | Database keyword indexing method | |
| US8051249B2 (en) | Method for preloading data to improve data-retrieval times | |
| US7769725B2 (en) | File profiling to minimize fragmentation | |
| US9996557B2 (en) | Database storage system based on optical disk and method using the system | |
| CN107025071A (en) | Non-volatile memory device and its garbage collection method | |
| KR100703807B1 (en) | Method and apparatus for managing block by update type of data in block type memory | |
| CN111026329A (en) | Key value storage system based on host management tile record disk and data processing method | |
| US20180196610A1 (en) | Database Memory Monitoring and Defragmentation of Database Indexes | |
| CN103455527A (en) | Handwritten document retrieval apparatus, handwritten document retrieval method and recording medium | |
| CN102609531A (en) | Method for pegging files according to keywords | |
| CN106897174B (en) | Fragment recovery method for MYSQL database | |
| US11630595B2 (en) | Methods and systems of efficiently storing data | |
| US9235352B2 (en) | Datastore for non-overwriting storage devices | |
| CN105260130B (en) | A kind of reading/writing method of Seagate hard-disk system file | |
| CN107451069A (en) | The rubbish recovering method of Solid-state disc array based on headspace | |
| CN107291794A (en) | A kind of method for improving database performance | |
| CN106873917A (en) | A kind of object storage system based on disk | |
| US20100241643A1 (en) | Magnetic disk device and metadata management system | |
| CN100444166C (en) | Position-based interface access method and device for FAT file system | |
| CN2854694Y (en) | Prolonging service life of internal or external storage by long service life non-volatility storage chip | |
| RU2757659C1 (en) | Magnetic drive with divided areas |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171024 |