CN107145414B - Method and system for testing distributed object storage - Google Patents

Method and system for testing distributed object storage Download PDF

Info

Publication number
CN107145414B
CN107145414B CN201710298743.5A CN201710298743A CN107145414B CN 107145414 B CN107145414 B CN 107145414B CN 201710298743 A CN201710298743 A CN 201710298743A CN 107145414 B CN107145414 B CN 107145414B
Authority
CN
China
Prior art keywords
storage cluster
target storage
medical information
imaging system
data parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710298743.5A
Other languages
Chinese (zh)
Other versions
CN107145414A (en
Inventor
刘景洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Inspur Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co Ltd filed Critical Suzhou Inspur Intelligent Technology Co Ltd
Priority to CN201710298743.5A priority Critical patent/CN107145414B/en
Publication of CN107145414A publication Critical patent/CN107145414A/en
Application granted granted Critical
Publication of CN107145414B publication Critical patent/CN107145414B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/22Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
    • G06F11/2273Test methods

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The invention discloses a method and a system for testing distributed object storage, wherein the method comprises the following steps: acquiring data parameters of a medical information imaging system; establishing a model for simulating data parameters of the medical information imaging system; performing a preset test on the target storage cluster through the model; and analyzing the test result to obtain the operation performance index of the target storage cluster to the medical information imaging system. Before the medical information-based image system is established, firstly, data of the medical information-based image system is simulated, corresponding tests are carried out on a target storage cluster, the operation performance index of the target storage cluster is obtained according to the test result so as to judge whether the target storage cluster meets the requirements or not, if the target storage cluster does not meet the requirements, other storage clusters can be selected or the storage cluster can be improved until the requirements are met, so that the requirements of medical information-based image processing on a server are met, and the condition of high cost is avoided.

Description

Method and system for testing distributed object storage
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method and a system for testing distributed object storage.
Background
With the development of information technology, the processing of regional images has been rapidly developed.
The regional image system comprises two core contents of image calculation and data influence service, the image calculation technology adopts a high-performance computing cluster (HPC cluster) to assist a GPU with high computing power, the functions of image big data calculation, display, reconstruction and the like are achieved, and the image data service solves the problems of full image, full processing, full analysis and full parallel new-generation medical informatization image processing and analysis in any network (including wireless 3G) environment. In the medical information-based image processing system, if the server for processing data by the system cannot meet the requirement, the processing of the medical information-based data is seriously influenced, and serious consequences are caused, and if the server is replaced at the moment, higher cost is caused.
Therefore, how to not only ensure the requirement of the medical information-based image processing on the server, but also avoid the situation of high cost caused by replacing the server which does not meet the requirement is a technical problem to be solved by the technical personnel in the field at present.
Disclosure of Invention
The invention aims to provide a method and a system for testing distributed object storage, which can not only ensure the requirement of medical information-based image processing on a server, but also avoid the condition of overhigh cost caused by replacing the server which does not meet the requirement.
In order to solve the technical problems, the invention provides the following technical scheme:
a method for testing distributed object storage, comprising:
acquiring data parameters of a medical information imaging system;
establishing a model for simulating data parameters of the medical information imaging system;
performing preset test on the target storage cluster through the model;
and analyzing the test result to obtain the operation performance index of the target storage cluster to the medical information imaging system.
Preferably, the establishing a model for simulating data parameters of the medical information imaging system includes:
and simulating the image-text data parameters and the image data parameters of the medical information imaging system by a cosbench tool, and establishing a corresponding model.
Preferably, the performing a preset test on the target storage cluster through the model includes:
and performing preset read-write operation on the target storage cluster through the cosbench tool.
Preferably, the analyzing the test result to obtain the operation performance index of the target storage cluster for the medical information imaging system includes:
acquiring the network bandwidth and the writing and reading rate information of the target storage cluster according to the preset reading and writing operation;
analyzing and processing the network bandwidth and the written and read rate information, judging whether the target storage cluster meets a preset operation performance index, and acquiring the expansion performance information and the linear performance degree information of the target storage cluster.
A system for testing distributed object storage, comprising:
the acquisition module is used for acquiring data parameters of the medical information imaging system;
the modeling module is used for establishing a model for simulating data parameters of the medical information imaging system;
the test module is used for carrying out preset test on the target storage cluster through the model;
and the analysis module is used for analyzing the test result and acquiring the operation performance index of the target storage cluster to the medical information imaging system.
Preferably, the modeling module comprises:
the simulation unit is used for simulating image-text data parameters and image data parameters of the medical information imaging system through a cosbench tool;
and the modeling unit is used for establishing a corresponding model according to the data simulated by the simulation unit.
Preferably, the test module comprises:
the read operation testing unit is used for performing preset read operation on the target storage cluster through the cosbench tool;
and the write operation testing unit is used for carrying out preset write operation on the target storage cluster through the cosbench tool.
Preferably, the analysis module comprises:
the acquisition unit is used for acquiring the network bandwidth and the writing and reading rate information of the target storage cluster according to the preset reading and writing operation;
and the analysis unit is used for analyzing and processing the network bandwidth and the written and read rate information, judging whether the target storage cluster meets a preset operation performance index or not, and acquiring the expansion performance information and the linear performance degree information of the target storage cluster.
Compared with the prior art, the technical scheme has the following advantages:
the invention provides a method for testing distributed object storage, which comprises the following steps: acquiring data parameters of a medical information imaging system; establishing a model for simulating data parameters of the medical information imaging system; performing a preset test on the target storage cluster through the model; and analyzing the test result to obtain the operation performance index of the target storage cluster to the medical information imaging system. Before the medical information-based image system is established, firstly, data of the medical information-based image system is simulated, corresponding tests are carried out on a target storage cluster, the running performance index of the target storage cluster is obtained according to the test result to judge whether the target storage cluster meets the requirements or not, if the target storage cluster does not meet the requirements, other storage clusters can be selected or the storage cluster can be improved until the requirements are met, so that the requirements of medical information-based image processing on the server can be met, and the condition of overhigh cost caused by replacing the server which does not meet the requirements can be avoided.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow diagram of a method for testing a distributed object store in accordance with an embodiment of the present invention;
FIG. 2 is a block diagram of a system for testing distributed object storage according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a hardware structure of a system for testing a distributed object storage according to an embodiment of the present invention.
Detailed Description
The core of the invention is to provide a method and a system for testing distributed object storage, which can not only ensure the requirements of medical information-based image processing on a server, but also avoid the condition of overhigh cost caused by replacing the server which does not meet the requirements.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
In the following description, specific details are set forth in order to provide a thorough understanding of the present invention. The invention can be implemented in a number of ways different from those described herein and similar generalizations can be made by those skilled in the art without departing from the spirit of the invention. The invention is therefore not limited to the specific implementations disclosed below.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for testing a distributed object store according to an embodiment of the present invention.
One embodiment of the present invention provides a method for testing distributed object storage, comprising:
s11: and acquiring data parameters of the medical information imaging system. The data parameters of the medical information imaging system comprise image-text data parameters and image data parameters of the medical information imaging system.
S12: and establishing a model for simulating data parameters of the medical information imaging system.
In one embodiment of the present invention, the modeling of data parameters for simulating a medical information-based imaging system includes: and simulating image-text data parameters and image data parameters of the medical information imaging system by using a cosbench tool, and establishing a corresponding model.
S13: and carrying out preset tests on the target storage cluster through the model.
Performing a preset test on the target storage cluster through the model, wherein the preset test comprises the following steps: and performing preset read-write operation on the target storage cluster through a cosbench tool.
S14: and analyzing the test result to obtain the operation performance index of the target storage cluster to the medical information imaging system.
Analyzing the test result to obtain the operation performance index of the target storage cluster to the medical information imaging system, wherein the operation performance index comprises the following steps: acquiring network bandwidth and writing and reading rate information of a target storage cluster according to preset reading and writing operations; analyzing and processing the network bandwidth and the written and read rate information, judging whether the target storage cluster meets a preset operation performance index, and acquiring the expansion performance information and the linear performance degree information of the target storage cluster.
In the embodiment, by installing a testing tool such as a cosbench tool on a target storage cluster such as a server, the data of the regional image system in the medical industry is simulated, and then performing read-write operation on the target storage cluster, the requirement of the distributed storage system on the data performance of the regional image service, and the expansibility and linear performance degree of the storage system are verified. Before the medical information-based image system is established, firstly, data of the medical information-based image system is simulated, corresponding tests are carried out on a target storage cluster, the running performance index of the target storage cluster is obtained according to the test result to judge whether the target storage cluster meets the requirements or not, if the target storage cluster does not meet the requirements, other storage clusters can be selected or the storage cluster can be improved until the requirements are met, so that the requirements of medical information-based image processing on the server can be met, and the condition that cost is too high due to the fact that the server which does not meet the requirements is replaced can be avoided.
Referring to fig. 2 and fig. 3, fig. 2 is a schematic structural diagram of a system for testing a distributed object storage according to an embodiment of the present invention; fig. 3 is a schematic diagram of a hardware structure of a system for testing a distributed object storage according to an embodiment of the present invention.
Accordingly, an embodiment of the present invention further provides a system for testing distributed object storage, including: an obtaining module 21, configured to obtain data parameters of the medical information imaging system; the modeling module 22 is used for establishing a model for simulating data parameters of the medical information imaging system; the test module 23 is configured to perform a preset test on the target storage cluster through the model; and the analysis module 24 is configured to analyze the test result and obtain an operation performance index of the target storage cluster for the medical information imaging system.
Further, the modeling module includes: the simulation unit is used for simulating image-text data parameters and image data parameters of the medical information imaging system through a cosbench tool; and the modeling unit is used for establishing a corresponding model according to the data simulated by the simulation unit.
The test module includes: the read operation testing unit is used for performing preset read operation on the target storage cluster through a cosbench tool; and the write operation testing unit is used for performing preset write operation on the target storage cluster through the cosbench tool.
The analysis module comprises: the acquisition unit is used for acquiring the network bandwidth and the writing and reading rate information of the target storage cluster according to preset reading and writing operations; and the analysis unit is used for analyzing and processing the network bandwidth and the written and read rate information, judging whether the target storage cluster meets a preset operation performance index or not, and acquiring the expansion performance information and the linear performance degree information of the target storage cluster.
Before the medical information-based image system is established, firstly, data of the medical information-based image system is simulated, corresponding tests are carried out on a target storage cluster, the running performance index of the target storage cluster is obtained according to the test result to judge whether the target storage cluster meets the requirements or not, if the target storage cluster does not meet the requirements, other storage clusters can be selected or the storage cluster can be improved until the requirements are met, so that the requirements of medical information-based image processing on the server can be met, and the condition of overhigh cost caused by replacing the server which does not meet the requirements can be avoided.
In this embodiment, preferably, the system builds a distributed storage cluster based on an S3 protocol, and includes a terminal access layer, a pressure layer, and a storage layer, where the terminal access layer communicates with the pressure layer through a local area network, and the pressure layer and the storage layer are connected by using a ten-gigabit optical fiber through an exchange. The terminal access layer comprises a plurality of terminals and switches, the terminals are connected with the local area network through the switches, meanwhile, the SSH protocol is adopted to access the pressure servers of the pressure layer, the pressure layer preferably comprises 3 pressure servers to deploy pressure application programs, the actual user concurrence scene of the module is used for carrying out link aggregation on the storage test, and 4 ten-gigabit network cards/ports. The storage layer comprises 5 node distributed storage servers for storing image data of user concurrent scenes. That is, the terminal access layer implements the functions of the acquisition module and the modeling module, and the pressure layer and the storage layer implement the functions of the testing module and the analysis module.
Specifically, the network is assigned as follows: the pressure server and the storage server are respectively distributed with 1 IPMI, 1 management network port and 4 ten-million IPs, 4 ten-million network ports of each pressure server are aggregated and bound, and 4 ten-million network ports of each storage server are bound in pairs and used for an external network and an internal network.
The test of the test module comprises the test by two modes of disk writing and disk reading, and the disk writing test method comprises the following steps: the 3 pressure servers simulate 40 and send 100G data to the 5 storage servers respectively; the 3 pressure servers simulate 80 and send the data to the 5 storage servers respectively, and send 100G data; the 3 pressure servers simulate 120 and transmit 100G data to the 5 storage servers respectively. The disk read test method is as follows: the 3 pressure servers respectively simulate 40 concurrence to the 5 storage servers and read 100G data; the 3 pressure servers respectively simulate 80 concurrence to the 5 storage servers and read 100G data; the 3 pressure servers simulate 120 concurrence to the 5 storage servers respectively and read 100G data.
Testing by two modes of disk writing and disk reading to obtain related test data and analyzing, wherein the analysis of the disk writing data is as follows: the 3 pressure servers simulate 40 concurrent transmissions to the 5 storage servers respectively, and check the total bandwidth of the pressure end and the write-in rate of the storage end under the condition of transmitting 100G data; the 3 pressure servers simulate 40 concurrent transmissions to the 5 storage servers respectively, and check the total bandwidth of the pressure end and the write-in rate of the storage end under the condition of transmitting 100G data; and (3) simulating 40 and sending the data to 5 storage servers respectively by the pressure servers, and checking the total bandwidth of the pressure end and the write-in rate of the storage end under the condition of sending 100G of data.
Disk read data analysis was as follows: the 3 pressure servers respectively simulate 40 concurrences to the 5 storage servers, and check the total bandwidth of the pressure end and the reading rate of the storage end under the condition of reading 100G of data; the 3 pressure servers respectively simulate 40 concurrences to the 5 storage servers, and check the total bandwidth of the pressure end and the reading rate of the storage end under the condition of reading 100G of data; and (3) simulating 40 concurrency from the pressure servers to the 5 storage servers respectively, and checking the total bandwidth of the pressure end and the reading rate of the storage end under the condition of reading 100G data.
And summarizing after analyzing the test data in the two modes of disk writing and disk reading to obtain the data performance requirement of the distributed storage system on the regional image service and the expansibility and linear expression degree of the storage system.
In summary, before the medical information-based imaging system is established, the method and the system for testing distributed object storage provided by the present invention simulate data of the medical information-based imaging system, perform a corresponding test on the target storage cluster, obtain an operation performance index of the target storage cluster according to a test result to determine whether the target storage cluster meets requirements, and if not, select another storage cluster or improve the storage cluster until the requirements are met, thereby not only ensuring the requirements of the medical information-based imaging processing on the server, but also avoiding the situation of too high cost caused by replacing the server which does not meet the requirements.
A method and system for testing distributed object storage in accordance with the present invention has been described in detail. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.

Claims (6)

1. A method for testing a distributed object store, comprising:
acquiring data parameters of a medical information imaging system; the data parameters of the medical information imaging system comprise image-text data parameters and image data parameters of the medical information imaging system;
establishing a model for simulating data parameters of the medical information imaging system;
performing preset test on the target storage cluster through the model;
analyzing the test result to obtain the operation performance index of the target storage cluster to the medical information imaging system;
wherein the analyzing the test result to obtain the operation performance index of the target storage cluster to the medical information-based imaging system includes:
acquiring network bandwidth and writing and reading rate information of the target storage cluster according to preset reading and writing operations;
analyzing and processing the network bandwidth and the written and read rate information, judging whether the target storage cluster meets a preset operation performance index, and acquiring the expansion performance information and the linear performance degree information of the target storage cluster.
2. The method of claim 1, wherein the modeling data parameters that simulate the medical imaging system comprises:
and simulating the image-text data parameters and the image data parameters of the medical information imaging system by a cosbench tool, and establishing a corresponding model.
3. The method of claim 2, wherein the performing the predetermined test on the target storage cluster through the model comprises:
and performing preset read-write operation on the target storage cluster through the cosbench tool.
4. A system for testing distributed object storage, comprising:
the acquisition module is used for acquiring data parameters of the medical information imaging system; the data parameters of the medical information imaging system comprise image-text data parameters and image data parameters of the medical information imaging system;
the modeling module is used for establishing a model for simulating data parameters of the medical information imaging system;
the test module is used for carrying out preset test on the target storage cluster through the model;
the analysis module is used for analyzing the test result and acquiring the operation performance index of the target storage cluster to the medical informatization image system;
wherein the analysis module comprises:
the acquisition unit is used for acquiring the network bandwidth and the writing and reading rate information of the target storage cluster according to preset reading and writing operations;
and the analysis unit is used for analyzing and processing the network bandwidth and the written and read rate information, judging whether the target storage cluster meets a preset operation performance index or not, and acquiring the expansion performance information and the linear performance degree information of the target storage cluster.
5. The system of claim 4, wherein the modeling module comprises:
the simulation unit is used for simulating image-text data parameters and image data parameters of the medical information imaging system through a cosbench tool;
and the modeling unit is used for establishing a corresponding model according to the data simulated by the simulation unit.
6. The system of claim 5, wherein the testing module comprises:
the read operation testing unit is used for performing preset read operation on the target storage cluster through the cosbench tool;
and the write operation testing unit is used for carrying out preset write operation on the target storage cluster through the cosbench tool.
CN201710298743.5A 2017-04-27 2017-04-27 Method and system for testing distributed object storage Active CN107145414B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710298743.5A CN107145414B (en) 2017-04-27 2017-04-27 Method and system for testing distributed object storage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710298743.5A CN107145414B (en) 2017-04-27 2017-04-27 Method and system for testing distributed object storage

Publications (2)

Publication Number Publication Date
CN107145414A CN107145414A (en) 2017-09-08
CN107145414B true CN107145414B (en) 2021-03-09

Family

ID=59774998

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710298743.5A Active CN107145414B (en) 2017-04-27 2017-04-27 Method and system for testing distributed object storage

Country Status (1)

Country Link
CN (1) CN107145414B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109951506B (en) * 2017-12-20 2021-11-30 中移(苏州)软件技术有限公司 Method and equipment for evaluating performance of storage cluster
CN111104221A (en) * 2019-12-13 2020-05-05 烽火通信科技股份有限公司 Object storage testing system and method based on Cosbench cloud platform

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020719A (en) * 2016-05-13 2016-10-12 广东电网有限责任公司信息中心 Initial parameter configuration method of distributed storage system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9354964B2 (en) * 2014-05-13 2016-05-31 Netapp, Inc. Tag based selection of test scripts for failure analysis

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020719A (en) * 2016-05-13 2016-10-12 广东电网有限责任公司信息中心 Initial parameter configuration method of distributed storage system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
海量规模下高性能对象存储服务技术的研究;郑庆;《中国优秀硕士学位论文全文数据库 信息科技辑》;20131215;第三章第3.1-3.5节,图3-11 *

Also Published As

Publication number Publication date
CN107145414A (en) 2017-09-08

Similar Documents

Publication Publication Date Title
CN107092541A (en) A kind of method that utilization virtual machine carries out storage performance test
CN103853639B (en) Self-testing system and the method for self-test function logic module
CN105738854A (en) Simulation memory test board system for intelligent ammeter embedded application and test method
CN104331487B (en) The processing method and processing device of log
CN103984619A (en) Performance monitoring method of network storage system
CN111181800B (en) Test data processing method and device, electronic equipment and storage medium
CN104022913B (en) For method of testing and the device of data cluster
CN104660471A (en) Method for automatically testing PCIE-SSD transmitting velocity and band width under Linux
CN104317684A (en) Method for synchronously automatic testing of bandwidth and transmission rate of multiple USB (Universal Serial Bus) interfaces
CN104850480A (en) Method and device for testing performance of hard disk of high-density storage server
CN108984331A (en) A kind of server hard disc number display device, method in order
US20140350910A1 (en) Time-segmented statistical i/o modeling
CN107145414B (en) Method and system for testing distributed object storage
CN103198001B (en) Storage system capable of self-testing peripheral component interface express (PCIE) interface and test method
CN104639345B (en) A kind of NTB performance test methods and system
CN100568827C (en) A kind of network pressure testing method of multithreading
CN114528792A (en) Chip verification method and device, electronic equipment and storage medium
CN108154891A (en) A kind of memory module based on the mono- slot structures of VPX
CN104378626A (en) Time delay testing system of image transmitting system and method for testing time delay testing system
CN106528803B (en) A kind of MongoDB database object replica delay monitoring method and device
CN107395456A (en) Distributed file system stream directly deposits method of testing and platform
CN101883019A (en) Test method for verifying video application of storage server
CN109597724A (en) Service stability measurement method, device, computer equipment and storage medium
CN115037651B (en) RDMA bandwidth transmission test method, system and storage medium
CN105279007A (en) Multi-core processor simulation method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210205

Address after: Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province

Applicant after: SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd.

Address before: Room 1601, floor 16, 278 Xinyi Road, Zhengdong New District, Zhengzhou City, Henan Province

Applicant before: ZHENGZHOU YUNHAI INFORMATION TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant