Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below by specific embodiment and referring to accompanying drawing, the present invention is described in detail.
Storage management interface standard SMI-S (Storage Management Initiative specification, be called for short SMI-S), be used for monitoring and manage memory device from different vendor, its technical foundation is by DMTF (Distributed Management Task Force, the distributed task management tissue) CIM of Zhi Dinging (Common Information Model, the general information module) and WBEM (Web-Based Enterprise Management is based on the Techniques of Enterprise Management of Web).The target of SMI-S is, standardized communication mode is provided between memory device in storage networking and the management software, thereby make storage administration realize manufacturer's independence (vendor-neutral), make storage management system can realize differentiating, classify, monitoring and control the ability of physics and logical resource, improve the efficiency of management, reduce handling cost, promote the development of storage networking.
Simple Network Management Protocol (SNMP:Simple Network Management Protocol) is the cover Network Management Protocol by internet engineering duty group (IETF:Internet Engineering Task Force) definition.This agreement is based on simple gateway monitoring protocol (SGMP:Simple Gateway Monitor Protocol).Utilize SNMP, management work station can telemanagement all support the network storage equipment of this agreement, comprise the monitoring network state, revise network storage equipment configuration, receive network event warning etc.
CLI is the abbreviation of Command Line Interface, i.e. Command Line Interface.The CLI interface is the interface that the all-router product all provides, as CISCO, and LUCENT, Huawei etc. are the standards of router product.Using CLI to have request for utilization low (only needing serial port) uses easily, function expands advantage easily, particularly as a lot (as 10) when the platform router device need dispose, can finish the configuration of all-router by the COPY/PASTE function very soon, not need platform configuration by IE.
Among the present invention, the monitor data conversion method starts by the mode of acquisition tasks.Acquisition tasks is divided into real-time acquisition tasks and periodicity acquisition tasks, acquisition tasks is sent by the third party system in real time by the third party in real time, periodically acquisition tasks is created and is stored in the configuration database according to gathering needs by the user, with regular transmission and execution acquisition tasks.
Each acquisition tasks all comprises storage device type sign and SMI-S index to be collected, and wherein, the storage device type sign is made up of character string or numeral, and is corresponding one by one with storage device type.Storage device type comprises the specific product model under trade name and this memory device, and for example: one type is the tape library of IBM3584.The SMI-S index is meant the standard index that relates in the SMI-S standard, for example: the performance of memory device, flow, capacity, network service situation, packet loss; Partition size in the storage device configurations information, manufacturer, title; Fan quality in the storage device status, power supply situation or the like.Each acquisition tasks is identified uniquely by a task ID, and task ID can be made up of character string or numeral, and acquisition tasks is at one type memory device.
Method flow of the present invention as shown in Figure 1, the monitor data conversion method towards the memory device of radio, TV and film industries may further comprise the steps:
Step 101: obtain acquisition tasks, comprise storage device type sign and SMI-S index to be collected in this task;
In above-mentioned steps,, obtain acquisition tasks by calling or load existing acquisition tasks;
Step 102: according to sign of the storage device type in the described task and SMI-S index, from the connection parameter of configuration database load store device type, memory device and the conversion formula that is used for memory device collection item ID is converted to the SMI-S index;
Described configuration database, be used for storage of collected task executions parameter, comprise: storage device type and trade name, collection item, be used for conversion formula, memory device that memory device collection item ID converts the SMI-S index to are connected the configuration information and the operational factor of parameter, various acquisition modes;
According to the storage device type in described task sign from configuration database load store device type and memory device be connected parameter, from configuration database, load the conversion formula that is used for memory device collection item ID is converted to the SMI-S index according to sign of the storage device type in the described task and SMI-S index;
Described collection item is meant the most basic monitor data that can be gathered in the memory device, for example: the capacity of C dish.Definition has acquisition mode and parameter for each gathers separately, and is stored in and is convenient to change and expansion in the configuration database, calls by unified configuration management interface during use.
Described memory device connects parameter, comprising: IP address, user name, password etc. connect the parameter of memory device.
Conversion formula is used to realize a SMI-S index and memory device computing and the format conversion between gathering, and conversion formula and storage device type, SMI-S index are corresponding one by one, and the result that will define is kept in the configuration database in the mode of formula text.
Be used for memory device collection item ID is converted to the conversion formula of SMI-S index, form by SMI-S index, a collection ID and operational symbol.Wherein, operational symbol comprises various functions, adds, subtracts, multiplication and division, bracket, and various functions mainly comprise difference, speed, sue for peace, average etc.; Each is gathered an ID and identifies one uniquely and gather, and the attribute of gathering an ID comprises: the collection item of this collections ID sign, this gathers corresponding acquisition mode sign, carries out described acquisition mode and can gather this and carry out data acquisition.
Conversion formula is stored in the configuration management system/library with the form of formula tabulation, along with the increase of conversion formula enlarges compatibility to storage device type gradually.
Step 103: decompose the collection item ID in the described conversion formula, will have the identical collection item of gathering an ID and carry out merger;
In acquisition tasks, for the memory device of same type, according to the difference of SMI-S index, conversion formula is also different, therefore, the collection item that collection item ID in the conversion formula is identified may overlap, and only gathers once in order to ensure identical collection item, just need decompose according to gathering a sign, decompose the collection item ID in these all conversion formulas of gathering use, the collection item of identical ID only keeps one, and all the other filter out, to finish merger.For example: storage device type is that Promise, SMI-S index are the pairing conversion formula A of disk total volume, with storage device type be that Promise, SMI-S index are the pairing conversion formula B of a certain disk partition capacity, collection item ID among conversion formula A and the conversion formula B will repeat, the capacity sum of disk total volume=each disk partition, at this moment the capacity that has all comprised a certain disk partition needs to decompose merger.
Step 104: based on the collection item after the merger, the described acquisition mode of gathering item of merger;
The memory device of same type, according to the difference of SMI-S index, or the difference of memory device self support attribute, may there be multiple acquisition mode, at this moment, need carry out merger to acquisition mode, be specially:
Based on the collection item after the merger, carry out merger according to described acquisition mode sign of gathering item, extract identical acquisition mode.
Step 105: load the configuration information and the operational factor of described acquisition mode from configuration database, and with the configuration parameter of the collection item after the merger as corresponding acquisition mode;
Described configuration information comprises: protocol name, version, load path etc.For example, the protocol name of acquisition mode SNMP v2 is SNMP, and version is v2, and load path is promptly carried out the address that this acquisition mode will be visited; Order, MIB (management information bank defined the addressable network equipment and attribute thereof, by object identifier unique appointment), the OID parameters such as (Object Identifier object identifiers) of operational factor for carrying out;
Step 106: judging whether can the described acquisition mode of successful execution, if cannot, execution in step 107, if can, execution in step 108;
Reason that can't the described acquisition mode of successful execution comprises: acquisition parameter configuration error, apparatus for acquiring and storing connect parameter error, memory device operation irregularity etc.;
Step 107: the failure daily record carried out in record;
Described log record content comprises: gather date, apparatus for acquiring and storing, collection item, failure cause, regularly check and carry out the failure daily record, be convenient in time safeguard and adjust, guarantee that data acquisition can successful execution;
If, can omit step 107 in order to simplify procedures;
Step 108: carry out described acquisition mode acquisition monitoring data and, obtain the monitor data of user-defined format by the user-defined format translation data;
Described user-defined format is meant and the image data form that collects is carried out self-defined that guarantee no matter to carry out any acquisition mode, the collection item number that collects is according to the data that are consolidation form; For the acquisition mode that does not meet standard agreement, can realize that acquisition mode newly developed will be followed the acquisition mode interface standard that defines in the user-defined format could realize slitless connection with converter, thereby possesses extensibility by secondary development;
Understand the acquisition mode that uses more than one in the data acquisition, acquisition mode commonly used at present is as follows:
SNMP acquisition mode: by the MIB storehouse acquisition monitoring data of snmp protocol and memory device;
SMI-S acquisition mode: by the monitor data of SMI-S standard acquisition memory device;
CLI acquisition mode:, use modes such as Telnet or SSH to connect, and its method of long-range execution is obtained monitor data by the pipe memory device by the command line interface that memory device provides;
File acquisition mode: by files such as privately owned configuration of memory device or daily record are resolved to obtain monitor data;
Other acquisition modes: API or other modes of calling memory device by secondary development are obtained the memory device monitor data, and the acquisition mode of secondary development will be followed collector calling interface standard of the present invention;
Collection adapter calling interface by the definition standard can guarantee that the image data form that returns is the user-defined format of stipulating among the present invention.
Step 109: according to conversion formula described user-defined format data are carried out computing, conversion, obtain the SMI-S index;
Among the collection item ID with the user-defined format data substitution conversion formula that collects, carry out arithmetic and/or functional operation, the row format of going forward side by side conversion, formulae results is the SMI-S index.
The operation logic of conversion formula is: when carry out that acquisition mode carries out data acquisition to the collection item that is designated this acquisition mode and by the user-defined format translation data after, the data that obtain all are self-defining form, with the collection item ID in the user-defined format data substitution formula that collects, carry out arithmetic and/or functional operation, the row format of going forward side by side conversion, the user-defined format data are converted to the SMI-S achievement data, are the result data of formula output.
Conversion formula has characterized the relation between a SMI-S index to be collected and the collection ID, now illustrates, and supposes that the SMI-S index is f (x, y, z), gathering an ID is x, y, z, f (x, y, z) with x, y, z be various functions, add, subtract, the relation of multiplication and division, bracket, for example: f (x, y, z)=f (x, y) * f (y, z)+z}, wherein, f (x, y), (y z) is various functions to f, specifically getting what function determines according to various collection needs, function commonly used comprises: difference, speed, sue for peace, average, wherein
The value of difference=twice collection item poor;
Speed=difference is divided by the mistiming between twice collection;
Can logging timestamp when the timestamp the when mistiming between described twice collection is twice data acquisition in front and back poor, each data acquisition, when computation rate, the value of described timestamp can be passed in the formula.
In the above-mentioned example, conversion formula be f (x, y, z)=f (x, y) * { (y z)+z}, composes the value of the collection item that collects to gathering an ID f, is respectively x, y, z, and (x, y z), are the SMI-S index to obtain f by arithmetic and/or functional operation;
For example: with type be the memory device of Promise, and the SMI-S index is that the conversion formula of disk remaining space correspondence is:
Disk remaining space=raidv4PhysicalCapacity-raidv4UsedCapacity
In the above-mentioned formula, " raidv4PhysicalCapacity " and " raidv4UsedCapacity " is for gathering an ID, character string by shorthand is formed, has uniqueness, it is the disk total volume of Promise that " raidv4PhysicalCapacity " uniquely identified is gathered item, " raidv4UsedCapacity " uniquely identified collection item is that the disk of Promise has used capacity, if above-mentioned two acquisition modes of gathering the item correspondence are SNMP v1 (the v1 version of SNMP), then carry out SNMP v1 collection and change the disk total volume of Promise and the data that disk has used capacity by user-defined format, be respectively disk total volume=3000, disk has used capacity=1000, the data that collect are self-defining form, the data that obtain are distinguished among the collection item ID " raidv4PhysicalCapacity " and " raidv4UsedCapacity " of substitution formula, be raidv4PhysicalCapacity=3000, raidv4UsedCapacity=1000, carry out subtraction according to conversion formula, disk remaining space=raidv4PhysicalCapacity-raidv4UsedCapacity=3000-1000=2000 then, the row format of going forward side by side conversion, user-defined format is converted to the SMI-S index, obtains SMI-S index=2000.
Similarly, conversion formula also can carry out the multiplication and division computing, for example: have the disk partition M of same capability individual on the memory device of certain type, when then the SMI-S index is the total volume of the type memory device, utilize formula to carry out multiplying, i.e. total volume=disk partition capacity * M.
Conversion formula also is used for the conversion of measurement unit, and for example, the measurement unit of the value of the collection item that collects is KB, and the measurement unit of SMI-S index is MB, at this moment needs to be undertaken by conversion formula the conversion of measurement unit, and KB is scaled MB.
Step 110: above-mentioned SMI-S index is encapsulated according to SMI-S authority data form;
Encapsulation is that described SMI-S achievement data is carried out stylistic standard according to SMI-S authority data form, becomes the SMI-S cannonical format data of standard.For example, if the result of formula operation is: the SMI-S index is " 2000 ", and the result after the encapsulation is exemplified as " disk remaining space=2000 ", is the SMI-S cannonical format;
Wherein, step 110 is a preferred steps, can omit.
Converter structure of the present invention as shown in Figure 2, the monitor data converter towards the memory device of radio, TV and film industries comprises: acquisition index initialization module 201, index conversion process module 202, gather execution module 203, configuration database 204, wherein:
Acquisition index initialization module 201, be used to obtain acquisition tasks, according to sign of the storage device type in the described acquisition tasks and SMI-S index, from the connection parameter of configuration database load store device type, memory device and the conversion formula that is used for memory device collection item ID is converted to the SMI-S index;
Index conversion process module 202, be used for decomposing the collection item ID of described conversion formula, item is gathered in merger, based on the collection item after the merger, the described acquisition mode of gathering item of merger after the pending data collection is finished, receives and gathers the user-defined format data that execution module 203 transmits again, according to conversion formula described data are carried out computing, conversion, obtain the SMI-S index;
Gather execution module 203, be used for loading the configuration information and the operational factor of acquisition mode from configuration database, and with the configuration parameter of the collection item after the merger as corresponding acquisition mode; When can not the described acquisition mode of successful execution, the failure daily record carried out in record, when can the described acquisition mode of successful execution, carry out described acquisition mode acquisition monitoring data and by the user-defined format translation data, send the monitor data of the user-defined format that obtains to index conversion process module 202;
Configuration database 204, be used to store the execution parameter of existing acquisition tasks, comprise: storage device type and trade name, collection item, be used for converting memory device collection item ID to the conversion formula of SMI-S index, configuration information and the operational factor that memory device connects parameter, various acquisition modes;
Described existing acquisition tasks comprises real-time acquisition tasks and periodicity acquisition tasks.
Converter can the task-driven mode operation, periodically acquisition function is provided, also can receive client's acquisition tasks in real time and carry out acquisition tasks, the SMI-S authority data after collection and the format conversion is in time returned to the client, realize real-time image data service by calling interface.
Monitor data converter towards the memory device of radio, TV and film industries can carry out data acquisition, format conversion and standard interface output to all memory devices that need monitor in the production environment, converter can be deployed on the operating systems such as MS Windows, Unix, Linux, thereby realizes cross-platform application.
As first kind of preferred methods embodiment, conversion method of the present invention can be with the task-driven mode operation, after starting converter, converter loads the acquisition tasks that configures automatically and regularly carries out, the collection period of task can define respectively, and, can carry out monitoring data collection to many memory devices simultaneously with multitask asynchronous operation mode operation.
According to first kind of preferred approach flow process of the embodiment of the invention as shown in Figure 3, may further comprise the steps:
Step 301: the monitor data converter that starts memory device;
Step 302: load acquisition tasks from configuration database, form the acquisition tasks sequence;
Each acquisition tasks is set collection period, by being set, task carries out the collection period that timer is set each acquisition tasks, all acquisition tasks and configuration parameter thereof are stored in the configuration database, after converter starts, load all acquisition tasks from configuration database, be that converter reads acquisition tasks from configuration database, all acquisition tasks and configuration parameter thereof are cached in the internal memory, realize the monitor data of memory device is regularly gathered; For each acquisition tasks is provided with acquisition tasks ID, form the acquisition tasks sequence in the configuration database.
Step 303: regular visit acquisition tasks sequence;
Sequence by acquisition tasks ID is carried out regular visit to each acquisition tasks;
Step 304: judge whether each acquisition tasks expires;
If acquisition tasks does not expire, execution in step 303 is if expire execution in step 305;
Step 305: judge whether to withdraw from task and carry out, if, execution in step 306, otherwise, execution in step 307 and step 308;
Step 306: finish;
If converter place server breaks down, crashes or when other abnormal conditions took place, acquisition tasks stopped to carry out, converter is out of service;
Step 307: the task of the described acquisition tasks that expires is carried out timer make zero;
After confirming that described acquisition tasks can normally be carried out, when carrying out described acquisition tasks, the task of the described task that expires is carried out timer to make zero, timing since the next performance period of zero-time, simultaneously, continue to patrol and examine next acquisition tasks and whether expire, if a plurality of tasks all expire, then order is carried out the task that expires, and realizes the multitask asynchronous operation;
Step 308~step 316 is with the step 101~step 109 among the inventive method embodiment;
Step 317: described SMI-S achievement data is sent to the image data library storage, for the SMI-S data, services provides data source;
Described SMI-S data, services is meant the standard based on SMI-S, uses HTTP or HTTPs agreement, for the client provide standard, according to the SMI-S cannonical format SMI-S index is carried out SMI-S formatted data behind the format specification.
According to first kind of preferred means structure of the embodiment of the invention as shown in Figure 4, comprise: task-driven module 401, acquisition index initialization module 402, index conversion process module 403, collection execution module 404, configuration database 405, acquisition database 406, wherein:
Task-driven module 401, be used for loading acquisition tasks from configuration database, form the acquisition tasks sequence, regular visit acquisition tasks sequence, judge one by one whether each acquisition tasks expires, if do not expire, then patrol and examine next acquisition tasks, if expire by the acquisition tasks sequence, then judging whether to withdraw from task carries out, if, finish, otherwise, acquisition tasks is sent to acquisition index initialization module 402, simultaneously, the task of the described task that expires in the acquisition tasks sequence is carried out timer make zero, continue to patrol and examine next acquisition tasks;
Acquisition index initialization module 402, be used to obtain acquisition tasks, according to sign of the storage device type in the described acquisition tasks and SMI-S index, from the connection parameter of configuration database load store device type, memory device and the conversion formula that is used for memory device collection item ID is converted to the SMI-S index;
Index conversion process module 403, be used for decomposing the collection item ID of described conversion formula, item is gathered in merger, based on the collection item after the merger, the described acquisition mode of gathering of merger again is after the pending data collection is finished, receive the monitor data of the user-defined format of gathering execution module 404 transmission, according to conversion formula described data are carried out computing, conversion, obtain the SMI-S index, described SMI-S achievement data is sent to the image data library storage;
Gather execution module 404, be used for loading the configuration information and the operational factor of acquisition mode from configuration database, and with the configuration parameter of the collection item after the merger as corresponding acquisition mode, during can not successful execution described acquisition mode, the failure daily record carried out in record, when can the described acquisition mode of successful execution, carry out described acquisition mode acquisition monitoring data and, send the user-defined format data that obtain to index conversion process module 403 by the user-defined format translation data;
Configuration database 405, be used to store the execution parameter of existing acquisition tasks, comprise: storage device type and trade name, collection item, be used for memory device collection item ID is converted to the configuration information and the operational factor of the conversion formula of SMI-S index, the connection parameter of memory device, various acquisition modes, also be used to store existing acquisition tasks sequence and performance period parameter thereof;
Acquisition database 406 is used to store the SMI-S index that index conversion process module 403 sends;
The client can utilize the third party system to transfer the SMI-S achievement data that it needs by calling interface from acquisition database; Wherein, calling interface is used for realizing the SMI-S index is encapsulated, and obtains SMI-S cannonical format data.
As second kind of preferred methods embodiment, the inventive method provides real-time acquisition interface for ageing monitor data of having relatively high expectations, and promptly directly obtains monitor data by interface interchange.
According to second kind of preferred approach flow process of the embodiment of the invention as shown in Figure 5, may further comprise the steps:
Step 501: receive the acquisition tasks that the client sends by the third party system;
Step 502~step 510 is with the step 101~step 109 among the inventive method embodiment;
Step 511: described SMI-S index is encapsulated by the SMI-S cannonical format by calling interface, the SMI-S cannonical format data after the encapsulation are returned to the third party system;
According to second kind of preferred means structure of the embodiment of the invention as shown in Figure 6, comprising: third party system 601, acquisition index initialization module 602, index conversion process module 603, gather execution module 604, configuration database 605, wherein:
Third party system 601 is used to receive client's acquisition tasks, and described acquisition tasks is sent to acquisition index initialization module 602, simultaneously, is used to receive the SMI-S cannonical format data after the calling interface conversion, and it is returned to the client; Wherein, calling interface is used for realizing the SMI-S index is encapsulated, and obtains SMI-S cannonical format data;
Acquisition index initialization module 602, be used to obtain acquisition tasks, according to sign of the storage device type in the described acquisition tasks and SMI-S index, from the connection parameter of configuration database load store device type, memory device and the conversion formula that is used for memory device collection item ID is converted to the SMI-S index;
Index conversion process module 603, be used for decomposing the collection item ID of described conversion formula, to have the identical collection item of gathering an ID and carry out merger, based on the collection item after the merger, the described acquisition mode of gathering of merger again is after the pending data collection is finished, receive and gather the user-defined format data that execution module 604 transmits, according to conversion formula described data are carried out computing, conversion, obtain the SMI-S index, it is returned to third party system 601 by calling interface;
Gather execution module 604, be used for loading the configuration information and the operational factor of acquisition mode from configuration database, and with the configuration parameter of the collection item after the merger as corresponding acquisition mode, when can not the described acquisition mode of successful execution, the failure daily record carried out in record, during can successful execution described acquisition mode, carry out described acquisition mode acquisition monitoring data and, send the user-defined format data that obtain to index conversion process module 603 by the user-defined format translation data;
Configuration database 605, be used to store the execution parameter of existing acquisition tasks, comprise: storage device type and trade name, collection item, be used for converting memory device collection item ID to the conversion formula of SMI-S index, configuration information and the operational factor that memory device connects parameter, various acquisition modes.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, within the spirit and principles in the present invention not all, any modification of being made, is equal to replacement, improvement etc., all should be included within the scope of protection of the invention.