CN116627360B - Data issuing method, data management system, server and storage medium - Google Patents

Data issuing method, data management system, server and storage medium Download PDF

Info

Publication number
CN116627360B
CN116627360B CN202310908445.9A CN202310908445A CN116627360B CN 116627360 B CN116627360 B CN 116627360B CN 202310908445 A CN202310908445 A CN 202310908445A CN 116627360 B CN116627360 B CN 116627360B
Authority
CN
China
Prior art keywords
data
hard disk
characteristic data
disk array
performance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310908445.9A
Other languages
Chinese (zh)
Other versions
CN116627360A (en
Inventor
王志浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Inspur Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co Ltd filed Critical Suzhou Inspur Intelligent Technology Co Ltd
Priority to CN202310908445.9A priority Critical patent/CN116627360B/en
Publication of CN116627360A publication Critical patent/CN116627360A/en
Application granted granted Critical
Publication of CN116627360B publication Critical patent/CN116627360B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3037—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a memory, e.g. virtual memory, cache
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3058—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
    • G06F11/3062—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations where the monitored property is the power consumption
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0644—Management of space entities, e.g. partitions, extents, pools
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Quality & Reliability (AREA)
  • Mathematical Physics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention relates to the technical field of data storage, and discloses a data issuing method, a data management system, a server and a storage medium. The data issuing method comprises the following steps: reading characteristic data labels corresponding to the characteristic data generated in the current service scene; determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag in the hard disk storage array module; and transmitting the characteristic data to the first hard disk array unit and transmitting the characteristic data label to the second hard disk array unit so that the first hard disk array unit stores the characteristic data, and the second hard disk array unit stores the characteristic data label. The characteristic data label management module is used for carrying out targeted management and issuing on the characteristic data label, so that the storage efficiency of the hard disk storage array module for storing the characteristic data and the characteristic data label is improved, and the reliability and the stability of the distributed storage system are guaranteed.

Description

Data issuing method, data management system, server and storage medium
Technical Field
The present invention relates to the field of data storage technologies, and in particular, to a data issuing method, a data management system, a server, and a storage medium.
Background
The disk array is a storage medium, is a large hard disk composed of a large number of disks, can realize parallel reading and writing through a database, and ensures the accuracy and the safety of data through data verification. In the process of storing the characteristic data in the disk array, the characteristic data to be Input/Output (I/O) can be processed in a targeted manner according to the characteristic data label of the characteristic data. For example: if the characteristic data label is cold data, storing the characteristic data corresponding to the characteristic data label into a low-speed storage medium; if the characteristic data tag is hot data, the characteristic data corresponding to the characteristic data tag is stored in a high-speed storage medium so as to achieve a good balance between cost and performance.
However, when the service load executed by the server is too high, the data transmission amount is too high, and the characteristic data labels are too complex, the characteristic data storage efficiency is low, so that the server cannot respond to the front-end service in time, and the usability of the whole system is affected.
In view of the foregoing, there is a need for a method that can improve the data processing efficiency and thus the usability of a server system.
Disclosure of Invention
In view of the above, the present invention provides a data issuing method, a data management system, a server and a storage medium, so as to solve the problem of low availability of the server system due to low data processing efficiency.
In a first aspect, the present invention provides a data issuing method, including:
reading characteristic data labels corresponding to the characteristic data generated in the current service scene;
determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag in the hard disk storage array module;
and transmitting the characteristic data to the first hard disk array unit and transmitting the characteristic data label to the second hard disk array unit so that the first hard disk array unit stores the characteristic data, and the second hard disk array unit stores the characteristic data label.
In the mode, the characteristic data labels are subjected to targeted management and issuing through the characteristic data label management module, so that the storage efficiency of the hard disk storage array module for storing the characteristic data and the characteristic data labels is improved, the reliability and the stability of the distributed storage system are further guaranteed, and when the characteristic data labels of the characteristic data are complex and the characteristic data are more due to high load in an extreme service scene, the characteristic data and the corresponding characteristic data labels can be issued and stored quickly and orderly, so that the usability of the whole system is improved.
In an alternative embodiment, the issuing of the feature data to the first hard disk array unit and the issuing of the feature data tag to the second hard disk array unit includes:
determining a data transmission mode of data transmission in a current service scene;
determining first performance reference data of the characteristic data in a data transmission mode and determining second performance reference data of the characteristic data tag in the data transmission mode based on preset configuration information;
determining a target detection period according to the working mode issued by the current data;
acquiring first real-time performance data of the characteristic data and second real-time performance data of the characteristic data tag in a target detection period;
respectively acquiring a first comparison result between the first real-time performance data and the first performance reference data and a second comparison result between the second real-time performance data and the second performance reference data;
based on the first comparison result and the second comparison result, the characteristic data is issued to the first hard disk array unit and the characteristic data label is issued to the second hard disk array unit.
In the mode, the data transmission mode of data transmission can be combined with the current service scene, and the descending situations of the characteristic data and the characteristic data labels are periodically detected, so that the characteristic data and the characteristic data labels can be orderly stored, the occurrence of the situation that the reliability and the stability of a storage system are affected due to the occurrence of abnormality of the descending situations of the data is reduced, and the usability of the whole system is improved.
In an alternative embodiment, based on the first comparison result and the second comparison result, issuing the feature data to the first hard disk array unit and issuing the feature data tag to the second hard disk array unit includes:
if the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value, and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value, the characteristic data is issued to the first hard disk array unit, and the characteristic data label is issued to the second hard disk array unit;
the first threshold is a product between the first performance reference data and the first weight, and the second threshold is a product between the second performance reference data and the second weight.
In an alternative embodiment, the method further comprises:
acquiring a load state value of a current service scene;
dividing at least one test area in each hard disk array unit in the hard disk storage array module based on the load state value to obtain a first number of test areas;
performing performance simulation test on the first number of test areas based on the load state value to obtain a performance simulation test result;
based on the performance simulation test result, performing performance gear division on the storage areas of the hard disk array units to obtain a second number of storage performance gears, wherein different performance gears correspond to different storage areas;
Respectively determining a first performance gear of the characteristic data tag and a second performance gear of the characteristic data;
determining a target storage performance gear from the second number of storage performance gears based on a difference between the second performance gear and the first performance gear;
and transmitting the characteristic data to a first target storage area corresponding to the second performance gear, transmitting the characteristic data label to a second target storage area corresponding to the target storage performance gear, wherein the first target storage area corresponds to the first hard disk array unit, and the second target storage area corresponds to the second hard disk array unit.
In the mode, the characteristic data and the characteristic data labels can be stored in a targeted mode by combining the load pressure of the current service and the storage performance gear of each hard disk array unit in the hard disk storage array module, so that the storage resources of the hard disk storage array module can be reasonably utilized, further the storage efficiency is improved, and meanwhile, the reliability and the stability of a storage system can be ensured.
In an alternative embodiment, the method further comprises:
if the first comparison result is that the first real-time performance data is smaller than a first threshold value and the second comparison result is that the second real-time performance data is smaller than a second threshold value, sending alarm information and/or a current working mode switching request;
The alarm information is used for alarming the hard disk storage array module to store characteristic data and the characteristic data label to be abnormal.
In an alternative embodiment, the method further comprises:
and sending the alarm information to the indication module through the serial port module or the wireless module so that the indication module can display the alarm information.
In an alternative embodiment, the method further comprises:
the load state value is re-acquired, and the target storage area is re-determined based on the load state value and the gear value of the first performance gear;
issuing the characteristic data label to a second designated hard disk array unit corresponding to the new target storage area;
and canceling the sending of the alarm information until the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value.
In this manner, dynamic management of the feature data tags may be achieved.
In an alternative embodiment, the method further comprises:
and sending tag modification information, wherein the tag modification information is used for prompting a user to modify the first performance gear in the characteristic data tag.
In an alternative embodiment, acquiring first real-time performance data of the feature data and second real-time performance data of the feature data tag includes:
And acquiring the first real-time performance data of the characteristic data and the second real-time performance data of the characteristic data tag from a front-end module and/or a control module of the server.
In an alternative embodiment, the hard disk storage array module includes a plurality of hard disk array units, and determines a first hard disk array unit corresponding to the feature data and a second hard disk array unit corresponding to the feature data tag respectively, including:
receiving a data storage instruction;
according to the data storage instruction, a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag are respectively determined;
the first hard disk array unit and the second hard disk array unit are the same hard disk array unit;
or the first hard disk array unit and the second hard disk array unit are different hard disk array units.
In an alternative embodiment, the data storage instruction is sent by a service module, and the service module is used for generating feature data and feature data labels corresponding to the feature data in the current service scene, and is used for providing an operation environment of the current service scene.
In a second aspect, the present invention provides a data management system comprising: the device comprises a characteristic data tag management module and a hard disk storage array module connected with the characteristic data tag management module;
The characteristic data tag management module comprises: the system comprises a data reading unit, a distribution determining unit and a data issuing unit, wherein the data reading unit is used for reading characteristic data generated under a current service scene and characteristic data labels corresponding to the characteristic data; the distribution determining unit is used for determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data label in the hard disk storage array module respectively; the data issuing unit is used for issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit;
the hard disk storage array module comprises a first hard disk array unit and a second hard disk array unit, wherein the first hard disk array unit is used for storing characteristic data, and the second hard disk array unit is used for storing characteristic data labels.
In the mode, the characteristic data tags can be subjected to targeted management through the characteristic data tag management module so as to respectively issue the characteristic data and the characteristic data tags to corresponding hard disk array units in the hard disk storage array module, and the corresponding hard disk array units are used for targeted receiving and storing, so that the data processing efficiency of the hard disk storage array module can be improved, and the usability of a server system is improved.
In an alternative embodiment, the data management system further comprises:
the control module is connected with the characteristic data tag management module and is used for generating characteristic data and characteristic data tags corresponding to the characteristic data in the current service scene.
In an alternative embodiment, the data management system further comprises:
the service module is connected with the characteristic data tag management module and the control module through the front end module, and is used for providing the running environment of the current service scene.
In an alternative embodiment, the service module is further configured to send a data storage instruction to the feature data tag management module;
the characteristic data tag management module is also used for receiving the data storage instruction and respectively determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag according to the data storage instruction;
the hard disk storage array module comprises a plurality of hard disk array units, wherein the first hard disk array unit and the second hard disk array unit are the same hard disk array unit; or the first hard disk array unit and the second hard disk array unit are different hard disk array units.
In an alternative embodiment, the control module is further configured to generate first real-time performance data of the feature data and second real-time performance data of the feature data tag, and send the first real-time performance data and the second real-time performance data to the front-end module, so that the front-end module feeds back the first real-time performance data and the second real-time performance data to the service module;
the front end module is connected with the characteristic data tag management module;
the feature data tag management module acquires first real-time performance data of the feature data and second real-time performance data of the feature data tag from the service module, the front-end module and/or the control module.
In an alternative embodiment, the feature data tag management module further includes:
the mode determining unit is used for determining a data transmission mode of data transmission in the current service scene;
the first data acquisition unit is used for determining first performance reference data of the characteristic data in a data transmission mode and determining second performance reference data of the characteristic data tag in the data transmission mode based on preset configuration information;
the period determining unit is used for determining a target detection period according to the working mode issued by the current data;
The second data acquisition unit is used for acquiring first real-time performance data of the characteristic data and second real-time performance data of the characteristic data tag in a target detection period;
the third data acquisition unit is used for respectively acquiring a first comparison result between the first real-time performance data and the first performance reference data and acquiring a second comparison result between the second real-time performance data and the second performance reference data;
and the issuing execution unit is used for issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit based on the first comparison result and the second comparison result.
In an optional implementation manner, the issuing execution unit is configured to issue the feature data to the first hard disk array unit and issue the feature data tag to the second hard disk array unit when the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value;
the first threshold is a product between the first performance reference data and the first weight, and the second threshold is a product between the second performance reference data and the second weight.
In an alternative embodiment, the feature data tag management module further includes:
a fourth data acquisition unit, configured to acquire a load status value of a current service scenario;
the first dividing unit is used for dividing at least one test area in each hard disk array unit in the hard disk storage array module based on the load state value to obtain a first number of test areas;
the test unit is used for performing performance simulation test on the first number of test areas based on the load state value to obtain a performance simulation test result;
the second dividing unit is used for dividing the performance gears of the storage areas of the hard disk array units based on the performance simulation test result to obtain a second number of storage performance gears, and the different performance gears correspond to different storage areas;
the performance gear determining unit is used for respectively determining a first performance gear of the characteristic data tag and a second performance gear of the characteristic data;
a matching unit configured to determine a target storage performance gear from a second number of storage performance gears based on a difference between the second performance gear and the first performance gear;
the first execution subunit is configured to issue the feature data to a first target storage area corresponding to the second performance gear, issue the feature data tag to a second target storage area corresponding to the target storage performance gear, where the first target storage area corresponds to the first hard disk array unit, and the second target storage area corresponds to the second hard disk array unit.
In an alternative embodiment, the feature data tag management module further includes:
the prompting unit is used for sending alarm information and/or a current working mode switching request, wherein the alarm information is used for alarming the hard disk storage array module to store characteristic data and the characteristic data label is abnormal.
In an alternative embodiment, the data management system further comprises: an indication module, a serial port module or a wireless module;
the indication module is connected with the prompt unit through the serial port module;
or the indication module is in wireless communication connection with the prompt unit through the wireless module;
the indication module is used for receiving and displaying alarm information.
In an alternative embodiment, the feature data tag management module further includes:
the adjusting unit is used for re-acquiring the load state value and re-determining the target storage area based on the load state value and the gear value of the first performance gear; issuing the characteristic data label to a second designated hard disk array unit corresponding to the new target storage area; and canceling the sending of the alarm information until the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value.
In an alternative embodiment, the feature data tag management module further includes:
the information sending unit is used for sending tag modification information, and the tag modification information is used for prompting a user to modify a first performance gear in the characteristic data tag.
In a third aspect, the present invention provides a server comprising: including the data management system of the second aspect described above or any of its corresponding embodiments.
In a fourth aspect, the present invention provides a computer readable storage medium having stored thereon computer instructions for causing a computer to execute the data issuing method of the first aspect or any embodiment corresponding thereto.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a data delivery method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another data delivery method according to an embodiment of the present invention;
FIG. 3 is a block diagram of a data management system according to an embodiment of the present invention;
FIG. 4 is a block diagram of another data management system according to an embodiment of the invention
FIG. 5 is a block diagram of a further data management system according to an embodiment of the invention
Fig. 6 is a schematic diagram of a hardware structure of a server according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In the related art, a disk array stores received characteristic data in a targeted manner according to a characteristic data tag of the characteristic data. However, when the service load executed by the server is too high, the data transmission amount is too high, and the characteristic data labels are too complex, the disk array cannot effectively identify the characteristic data labels, so that the characteristic data storage efficiency is low, and further the server cannot respond to the front-end service in time, and the usability of the whole system is affected.
In view of the above, the present invention provides a data issuing method, including: reading characteristic data labels corresponding to the characteristic data generated in the current service scene; determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag in the hard disk storage array module; and transmitting the characteristic data to the first hard disk array unit and transmitting the characteristic data label to the second hard disk array unit so that the first hard disk array unit stores the characteristic data, and the second hard disk array unit stores the characteristic data label. In the invention, the characteristic data label management module is used for carrying out targeted management and issuing on the characteristic data label, thereby being beneficial to accelerating the storage efficiency of the hard disk storage array module for storing the characteristic data and the characteristic data label, and further being beneficial to guaranteeing the reliability and the stability of the distributed storage system.
In this embodiment, a data issuing method is provided, fig. 1 is a flowchart of the data issuing method according to an embodiment of the present invention, and as shown in fig. 1, the flowchart includes the following steps:
step S101, reading the characteristic data generated in the current service scene and the characteristic data label corresponding to the characteristic data.
In the embodiment of the invention, the characteristic data tag is a tag for identifying characteristic data, so that the characteristic data tag needs to be combined for storage when storing the characteristic data. Therefore, in order to improve the storage efficiency, the feature data generated in the current service scene and the feature data tag corresponding to the feature data are read, so that the feature data and the feature data tag of the feature data are stored in a targeted manner.
Step S102, determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag in the hard disk storage array module.
In the embodiment of the invention, in order to be convenient for rapidly storing the characteristic data tag and the characteristic data, the first hard disk array unit corresponding to the characteristic data and the second hard disk array unit corresponding to the characteristic data tag are respectively determined from the hard disk storage array module, so that the characteristic data and the characteristic data tag can be processed in a targeted manner, and the storage efficiency of the hard disk storage array module for storing the characteristic data is improved.
Step S103, the characteristic data is issued to the first hard disk array unit and the characteristic data label is issued to the second hard disk array unit, so that the first hard disk array unit stores the characteristic data, and the second hard disk array unit stores the characteristic data label.
In the embodiment of the invention, after the characteristic data is stored by the first hard disk array unit and the characteristic data label is stored by the second hard disk array unit, the characteristic data is directly issued to the first hard disk array unit for storage, and the characteristic data label is issued to the second hard disk array unit for storage, so that the characteristic data is stored without waiting for the storage of the characteristic data label after the characteristic data label of the characteristic data is completely identified, thereby being beneficial to improving the storage efficiency of the characteristic data. And the characteristic data labels are issued to the second hard disk array unit for storage, so that the characteristic data labels can be managed in a targeted manner.
According to the data issuing method, the characteristic data labels are subjected to targeted management and issuing through the characteristic data label management module, so that the storage efficiency of the hard disk storage array module for storing the characteristic data and the characteristic data labels is improved, the reliability and the stability of a distributed storage system are guaranteed, and when the characteristic data labels of the characteristic data are complex and the characteristic data are more due to high load in an extreme service scene, the characteristic data and the corresponding characteristic data labels can be issued and stored rapidly and orderly, so that the usability of the whole system is improved.
In this embodiment, a data issuing method is provided, which may be used in the above mobile terminal, such as a mobile phone, a tablet pc, etc., fig. 2 is a flowchart of the data issuing method according to an embodiment of the present invention, and as shown in fig. 2, the flowchart includes the following steps:
step S201, reading the characteristic data generated in the current service scene and the characteristic data label corresponding to the characteristic data.
In some alternative embodiments, the step S201 includes:
step a1, acquiring first real-time performance data of the characteristic data and second real-time performance data of the characteristic data tag from a front-end module and/or a control module of the server.
In this embodiment, the control module of the server is a module carrying storage system software, and may generate feature data and a feature data tag corresponding to the feature data in the current service scenario during the running process of the server. Therefore, to determine the storage condition of the current feature data and the feature data tag, the first real-time performance data of the feature data and the second real-time performance data of the feature data tag may be obtained from the control module.
The front-end module is an intermediate module for performing data interaction between the control module and the service module, wherein the service module is used for providing an operating environment for executing the current service scene. Thus, in the front-end module of the server, there is also the first real-time performance data of the feature data and the second implementation performance data of the feature data tag.
Thus, the first real-time performance data of the feature data, and the second real-time performance data of the feature data tag may be obtained from either the front-end module or the control module, or both. If the first real-time performance data of the feature data and the second real-time performance data of the feature data tag are obtained from the front-end module and the control module respectively, the validity of issuing the feature data and the feature data tag can be guaranteed by comparing whether the real-time performance data in the two modules are different or not for mutual verification before issuing the data.
Step S202, determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag in the hard disk storage array module. Please refer to step S201 in the embodiment shown in fig. 1 in detail, which is not described herein.
In step S203, the feature data is issued to the first hard disk array unit and the feature data tag is issued to the second hard disk array unit, so that the first hard disk array unit stores the feature data, and the second hard disk array unit stores the feature data tag.
Specifically, the step S203 includes:
Step S2031, determining a data transmission mode of data transmission in the current service scenario.
In the embodiment of the invention, in order to avoid the influence on the normal operation of the storage system caused by the unmatched generation amount of the characteristic data and the characteristic data label and the unmatched storage amount, the data transmission mode corresponding to the current service scene is firstly determined so as to clearly determine the generation condition of the characteristic data and the characteristic data label in the theoretical state of the data transmission mode. For example: the data transmission modes may include, but are not limited to, the following modes: size data block transfer mode, sequential/random transfer mode, read/write mode.
Step S2032, determining first performance reference data of the feature data in the data transmission mode and determining second performance reference data of the feature data tag in the data transmission mode based on the preset configuration information.
In the embodiment of the invention, the characteristic data and the performance reference data corresponding to the characteristic data tag in a theoretical state in a plurality of data transmission modes are prestored in preset configuration information, and further under the condition that the current data transmission mode is defined, the first performance reference data of the characteristic data in the data transmission mode and the second performance reference data of the characteristic data tag in the data transmission mode are respectively determined.
Step S2033, determining a target detection period according to the operation mode issued by the current data.
In the embodiment of the invention, the corresponding detection periods of the characteristic data tag management module in different working modes are different, so that in order to ensure the stability of issuing the characteristic data and the characteristic data tag, a target detection period is determined according to the current working mode of the characteristic data tag management module, so as to detect whether the issuing conditions of the characteristic data and the characteristic data tag are normal or not in the target detection period. The current operation mode may include a normal mode or a high availability mode, among others.
In step S2034, in the target detection period, the first real-time performance data of the feature data and the second real-time performance data of the feature data tag are acquired.
In the embodiment of the invention, in a target detection period, the first real-time performance data of the characteristic data and the second real-time performance data of the characteristic data tag are respectively acquired from the control module. Wherein the first real-time performance data and the second real-time performance data may be understood as real-time performance data in the data transmission mode. The first performance reference data is theoretical data of the first real-time performance data in the same data transmission mode, and the second performance reference data is theoretical data of the second real-time performance data in the same data transmission mode. The first real-time performance data may include, but is not limited to, any one or more of the following performance types of data: the number of read/write operations per second (Input/Output Operations Per Second, IOPS), bandwidth and time delay of the hard disk. The second real-time performance data may include, but is not limited to, any one or more of the following performance types of data: the number of read/write operations per second (Input/Output Operations Per Second, IOPS), bandwidth and time delay of the hard disk.
Step S2035, respectively obtaining a first comparison result between the first real-time performance data and the first performance reference data, and obtaining a second comparison result between the second real-time performance data and the second performance reference data.
In the embodiment of the invention, the first real-time performance data and the first performance reference data are respectively compared to obtain a first comparison result; and comparing the second real-time performance data with the second performance reference data to obtain a second comparison result.
Step S2036, based on the first comparison result and the second comparison result, issues the feature data to the first hard disk array unit and issues the feature data tag to the second hard disk array unit.
In the embodiment of the invention, whether the characteristic data and the characteristic data label are normal in the downlink condition under the current data transmission mode or not can be definitely determined through the first comparison result and the second comparison result, and when the characteristic data is transmitted to the first hard disk array unit and the characteristic data label is transmitted to the second hard disk array unit, the characteristic data and the characteristic data label can be ensured to be orderly stored, so that the effectiveness and the rationality of the transmission of the characteristic data and the characteristic data label are ensured.
In some optional embodiments, step S2036 includes:
and a step a1 of issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit if the first comparison result is that the first real-time performance data is larger than or equal to a first threshold value and the second comparison result is that the second real-time performance data is larger than or equal to a second threshold value.
In this manner, the first threshold is a product between the first performance reference data and the first weight, and the second threshold is a product between the second performance reference data and the second weight. The first threshold may be understood as an early warning threshold that may be abnormal in the feature data distribution. If the first real-time performance data is greater than or equal to a first threshold value, the issuing state of the characterization feature data is normal; if the first real-time performance data is smaller than the first threshold value, the issuing state of the characterization feature data is abnormal. The second threshold may be understood as an early warning threshold that may be abnormal when the feature data tag issues. If the second real-time performance data is greater than or equal to a second threshold value, the issuing state of the characteristic data tag is characterized as normal; if the second real-time performance data is smaller than the second threshold value, the issuing state of the characteristic data tag is characterized to be abnormal.
Therefore, if the first comparison result is that the first real-time performance data is greater than or equal to the first threshold value, and the second comparison result is that the second real-time performance data is greater than or equal to the second threshold value, the issuing states of the characterization feature data and the feature data tag are normal, so that the feature data can be issued to the first hard disk array unit and the feature data tag can be issued to the second hard disk array unit.
In one implementation scenario, in the data transmission mode G, the first performance reference data of the feature data in the data transmission mode is A1, and the second performance reference data B1 of the feature data tag in the data transmission mode is determined. If the working mode of the current data transmission is the normal mode, the target detection period is 60 minutes (min). Every 60min, the first real-time performance data of the characteristic data are respectively obtained from the control module as a1, and the second real-time performance data of the obtained characteristic data label are b1. Taking the first weight as 70% and the second weight as 72% as an example, the first threshold is A1 x 70% and the second threshold is B1 x 72%. If A1 is greater than or equal to A1 by 70% and B1 is greater than or equal to B1 by 72% within 60min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data can be issued to the first hard disk array unit and the characteristic data tag can be issued to the second hard disk array unit. If A1 is less than A1 by 70% and B1 is less than B1 by 72% within 60min, the issuing states of the characterization feature data and the feature data tag are abnormal.
In another implementation scenario, if the current working mode of data transmission is a normal mode, but the user has a special requirement, the first threshold and the second threshold may be increased, and the single target detection duration of the target detection period may be shortened, so that data transmission management is stricter. For example: the target detection period may be set to 50 minutes. Every 50min, the first real-time performance data of the characteristic data are respectively obtained from the control module as a1, and the second real-time performance data of the obtained characteristic data label are b1. Taking the first weight as 75% and the second weight as 78% as an example, the first threshold is A1 x 75% and the second threshold is B1 x 78%. If A1 is greater than or equal to A1 by 75% and B1 is greater than or equal to B1 by 78% within 50min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data can be issued to the first hard disk array unit and the characteristic data tag can be issued to the second hard disk array unit. If A1 is less than A1 by 75% and B1 is less than B1 by 78% within 50min, the issuing states of the characterization feature data and the feature data tag are abnormal.
In some alternative implementations, the first hard disk array unit and the second hard disk array unit may be the same hard disk array unit.
According to the data issuing method, the data transmission mode of data transmission can be combined with the current service scene, the issuing conditions of the feature data and the feature data labels are periodically detected, so that the feature data and the feature data labels can be orderly stored, the situation that the reliability and the stability of a storage system are affected due to the fact that the issuing of the data is abnormal is further reduced, and the usability of the whole system is improved.
In some optional embodiments, the data issuing method further includes:
step S204, obtaining a load state value of the current service scene.
In an embodiment of the present invention, in the present invention,
the load state value of the current service scene is obtained from the service module, so that the load pressure of the current service scene of the current operation of the distributed service system can be definitely obtained through the load state value, and further, the characteristic data and the characteristic data label can be ensured to be issued to be matched with the load state value of the current service module, and the condition that the response of the server is not timely is avoided.
Step S205, based on the load status value, dividing at least one test area in each hard disk array unit in the hard disk storage array module to obtain a first number of test areas.
In the embodiment of the invention, the corresponding relation between a plurality of load state value intervals and the dividing number of the test areas is pre-established. Comparing the load state value with a plurality of load state value intervals to determine a target load state value interval containing the load state value from the plurality of load state value intervals, and further taking a first number corresponding to the target load state value interval as the dividing number of the test areas. For example: if the target load state value interval is [0, 30%), the first number is 1024; if the target load state value interval is [30%, 40%), the first number is 2048.
And S206, performing performance simulation test on the first number of test areas based on the load state value to obtain a performance simulation test result.
In the embodiment of the invention, based on the performance requirement in the current service scene, performance simulation tests (Simulation Testing, ST) are carried out on the first number of test areas so as to determine the performance condition corresponding to each test area and further obtain the performance simulation test result.
Step S207, based on the performance simulation test result, performing performance gear division on the storage areas of the hard disk array units to obtain a second number of storage performance gears.
In the embodiment of the invention, based on the performance simulation test result, the storage areas of the hard disk array units are subjected to performance gear division to obtain a second number of storage performance gears. Wherein, different storage performance gears correspond to different storage areas. The higher the number of gear steps, the lower the corresponding memory performance.
Step S208, determining the first performance level of the feature data tag and the second performance level of the feature data, respectively.
In the embodiment of the invention, a first performance gear of the characteristic data tag and a second performance gear of the characteristic data are respectively determined. The second performance gear is a performance gear corresponding to a storage area where the feature data is to be issued.
Step S209 determines a target storage performance gear from the second number of storage performance gears based on a difference between the second performance gear and the first performance gear.
In the embodiment of the invention, the difference value between the second performance gear and the first performance gear is used as a target gear value, and then the storage performance gear which is the same as the target gear value is determined from the second number of storage performance gears and is used as the target storage performance gear.
Step S210, the characteristic data is issued to a first target storage area corresponding to the second performance gear, and the characteristic data label is issued to a second target storage area corresponding to the target storage performance gear.
In the embodiment of the invention, the first target storage area corresponds to a first designated hard disk array unit, and the second target storage area corresponds to a second designated hard disk array unit.
By adopting the mode to issue data, the characteristic data and the characteristic data labels can be stored in a targeted mode by combining the load pressure of the current service and the storage performance gear of each hard disk array unit in the hard disk storage array module, so that the storage resources of the hard disk storage array module can be reasonably utilized, further the storage efficiency is improved, and the reliability and the stability of a storage system can be ensured.
In an implementation scenario, in the data transmission mode G, if the load status value of the current service scenario is less than 30%, at least one test area is divided into each hard disk array unit in the hard disk storage array module based on the load status value, so as to obtain 1024 (first number of) test areas. And dividing each hard disk array unit into 16 storage performance gears from high to low according to a performance simulation test result of the performance simulation test. Wherein, the storage performance of the storage performance gear is highest, and the storage performance of the storage performance gear is lowest, and the storage performance of the storage performance gear is 16. If the second performance gear of the feature data is N1 and the first performance gear of the feature data tag is E1, the target storage performance gear is N1-E1. And then the characteristic data is issued to a first target storage area corresponding to N1, and the first target storage area corresponds to the first appointed hard disk array unit. And issuing the characteristic data label to a second target storage area corresponding to the N1-E1, wherein the second target storage area corresponds to the second designated hard disk array unit.
Further, in the process of issuing the feature data and the feature data tag, the current working mode of the feature data tag management module is a high available mode, and then the target detection period is 45 minutes (min). Further, under the condition that the first performance reference data of the characteristic data in the data transmission mode is A1 and the second performance reference data B1 of the characteristic data tag in the data transmission mode is determined, the first real-time performance data of the characteristic data is A1 and the second real-time performance data of the characteristic data tag is B1, which are obtained from the control module, respectively every 45 min. Taking the first weight as 80% and the second weight as 83.5% as an example, the first threshold is A1 x 80% and the second threshold is B1 x 83.5%. If A1 is greater than or equal to A1 by 80% and B1 is greater than or equal to B1 by 83.5% every 45min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data and the characteristic data tag can be continuously issued to the corresponding appointed hard disk array unit. If A1 is less than A1 by 80% and B1 is less than B1 by 83.5% within 45min, the issuing states of the characterization feature data and the feature data tag are abnormal.
In another implementation scenario, if the current working mode of the feature data tag management module is a high available mode, but the user has a special requirement, the first threshold and the second threshold may be increased, and the single target detection duration of the target detection period may be shortened, so that data issuing management is stricter. For example: the target detection period may be set to 30 minutes (min). Every 30min, the first real-time performance data of the characteristic data are respectively obtained from the control module as a1, and the second real-time performance data of the obtained characteristic data label are b1. Taking the first weight as 85% and the second weight as 89% as an example, the first threshold is a1×85% and the second threshold is B1×89%. If A1 is greater than or equal to A1 by 85% and B1 is greater than or equal to B1 by 89% within 30min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data and the characteristic data tag can be continuously issued to the specified hard disk array unit. If A1 is less than A1 by 85% and B1 is less than B1 by 89% within 30min, the issuing states of the characterization feature data and the feature data tag are abnormal.
In some optional embodiments, if the first comparison result is that the first real-time performance data is smaller than the first threshold value, and the second comparison result is that the second real-time performance data is smaller than the second threshold value, sending alarm information and/or a current working mode switching request. The alarm information is used for alarming the hard disk storage array module to store characteristic data and the characteristic data label to be abnormal. By sending the alarm information, the method is beneficial to users to process abnormal data distribution in time, thereby being beneficial to improving the usability of the whole system.
In other optional embodiments, the data issuing method provided by the present invention further includes: the alarm information is sent to the indication module through the serial port module or the wireless module, so that the alarm information is displayed by the indication module, and a user can intuitively and rapidly determine that the current data distribution has abnormality through the indication module.
In some optional embodiments, if the first comparison result is that the first real-time performance data is greater than or equal to the first threshold value, and the second comparison result is that the second real-time performance data is greater than or equal to the second threshold value, the data issuing method provided by the invention further includes: the load state value is re-acquired, and the target storage area is re-determined based on the load state value and the gear value of the first performance gear; issuing the characteristic data label to a second designated hard disk array unit corresponding to the new target storage area; and until the first comparison result is that the first real-time performance data is larger than or equal to a first threshold value and the second comparison result is that the second real-time performance data is larger than or equal to a second threshold value in the target detection period, canceling the sending of the alarm information. Specifically, in order to reduce manual intervention, the load state value is acquired again to determine the current running load condition of the current service scene. And if the re-acquired load state value is smaller than the specified load state threshold value, the gear value-1 of the first performance gear is used as a new target gear value, the storage performance gear which is the same as the new target gear value is re-determined from the second number of storage performance gears, and the storage performance gear is used as a new target storage performance gear, so that the next conditions of the characteristic data and the characteristic data labels are re-detected in the target detection period. If the first real-time performance data is greater than or equal to the first threshold value and the second real-time performance data is greater than or equal to the second threshold value, sending of alarm information is canceled, and therefore dynamic management of the feature data labels can be achieved.
And if the re-acquired load state value is greater than or equal to the specified load state threshold value, performing performance gear division on the storage area of each hard disk array unit again based on the re-acquired load state value to obtain a new second number of storage performance gears. And taking the difference value-1 between the second performance gear and the first performance gear as a new target gear value, and further determining a new second target storage area from the new second number of storage performance gears, so as to detect the characteristic data and the next condition of the characteristic data tag again in the target detection period. If the first real-time performance data is greater than or equal to the first threshold value and the second real-time performance data is greater than or equal to the second threshold value, the sending of the alarm information is canceled.
In still other optional embodiments, the data issuing method provided by the present invention further includes: and sending the label modification information. The tag modification information is used for prompting a user to modify a first performance gear in the characteristic data tag. For example: the first performance gear in the characteristic data tag is E2, but issuing the characteristic data tag by adopting the first performance gear results in issuing abnormality, and the gear value-1 of the first performance gear is used for redefining the target storage area until the first real-time performance data is greater than or equal to a first threshold value and the second real-time performance data is greater than or equal to a second threshold value, and the gear value H2 of the first performance gear at the moment is used for prompting a user to modify the first performance gear in the characteristic data tag.
In some optional embodiments, if the hard disk storage array module includes a plurality of hard disk array units, the first hard disk array unit corresponding to the feature data and the second hard disk array unit corresponding to the feature data tag may be determined in the following manner:
step b1, receiving a data storage instruction;
and b2, respectively determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag according to the data storage instruction.
In this embodiment, the first hard disk array unit and the second hard disk array unit are the same hard disk array unit. Or the first hard disk array unit and the second hard disk array unit are different hard disk array units. That is, the first hard disk array unit is used for storing the characteristic data, the second hard disk array unit is used for storing the characteristic data label, the characteristic data label can be determined according to the received data storage instruction, and further, when data is issued, the storage efficiency of the storage system can be improved, and therefore the usability of the whole system can be improved.
In other alternative embodiments, the data storage instruction is sent by the service module, so as to ensure the validity of the feature data and the feature data label issue. The service module is used for generating characteristic data and characteristic data labels corresponding to the characteristic data in the current service scene and providing an operation environment of the current service scene.
In some optional implementation scenarios, if the current working mode of the feature data tag management module is a normal mode, the following manner may be adopted to issue feature data and feature data tags:
in the data transmission mode G, the first performance reference data of the characteristic data in the data transmission mode is A1, and the second performance reference data B1 of the characteristic data tag in the data transmission mode is determined. If the current working mode of the characteristic data tag management module is the normal mode, the target detection period is 60 minutes (min). If the user has no special requirement and the feature data label are issued in the same appointed hard disk array unit, the first real-time performance data of the feature data is a1, and the second real-time performance data of the obtained feature data label is b1, wherein the first real-time performance data of the feature data is obtained from the control module respectively every 60 minutes. Taking the first weight as 70% and the second weight as 72% as an example, the first threshold is A1 x 70% and the second threshold is B1 x 72%. If A1 is greater than or equal to A1 by 70% and B1 is greater than or equal to B1 by 72% within 60min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data and the characteristic data tag can be continuously issued to the specified hard disk array unit.
If A1 is less than A1 by 70% and B1 is less than B1 by 72% within 60min, the issuing states of the characteristic data and the characteristic data label are abnormal, and then alarm information and a current working mode switching request are sent to inform a user that the characteristic data label issues the characteristic data and the characteristic data label in a common mode and the user is requested to switch the current working mode into a high available mode.
If the user has special requirements, the first threshold value and the second threshold value are increased, and the single target detection time length of the target detection period is shortened, so that data issuing management is stricter. Specifically, the target detection period is set to 50 minutes min. Every 50min, the first real-time performance data of the characteristic data are respectively obtained from the control module as a1, and the second real-time performance data of the obtained characteristic data label are b1. Taking the first weight as 75% and the second weight as 78% as an example, the first threshold is A1 x 75% and the second threshold is B1 x 78%. If A1 is greater than or equal to A1 by 75% and B1 is greater than or equal to B1 by 78% within 50min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data and the characteristic data tag can be continuously issued to the specified hard disk array unit.
If A1 is less than 75% of A1 and B1 is less than 78% of B1 within 50min, the issuing states of the characterization feature data and the feature data tag are abnormal, and then alarm information and a current working mode switching request are sent.
If the current working mode of the feature data tag management module is a high available mode, the following mode may be adopted to issue feature data and feature data tags:
in the data transmission mode G, if the load status value of the current service scenario is less than 30%, at least one test area is divided into each hard disk array unit in the hard disk storage array module based on the load status value, so as to obtain 1024 (first number of) test areas. The hard disk storage array module comprises a high-speed hard disk array unit, a medium-speed hard disk array unit and a low-speed hard disk array unit. Based on the performance test results, each hard disk array unit is divided into 16 storage performance gears from high to low. Wherein, the storage performance of the storage performance gear is highest, and the storage performance of the storage performance gear is lowest, and the storage performance of the storage performance gear is 16. If the second performance gear of the feature data is N1 and the first performance gear of the feature data tag is E1, the target storage performance gear is N1-E1. And then the characteristic data is issued to a first target storage area corresponding to N1, and the first target storage area corresponds to the first appointed hard disk array unit. And issuing the characteristic data label to a second target storage area corresponding to the N1-E1, wherein the second target storage area corresponds to the second designated hard disk array unit.
Because the current working mode of the characteristic data tag management module is a high available mode and no special requirement is required by a user, the target detection period can be set to be 45 minutes. And further, every 45min, respectively acquiring the first real-time performance data of the characteristic data from the control module as a1, and acquiring the second real-time performance data of the characteristic data label as b1. Taking the first weight as 80% and the second weight as 83.5% as an example, the first threshold is A1 x 80% and the second threshold is B1 x 83.5%. If A1 is greater than or equal to A1 by 80% and B1 is greater than or equal to B1 by 83.5% every 45min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data and the characteristic data tag can be continuously issued to the corresponding appointed hard disk array unit.
If A1 is less than A1 by 80% and B1 is less than B1 by 83.5% within 45min, the issuing states of the characterization feature data and the feature data tag are abnormal, and then alarm information is sent. And re-acquiring the load state value, if the re-acquired load state value is smaller than the specified load state threshold (35%), re-determining the first performance gear E1-1 to be N1-E1-1, further determining a first comparison result and a second comparison result within 45min by adopting the method, if A1 is still smaller than A1 by 80% and B1 is smaller than B1 by 83.5%, re-determining the new first performance gear-1 until A1 is larger than or equal to A1 by 80% and B1 is larger than or equal to B1 by 83.5%, and further canceling the sending of the alarm information.
If the user has special requirements and the load state value of the current service scene is smaller than 40%, dividing at least one test area into each hard disk array unit in the hard disk storage array module based on the load state value, further obtaining 2048 (first number) test areas, and further dividing each hard disk array unit into 32 storage performance gears from high to low based on the performance test result. The target detection period may be set to 30min, and then every 30min, the first real-time performance data of the feature data is respectively acquired from the control module as a1, and the second real-time performance data of the acquired feature data tag is b1. Taking the first weight as 85% and the second weight as 89% as an example, the first threshold is a1×85% and the second threshold is B1×89%. If A1 is greater than or equal to A1 by 85% and B1 is greater than or equal to B1 by 89% every 45min, the issuing states of the characteristic data and the characteristic data tag are normal, so that the characteristic data and the characteristic data tag can be continuously issued to the corresponding appointed hard disk array unit.
If A1 is less than A1 by 85% and B1 is less than B1 by 89% within 45min, the issuing states of the characterization feature data and the feature data tag are abnormal, and then alarm information is sent. And dividing the storage performance gears of the hard disk array units again based on the current load state value until A1 is greater than or equal to A1 by 85%, B1 is greater than or equal to B1 by 89%, determining the current first performance gear, and sending tag modification information to prompt a user to modify the first performance gear of the characteristic data tag into the current first performance gear.
According to the data issuing method provided by the invention, the service module, the front end module, the main control module and the high-speed, medium-speed, low-speed and three-speed disk array module can be subjected to dynamic fine management through the characteristic data label management module, and particularly multiple FDT strategy processing is performed in a high-availability mode, so that abnormal situations that a cluster cannot normally bear front end service and the like due to high-load complex service model pressure (including complex characteristic data labels) in an extreme scene are avoided, and the usability of a complete machine system is further improved.
Based on the same inventive concept, the invention also provides a data management system. The data management system provided by the invention comprises a characteristic data tag management module and a hard disk storage array module connected with the characteristic data tag management module. The characteristic data tag management module comprises: the system comprises a data reading unit, a distribution determining unit and a data issuing unit, wherein the data reading unit is used for reading characteristic data generated under a current service scene and characteristic data labels corresponding to the characteristic data; the distribution determining unit is used for determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data label in the hard disk storage array module respectively; the data issuing unit is used for issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit; the hard disk storage array module comprises a first hard disk array unit and a second hard disk array unit, wherein the first hard disk array unit is used for storing characteristic data, and the second hard disk array unit is used for storing characteristic data labels. According to the data management system provided by the invention, the characteristic data tags can be subjected to targeted management through the characteristic data tag management module, so that the characteristic data and the characteristic data tags are respectively issued to the corresponding hard disk array units in the hard disk storage array module, and further the corresponding hard disk array units are subjected to targeted receiving and storage, thereby improving the data processing efficiency of the hard disk storage array module and being beneficial to improving the usability of the server system.
As shown in fig. 3, the data management system includes: a characteristic data tag management module 310 and a hard disk storage array module 320 connected to the characteristic data tag management module 310.
The feature data tag management module 310, a data reading unit, a distribution determining unit and a data issuing unit, wherein the data reading unit is used for reading feature data generated under the current service scene and feature data tags corresponding to the feature data; the distribution determining unit is configured to determine a first hard disk array unit corresponding to the feature data and a second hard disk array unit corresponding to the feature data tag in the hard disk storage array module 320; the data issuing unit is used for issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit.
In the embodiment of the present invention, the feature data tag management module 310 may be understood as a module for performing targeted management on feature data tags, and may be capable of reading generated feature data and feature data tags corresponding to the feature data in a process of operating a server in a current service scenario, further sending the feature data to a first hard disk array unit corresponding to the feature data in the hard disk storage array module 320 for storage, sending the feature data tag corresponding to the feature data to a second hard disk array unit corresponding to the hard disk storage array module 320 for storage, so that when the hard disk storage array module 320 stores the feature data, it is not required to wait until the feature data tag corresponding to the feature data is identified, thereby not only improving the data storage efficiency of the hard disk storage array module 320, but also implementing targeted management on the feature data tag,
In some alternative implementations, the feature data tag management module 310 may be provided on a programmable logic device on a board. For example: the feature data tag management module 310 may be a ARM (Advanced RISC Machines) chip or FPGA (Field Programmable Gate Array) chip.
The hard disk storage array module 320 includes a first hard disk array unit for storing the feature data and a second hard disk array unit for storing the feature data tag.
In the embodiment of the invention, the characteristic data is directly issued to the first hard disk array unit, and the characteristic data is directly issued to the second hard disk array unit, so that the hard disk array unit which needs to store the characteristic data and the characteristic data tag is not needed to be judged by the hard disk storage array module 320, the situation that the data are accumulated and cannot be stored in time can be effectively avoided, and the usability of the server system is improved.
According to the data management system provided by the embodiment, the characteristic data tags can be subjected to targeted management through the characteristic data tag management module, so that the characteristic data and the characteristic data tags are respectively issued to the corresponding hard disk array units in the hard disk storage array module, and further the corresponding hard disk array units are subjected to targeted receiving and storage, so that the data processing efficiency of the hard disk storage array module can be improved, and the usability of the server system is improved.
In some alternative examples, the data transmission efficiency corresponding to the plurality of hard disk array units may be the same or different. If the data transmission efficiency corresponding to the hard disk array units is the same, the maximum hard disk storage space is facilitated. If the data transmission efficiency corresponding to the plurality of hard disk array units is different, the data management system is beneficial to meeting different storage requirements of users when the users use the data management system to store data, so that the usability of the whole system is improved. For example: three hard disk array units with different data transmission efficiency are obtained in advance, and the method comprises the following steps: high-speed hard disk array unit, medium-speed hard disk array unit and low-speed hard disk array unit. The number of the high-speed hard disk array units, the medium-speed hard disk array units or the low-speed hard disk array units in the plurality of hard disk array units is at least 1. The high-speed hard Disk array unit may be a single-layer storage unit (SLC) SSD or a double-layer storage unit (MLC) Solid State Disk (Solid State Disk or Solid State Drive, SSD). The medium speed hard disk array unit may be a three layer memory cell (TLC) SSD or a four layer memory cell (QLC) SSD. The low-speed Hard Disk array unit may be a Hard Disk Drive (HDD), a tape library, or an optical Disk array.
As shown in fig. 4, the data management system further includes: the control module 330 is connected to the feature data tag management module 310, and is configured to generate feature data and a feature data tag corresponding to the feature data in the current service scenario. The control module 330 carries storage system software and can generate feature data and feature data labels corresponding to the feature data in the process of running the server. In an implementation scenario, if the control module 330 is a control module of a storage array, the control modules may be communicatively interconnected with each other by a cache module based on a high-speed data link such as Fibre Channel (FC), infiniband (IB), internet protocol (Internet Protocol, IP), roCE (an Internet protocol (Internet) layer protocol), etc.
In some alternative embodiments, the data management system further comprises: the service module 340 is connected to the feature data tag management module 310 and the control module 330 through the front end module 350, and the service module 340 is used for providing an operating environment of a current service scenario. In some implementation scenarios, the service module 340 may be understood as a service server capable of providing an operating environment for operating the current service scenario, and further, the control module 10 may generate feature data and a feature data tag corresponding to the feature data during the process of operating the current service scenario. The current service scenario may be determined according to the user requirement, which is not limited in the present invention.
In some alternative embodiments, the service module 340 is further configured to send data storage instructions to the feature data tag management module 310; the feature data tag management module 310 is further configured to receive a data storage instruction, and determine, according to the data storage instruction, a first hard disk array unit corresponding to the feature data and a second hard disk array unit corresponding to the feature data tag, respectively; the hard disk storage array module 320 includes a plurality of hard disk array units, where the first hard disk array unit and the second hard disk array unit are the same hard disk array unit; or the first hard disk array unit and the second hard disk array unit are different hard disk array units.
That is, when storing the feature data and the feature data tag, the feature data tag management module 310 may determine whether to store the feature data and the feature data tag in the same hard disk array unit or store the feature data and the feature data tag in different hard disk array units according to the received data storage instruction, so that the feature data and the feature data tag storage manner is more convenient, and the data transmission efficiency and the storage effectiveness can be improved, thereby being beneficial to saving the data issuing time.
In some alternative embodiments, the control module 330 is further configured to generate first real-time performance data of the feature data and second real-time performance data of the feature data tag, and send the first real-time performance data and the second real-time performance data to the front-end module 350, so as to feed back the first real-time performance data and the second real-time performance data to the service module through the front-end module 350; the front end module 350 is connected with the feature data tag management module 310; the feature data tag management module 310 obtains first real-time performance data of the feature data and second real-time performance data of the feature data tag from the business module 340, the front-end module 350, and/or the control module 330. The first real-time performance data can be understood as the real-time performance data of the feature data in the current service scene, and the second real-time performance data can be understood as the real-time performance data of the feature data tag in the current service scene.
In some alternative embodiments, the feature data tag management module 310 further includes: the mode determining unit is used for determining a data transmission mode of data transmission in the current service scene; the first data acquisition unit is used for determining first performance reference data of the characteristic data in a data transmission mode and determining second performance reference data of the characteristic data tag in the data transmission mode based on preset configuration information; the period determining unit is used for determining a target detection period according to the working mode issued by the current data; the second data acquisition unit is used for acquiring first real-time performance data of the characteristic data and second real-time performance data of the characteristic data tag in a target detection period; the third data acquisition unit is used for respectively acquiring a first comparison result between the first real-time performance data and the first performance reference data and acquiring a second comparison result between the second real-time performance data and the second performance reference data; and the issuing execution unit is used for issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit based on the first comparison result and the second comparison result. In order to avoid the situation that the normal operation of the server system is affected due to the fact that the generated amounts of the feature data and the feature data labels are not matched with the storage amount, the feature data label management module 310 determines the data transmission mode corresponding to the current service scene first so as to clearly determine the generated situation of the feature data and the feature data labels in the theoretical state of the data transmission mode. The data transmission modes may include, but are not limited to, the following modes: size data block transfer mode, sequential/random transfer mode, read/write mode. And then, based on the data transmission mode, the current working mode of the characteristic data tag management module, the first real-time performance data and the second real-time performance data, the characteristic data and the characteristic data tag are issued to the appointed hard disk array unit.
In some optional embodiments, the issuing execution unit is configured to, when the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value, and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value, characterize the issuing states of the feature data and the feature data tag to be normal, and then issue the feature data to the first hard disk array unit and issue the feature data tag to the second hard disk array unit. The first threshold is a product between the first performance reference data and the first weight, and the second threshold is a product between the second performance reference data and the second weight. The first threshold may be understood as an early warning threshold that may be abnormal in the feature data distribution. The second threshold may be understood as an early warning threshold that may be abnormal when the feature data tag issues.
In some alternative embodiments, the feature data tag management module 310 further includes: a fourth data acquisition unit, configured to acquire a load status value of a current service scenario; the first dividing unit is used for dividing at least one test area in each hard disk array unit in the hard disk storage array module based on the load state value to obtain a first number of test areas; the test unit is used for performing performance simulation test on the first number of test areas based on the load state value to obtain a performance simulation test result; the second dividing unit is used for dividing the performance gears of the storage areas of the hard disk array units based on the performance simulation test result to obtain a second number of storage performance gears, and the different performance gears correspond to different storage areas; the performance gear determining unit is used for respectively determining a first performance gear of the characteristic data tag and a second performance gear of the characteristic data; a matching unit configured to determine a target storage performance gear from a second number of storage performance gears based on a difference between the second performance gear and the first performance gear; the first execution subunit is configured to issue the feature data to a first target storage area corresponding to the second performance gear, issue the feature data tag to a second target storage area corresponding to the target storage performance gear, where the first target storage area corresponds to the first hard disk array unit, and the second target storage area corresponds to the second hard disk array unit. By acquiring the load state value of the current service scene, the occupied storage resources can be matched with the load state value of the current service module in the process of issuing the characteristic data and the characteristic data labels, so that the data issuing and storing are more reasonable and effective, the condition that the server responds untimely is avoided, and the usability of the whole system is improved.
In some alternative embodiments, the feature data tag management module 310 further includes: the prompting unit is used for sending alarm information and/or a current working mode switching request, wherein the alarm information is used for alarming the hard disk storage array module to store characteristic data and the characteristic data label is abnormal. By sending the alarm information and/or the current working mode switching request, the user can perform targeted maintenance on the hard disk storage array module 320 according to the alarm information, thereby reducing loss. The current working mode request is used for requesting to switch the current working mode of the feature data tag management module 20, so that the switched working mode can meet the issuing requirement of the feature data and the feature data tag in the current data transmission mode.
As shown in fig. 5, the data management system further includes: an indication module 360, a serial module 370, or a wireless module 380; the indication module 360 is connected with the prompt unit through the serial port module 370; alternatively, the indication module 360 is connected to the prompt unit through the wireless module 380 in a wireless communication manner; the indication module 360 is configured to receive and display the alarm information, so that the user can quickly and definitely acquire the alarm information.
In some alternative embodiments, the feature data tag management module 310 further includes: the adjusting unit is used for re-acquiring the load state value and re-determining the target storage area based on the load state value and the gear value of the first performance gear; issuing the characteristic data label to a second designated hard disk array unit corresponding to the new target storage area; and until the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value, the sending of the alarm information is canceled, so that the dynamic management of the characteristic data labels can be realized.
In some alternative embodiments, the feature data tag management module 310 further includes: the information sending unit is used for sending tag modification information, and the tag modification information is used for prompting a user to modify a first performance gear in the characteristic data tag so that the user can receive the tag modification information to modify the characteristic data tag in a targeted manner, and therefore, when the characteristic data of the same characteristic data tag are stored later, the characteristic data can be rapidly issued to a correct appointed hard disk array unit, and the data storage efficiency is improved.
In some optional embodiments, the service module, the front-end module, the control module and the hard disk storage array module are embedded with the same data management policy as the characteristic data tag management module, so that mutual verification can be performed on the policies, stability of data distribution is guaranteed, and usability of the distributed storage system is improved.
Based on the same inventive concept, the invention also provides a server, comprising any one of the data management systems provided by the invention. According to the server provided by the invention, the characteristic data to be issued and the characteristic data label can be subjected to targeted dynamic management through the characteristic data label management module, so that the generation and issuing of the characteristic data and the characteristic data label can reach an equilibrium state, the stability and the reliability of the storage data of the storage system can be ensured, and the usability of the whole system can be enhanced.
The embodiment of the invention also provides a server which is provided with the data issuing device shown in the figures 3-5.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a server according to an alternative embodiment of the present invention, as shown in fig. 6, the server includes: one or more processors 610, memory 620, and interfaces for connecting components, including high-speed interfaces and low-speed interfaces. The various components are communicatively coupled to each other using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the server, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display apparatus coupled to the interface. In some alternative embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple servers may be connected, with each device providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 610 is illustrated in fig. 6.
The processor 610 may be a central processor, a network processor, or a combination thereof. The processor 610 may further include a hardware chip, among others. The hardware chip may be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general-purpose array logic, or any combination thereof.
Wherein the memory 620 stores instructions executable by the at least one processor 610 to cause the at least one processor 610 to perform methods illustrated by implementing the embodiments described above.
Memory 620 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the server, etc. In addition, memory 620 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, memory 620 may optionally include memory located remotely from processor 610, which may be connected to the server via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Memory 620 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, hard disk, or solid state disk; memory 620 may also include a combination of the types of memory described above.
The server further comprises input means 630 and output means 640. The processor 610, memory 620, input devices 630, and output devices 640 may be connected by a bus or other means, for example in fig. 6.
The input device 630 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the server, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer stick, one or more mouse buttons, a track ball, a joystick, and the like. The output device 640 may include a display apparatus, an auxiliary lighting device (e.g., LED), a haptic feedback device (e.g., vibration motor), and the like. Such display devices include, but are not limited to, liquid crystal displays, light emitting diodes, displays and plasma displays. In some alternative implementations, the display device may be a touch screen.
The embodiments of the present invention also provide a computer readable storage medium, and the method according to the embodiments of the present invention described above may be implemented in hardware, firmware, or as a computer code which may be recorded on a storage medium, or as original stored in a remote storage medium or a non-transitory machine readable storage medium downloaded through a network and to be stored in a local storage medium, so that the method described herein may be stored on such software process on a storage medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware. The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, a solid state disk or the like; further, the storage medium may also comprise a combination of memories of the kind described above. It will be appreciated that a computer, processor, microprocessor controller or programmable hardware includes a storage element that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the methods illustrated by the above embodiments.
Although embodiments of the present invention have been described in connection with the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope of the invention as defined by the appended claims.

Claims (21)

1. A method of data delivery, the method comprising:
reading characteristic data generated under a current service scene and a characteristic data tag corresponding to the characteristic data;
determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag in a hard disk storage array module;
the characteristic data is issued to the first hard disk array unit, the characteristic data label is issued to the second hard disk array unit, so that the first hard disk array unit stores the characteristic data, and the second hard disk array unit stores the characteristic data label;
the issuing the feature data to the first hard disk array unit and the feature data tag to the second hard disk array unit includes: determining a data transmission mode of data transmission of the current service scene; determining first performance reference data of the characteristic data in the data transmission mode and determining second performance reference data of the characteristic data tag in the data transmission mode based on preset configuration information; determining a target detection period according to the working mode issued by the current data; acquiring first real-time performance data of the characteristic data and second real-time performance data of the characteristic data tag in the target detection period; respectively acquiring a first comparison result between the first real-time performance data and the first performance reference data and a second comparison result between the second real-time performance data and the second performance reference data; based on the first comparison result and the second comparison result, issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit;
The issuing the feature data to the first hard disk array unit and the feature data tag to the second hard disk array unit based on the first comparison result and the second comparison result includes: if the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value, and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value, the characteristic data is issued to the first hard disk array unit, and the characteristic data label is issued to the second hard disk array unit; the first threshold is a product between the first performance reference data and a first weight, and the second threshold is a product between the second performance reference data and a second weight.
2. The method according to claim 1, wherein the method further comprises:
acquiring a load state value of running the current service scene;
dividing at least one test area in each hard disk array unit in the hard disk storage array module based on the load state value to obtain a first number of test areas;
performing performance simulation test on the first number of test areas based on the load state value to obtain a performance simulation test result;
Based on the performance simulation test result, performing performance gear division on the storage areas of the hard disk array units to obtain a second number of storage performance gears, wherein different performance gears correspond to different storage areas;
respectively determining a first performance gear of the characteristic data tag and a second performance gear of the characteristic data;
determining a target storage performance gear from the second number of storage performance gears based on a difference between the second performance gear and the first performance gear;
and transmitting the characteristic data to a first target storage area corresponding to the second performance gear, transmitting the characteristic data label to a second target storage area corresponding to the target storage performance gear, wherein the first target storage area corresponds to a first hard disk array unit, and the second target storage area corresponds to a second hard disk array unit.
3. The method according to claim 2, wherein the method further comprises:
if the first comparison result is that the first real-time performance data is smaller than the first threshold value and the second comparison result is that the second real-time performance data is smaller than the second threshold value, sending alarm information and/or a current working mode switching request;
And the alarm information is used for alarming the hard disk storage array module to store the characteristic data and the characteristic data label to have abnormality.
4. A method according to claim 3, characterized in that the method further comprises:
and sending the alarm information to an indication module through a serial port module or a wireless module so that the indication module displays the alarm information.
5. The method according to claim 3 or 4, characterized in that the method further comprises:
the load state value is re-acquired, and the target storage area is re-determined based on the load state value and the gear value of the first performance gear;
issuing the characteristic data label to a second designated hard disk array unit corresponding to the new target storage area;
and canceling the sending of the alarm information until the first comparison result is that the first real-time performance data is greater than or equal to the first threshold value and the second comparison result is that the second real-time performance data is greater than or equal to the second threshold value.
6. The method of claim 5, wherein the method further comprises:
and sending tag modification information, wherein the tag modification information is used for prompting a user to modify the first performance gear in the characteristic data tag.
7. The method of claim 1, wherein the acquiring the first real-time performance data of the feature data and the second real-time performance data of the feature data tag comprises:
and acquiring the first real-time performance data of the characteristic data and the second real-time performance data of the characteristic data tag from a front-end module and/or a control module of the server.
8. The method of claim 1, wherein the hard disk storage array module includes a plurality of hard disk array units, and the determining the first hard disk array unit corresponding to the characteristic data and the second hard disk array unit corresponding to the characteristic data tag includes:
receiving a data storage instruction;
according to the data storage instruction, a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag are respectively determined;
the first hard disk array unit and the second hard disk array unit are the same hard disk array unit;
or, the first hard disk array unit and the second hard disk array unit are different hard disk array units.
9. The method of claim 8, wherein the data storage instruction is sent by a service module, the service module being configured to generate feature data in a current service scenario and a feature data tag corresponding to the feature data, and to provide an operating environment of the current service scenario.
10. A data management system, the data management system comprising: the device comprises a characteristic data tag management module and a hard disk storage array module connected with the characteristic data tag management module;
the characteristic data tag management module comprises: the system comprises a data reading unit, a distribution determining unit and a data issuing unit, wherein the data reading unit is used for reading characteristic data generated under a current service scene and characteristic data labels corresponding to the characteristic data; the distribution determining unit is used for determining a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag in the hard disk storage array module respectively; the data issuing unit is used for issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit;
the hard disk storage array module comprises a first hard disk array unit and a second hard disk array unit, wherein the first hard disk array unit is used for storing the characteristic data, and the second hard disk array unit is used for storing the characteristic data tag;
Wherein, the characteristic data tag management module further comprises: the mode determining unit is used for determining a data transmission mode of data transmission of the current service scene; a first data acquisition unit, configured to determine first performance reference data of the characteristic data in the data transmission mode and determine second performance reference data of the characteristic data tag in the data transmission mode based on preset configuration information; the period determining unit is used for determining a target detection period according to the working mode issued by the current data; a second data acquisition unit, configured to acquire, in the target detection period, first real-time performance data of the feature data and second real-time performance data of the feature data tag; a third data acquisition unit, configured to acquire a first comparison result between the first real-time performance data and the first performance reference data, and acquire a second comparison result between the second real-time performance data and the second performance reference data, respectively; the issuing execution unit is used for issuing the characteristic data to the first hard disk array unit and issuing the characteristic data label to the second hard disk array unit based on the first comparison result and the second comparison result;
The issuing execution unit is configured to issue the feature data to the first hard disk array unit and issue the feature data tag to the second hard disk array unit when the first comparison result is that the first real-time performance data is greater than or equal to a first threshold value and the second comparison result is that the second real-time performance data is greater than or equal to a second threshold value; the first threshold is a product between the first performance reference data and a first weight, and the second threshold is a product between the second performance reference data and a second weight.
11. The data management system of claim 10, wherein the data management system further comprises:
and the control module is connected with the characteristic data tag management module and is used for generating characteristic data and characteristic data tags corresponding to the characteristic data in the current service scene.
12. The data management system of claim 11, wherein the data management system further comprises:
the service module is connected with the characteristic data tag management module and the control module through the front end module, and is used for providing the running environment of the current service scene.
13. The data management system of claim 12, wherein,
the service module is also used for sending a data storage instruction to the characteristic data tag management module;
the characteristic data tag management module is further configured to receive the data storage instruction, and determine a first hard disk array unit corresponding to the characteristic data and a second hard disk array unit corresponding to the characteristic data tag according to the data storage instruction;
the hard disk storage array module comprises a plurality of hard disk array units, and the first hard disk array unit and the second hard disk array unit are the same hard disk array unit; or, the first hard disk array unit and the second hard disk array unit are different hard disk array units.
14. The data management system according to claim 12 or 13, wherein,
the control module is further configured to generate first real-time performance data of the feature data and second real-time performance data of the feature data tag, and send the first real-time performance data and the second real-time performance data to the front-end module, so that the front-end module feeds back the first real-time performance data and the second real-time performance data to the service module;
The front-end module is connected with the characteristic data tag management module;
and the characteristic data tag management module acquires first real-time performance data of the characteristic data and second real-time performance data of the characteristic data tag from the service module, the front-end module and/or the control module.
15. The data management system of claim 10, wherein the feature data tag management module further comprises:
a fourth data acquisition unit, configured to acquire a load status value of the current service scenario;
the first dividing unit is used for dividing at least one test area in each hard disk array unit in the hard disk storage array module based on the load state value to obtain a first number of test areas;
the test unit is used for performing performance simulation test on the first number of test areas based on the load state value to obtain a performance simulation test result;
the second dividing unit is used for dividing the performance gears of the storage areas of the hard disk array units based on the performance simulation test result to obtain a second number of storage performance gears, and the different performance gears correspond to different storage areas;
A performance gear determining unit, configured to determine a first performance gear of the feature data tag and a second performance gear of the feature data, respectively;
a matching unit configured to determine a target storage performance gear from the second number of storage performance gears based on a difference between the second performance gear and the first performance gear;
the first execution subunit is configured to issue the feature data to a first target storage area corresponding to the second performance gear, issue the feature data tag to a second target storage area corresponding to the target storage performance gear, where the first target storage area corresponds to the first hard disk array unit, and the second target storage area corresponds to the second hard disk array unit.
16. The data management system of claim 15, wherein the feature data tag management module further comprises:
the prompting unit is used for sending alarm information and/or a current working mode switching request, and the alarm information is used for alarming the hard disk storage array module to store the characteristic data and the characteristic data label is abnormal.
17. The data management system of claim 16, wherein the data management system further comprises: an indication module, a serial port module or a wireless module;
The indication module is connected with the prompt unit through the serial port module;
or the indication module is in wireless communication connection with the prompt unit through the wireless module;
the indication module is used for receiving and displaying the alarm information.
18. The data management system of claim 16, wherein the feature data tag management module further comprises:
the adjusting unit is used for re-acquiring the load state value and re-determining the target storage area based on the load state value and the gear value of the first performance gear; issuing the characteristic data label to a second designated hard disk array unit corresponding to the new target storage area; and canceling the sending of the alarm information until the first comparison result is that the first real-time performance data is greater than or equal to the first threshold value and the second comparison result is that the second real-time performance data is greater than or equal to the second threshold value.
19. The data management system of claim 18, wherein the feature data tag management module further comprises:
the information sending unit is used for sending tag modification information, and the tag modification information is used for prompting a user to modify the first performance gear in the characteristic data tag.
20. A server comprising the data management system of any one of claims 10 to 19.
21. A computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the data distribution method according to any one of claims 1 to 9.
CN202310908445.9A 2023-07-24 2023-07-24 Data issuing method, data management system, server and storage medium Active CN116627360B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310908445.9A CN116627360B (en) 2023-07-24 2023-07-24 Data issuing method, data management system, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310908445.9A CN116627360B (en) 2023-07-24 2023-07-24 Data issuing method, data management system, server and storage medium

Publications (2)

Publication Number Publication Date
CN116627360A CN116627360A (en) 2023-08-22
CN116627360B true CN116627360B (en) 2023-11-03

Family

ID=87602971

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310908445.9A Active CN116627360B (en) 2023-07-24 2023-07-24 Data issuing method, data management system, server and storage medium

Country Status (1)

Country Link
CN (1) CN116627360B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809493A (en) * 2014-01-28 2015-07-29 上海复旦微电子集团股份有限公司 Radio frequency tag, method for accessing same and electronic system
CN104809420A (en) * 2014-01-28 2015-07-29 上海复旦微电子集团股份有限公司 Device having storage function
CN110609926A (en) * 2019-09-20 2019-12-24 中国银行股份有限公司 Data tag storage management method and device
CN113127847A (en) * 2019-12-30 2021-07-16 华为技术有限公司 Data management method and device
CN113867617A (en) * 2020-06-30 2021-12-31 华为技术有限公司 Storage system and energy-saving control method
CN114594908A (en) * 2022-02-25 2022-06-07 阿里巴巴（中国）有限公司 Data processing method and device based on Solid State Disk (SSD) and storage medium
CN115427945A (en) * 2020-04-30 2022-12-02 国际商业机器公司 Custom metadata tag inheritance based on file system directory tree or object bucket
CN116383207A (en) * 2023-04-03 2023-07-04 广州趣研网络科技有限公司 Data tag management method and device, electronic equipment and storage medium
CN116457885A (en) * 2021-01-30 2023-07-18 华为技术有限公司 Data processing method, device and system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809493A (en) * 2014-01-28 2015-07-29 上海复旦微电子集团股份有限公司 Radio frequency tag, method for accessing same and electronic system
CN104809420A (en) * 2014-01-28 2015-07-29 上海复旦微电子集团股份有限公司 Device having storage function
CN110609926A (en) * 2019-09-20 2019-12-24 中国银行股份有限公司 Data tag storage management method and device
CN113127847A (en) * 2019-12-30 2021-07-16 华为技术有限公司 Data management method and device
CN115427945A (en) * 2020-04-30 2022-12-02 国际商业机器公司 Custom metadata tag inheritance based on file system directory tree or object bucket
CN113867617A (en) * 2020-06-30 2021-12-31 华为技术有限公司 Storage system and energy-saving control method
CN116457885A (en) * 2021-01-30 2023-07-18 华为技术有限公司 Data processing method, device and system
CN114594908A (en) * 2022-02-25 2022-06-07 阿里巴巴（中国）有限公司 Data processing method and device based on Solid State Disk (SSD) and storage medium
CN116383207A (en) * 2023-04-03 2023-07-04 广州趣研网络科技有限公司 Data tag management method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN116627360A (en) 2023-08-22

Similar Documents

Publication Publication Date Title
US9898341B2 (en) Adjustable priority ratios for multiple task queues
CN110493080B (en) Block link point monitoring method and device, electronic equipment and storage medium
US8996925B2 (en) Managing error logs in a distributed network fabric
CN111694646A (en) Resource scheduling method and device, electronic equipment and computer readable storage medium
AU2012398220A1 (en) Data storage method and storage device
CN111338901A (en) Redis monitoring method, Redis monitoring device and terminal
CN110083494A (en) The method and apparatus of hardware error are managed in multi-core environment
US9460101B2 (en) Management of file cache
US10296431B2 (en) Generation of debugging log list in a blade server environment
US20170149864A1 (en) Distributed applications management with dependent resilient distributed services
CN110460653A (en) The method and device of automatic driving vehicle data transmission
CN109117342A (en) A kind of server and its hard disk health status monitoring system
CN110109765A (en) Storage device recognition methods, electronic equipment, system and medium
US9507744B2 (en) Handling two SGPIO channels using single SGPIO decoder on a backplane controller
CN113658351B (en) Method and device for producing product, electronic equipment and storage medium
US20220247641A1 (en) Unobservable node identification
CN116627360B (en) Data issuing method, data management system, server and storage medium
CN112181942A (en) Time sequence database system and data processing method and device
CN116723198A (en) Multi-node server host control method, device, equipment and storage medium
CN116185636A (en) Memory management method, device, equipment and storage medium
US8924644B2 (en) Extending cache in a multi-processor computer
US20180246824A1 (en) System provided with computer and storage apparatus and method for control of system
US20200133681A1 (en) Enabling software sensor power operation requests via baseboard management controller (bmc)
CN111083057A (en) Flow control method and device and computer storage medium
CN111752790A (en) Hard disk state monitoring system and hard disk state monitoring method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant