WO2013159337A1 - 存储控制设备、数据归档存储系统和数据存取方法 - Google Patents

存储控制设备、数据归档存储系统和数据存取方法 Download PDF

Info

Publication number
WO2013159337A1
WO2013159337A1 PCT/CN2012/074825 CN2012074825W WO2013159337A1 WO 2013159337 A1 WO2013159337 A1 WO 2013159337A1 CN 2012074825 W CN2012074825 W CN 2012074825W WO 2013159337 A1 WO2013159337 A1 WO 2013159337A1
Authority
WO
WIPO (PCT)
Prior art keywords
storage
file
control
storage location
storage device
Prior art date
Application number
PCT/CN2012/074825
Other languages
English (en)
French (fr)
Inventor
李勇
施有铸
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201280000592.6A priority Critical patent/CN103069380B/zh
Priority to PCT/CN2012/074825 priority patent/WO2013159337A1/zh
Priority to EP12805422.8A priority patent/EP2757461B1/en
Priority to US13/744,788 priority patent/US20130290658A1/en
Publication of WO2013159337A1 publication Critical patent/WO2013159337A1/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/16Protection against loss of memory contents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3268Power saving in hard disk drive
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0625Power saving in storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0634Configuration or reconfiguration of storage systems by changing the state or mode of one or more devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659Command handling arrangements, e.g. command buffers, queues, command scheduling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0689Disk arrays, e.g. RAID, JBOD
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/50Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Definitions

  • the present invention relates to data archival storage technologies, and more particularly to a storage control device, a data archive storage system, and a data access method. Background technique
  • the archive storage system there are two main implementations of the archive storage system, one is an archive storage system using a hard disk, and the other is an archive storage system using a tape.
  • the archival storage system using the hard disk allows the file management system to directly access the file, and thus the access efficiency is higher than that of the archival storage system using the magnetic tape.
  • a file management system In an archive storage system using a hard disk, a file management system generally accesses files through a distributed file system or the like.
  • the file management system does not know which hard disk is currently being operated by the distributed file system. For example, it does not know which hard disk is being read or written, so it is difficult to perform large-scale inactive disk array storage on the hard disk where the archive file is located (Massive Arrays). Of Idle Disks (MAID) or power down control, so archival storage costs are higher.
  • the invention provides a storage control device, a data archive storage system and a data archive access method for reducing the cost of archival storage.
  • An embodiment of the present invention provides a storage control device, including:
  • a write control unit configured to control the data storage device to write the first file to the first storage location of the data storage device, where the first file is a file to be stored, where the data storage device includes at least one storage a medium, the storage medium being a medium supporting random access data;
  • a readout control unit configured to acquire an identifier of the second file and storage location information of the second file, and control the identifier according to the acquired identifier of the second file and storage location information of the second file
  • the data storage device reads the second file from the second storage location, where the second file is a file to be read;
  • a hard disk control unit configured to send a first hard disk control indication to the data storage device, so that The data storage device performs energy saving control on the storage medium where the first storage location is located; and sends a second hard disk to the data storage device when the storage medium in which the second storage location is located is in a power down or sleep state And controlling the indication to control the data storage device to perform a power-on or sleep recovery operation on the storage medium where the second storage location is located.
  • An embodiment of the present invention provides a data archival storage system, including: a data storage device and a storage control device, where the data storage device includes at least one storage medium, and the storage medium is a medium supporting random access data;
  • the storage control device includes:
  • a write control unit configured to control the data storage device to write the first file to the first storage location of the data storage device, where the first file is a file to be stored
  • a readout control unit configured to acquire an identifier of the second file and storage location information of the second file, and control the identifier according to the acquired identifier of the second file and storage location information of the second file
  • the data storage device reads the second file from the second storage location, where the second file is a file to be read;
  • a hard disk control unit configured to send a first hard disk control indication to the data storage device, so that the data storage device performs energy saving control on a storage medium where the first storage location is located, and where the second storage location is located And sending, by the data storage device, a second hard disk control indication to the data storage device to perform a power-on or sleep recovery operation on the storage medium where the second storage location is located;
  • the data storage device includes:
  • a writing unit configured to write the first file to the first storage location under the control of the write control unit
  • a reading unit configured to read the second file from the second storage location under the control of the readout control unit
  • a control processing unit configured to receive the first hard disk control indication, perform energy saving control on the storage medium where the first storage location is located, and receive the second hard disk control indication according to the first hard disk control indication, And performing a power-on or sleep recovery operation energy-saving operation on the storage medium where the second storage location is located according to the second hard disk control indication.
  • An embodiment of the present invention provides a data archive access method, including:
  • the storage control device receives the storage control request;
  • the write control unit of the storage control device controls the data storage device to write the first file to the first of the data storage device a storage location, where the first file is a file to be stored, where the data storage device includes at least one storage medium, the storage medium is a medium supporting random access data, and the hard disk control unit of the storage control device
  • the data storage device sends a first hard disk control indication, so that the data storage device performs energy saving control on the storage medium where the first storage location is located;
  • the read control unit of the storage control device acquires the identifier of the second file and the storage location information of the second file;
  • the readout control unit powers on or stores the storage medium in which the second storage location is located when the storage medium where the second storage location is in the power-on state, or when the data storage device is in accordance with the second hard disk control indication
  • controlling, by the acquired identifier of the second file element and the storage location information of the second file, the data storage device to read the second file from the second storage location The second file is the file to be read.
  • the storage control device, the data archive storage system, and the data archive access method provided by the embodiment of the present invention, the storage control device directly controls the data storage device to store and read files, and after controlling the data storage device to write the file, to the data storage
  • the device sends a hard disk control instruction to perform energy saving control on the storage medium written to the file, and before the control data storage device reads the file from the storage medium, if the storage medium is in a power down or hibernation state, the hard disk control may be sent to the data storage device.
  • energy-saving control such as MAID or power-down of the storage medium pair is realized, and the cost of the archive storage is reduced.
  • FIG. 1 is a schematic structural diagram of a storage control device according to an embodiment of the present invention.
  • FIG. 2 is a schematic structural diagram of a storage control device according to another embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a data archive storage system according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a data archive storage system according to another embodiment of the present invention
  • FIG. 6 is a flowchart of a data archive access method according to another embodiment of the present invention.
  • FIG. 7 is a flowchart of a data archive access method according to another embodiment of the present invention.
  • FIG. 8 is a flowchart of a data archive access method according to another embodiment of the present invention.
  • FIG. 9 is a flowchart of a data archive access method according to still another embodiment of the present invention.
  • the technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention.
  • the embodiments are a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
  • FIG. 1 is a schematic structural diagram of a storage control device according to an embodiment of the present invention.
  • the storage control device of this embodiment is mainly used for reading and writing control of the data storage device, and controlling the data storage device to perform energy saving control on the storage medium on the data storage device.
  • the data storage device of the embodiment includes at least one storage medium for providing a storage space.
  • the storage medium in the data storage device of the embodiment is a medium supporting random access data, and may be, for example, a hard disk, an optical disk, a USB disk or a memory. Wait. These storage media maintain data for a long time.
  • the memory control device of this embodiment includes: a write control unit 101, a readout control unit 102, and a hard disk control unit 103.
  • the storage control device of the present embodiment includes a processor, a storage medium, various expansion cards, a connection line, a power supply, etc., in addition to the write control unit 101, the readout control unit 102, and the hard disk control unit 103. Module.
  • the write control unit 101 is connected to the data storage device and configured to control the data storage device to write the first file to the first storage location of the data storage device.
  • the first file is a file to be stored, and the first storage location refers to a storage space for storing the first file.
  • the storage medium on the data storage device is a hard disk
  • the first storage location may be a hard disk on the data storage device. More specifically, the first storage location may also be a sector on a certain hard disk.
  • the first storage location is determined by the storage control device, such as a write control ticket that can be stored by the storage control device Determined by element 101.
  • the readout control unit 102 is connected to the data storage device, configured to acquire the identifier of the second file and the storage location information of the second file, and control the data according to the acquired identifier of the second file and the storage location information of the second file.
  • the storage device reads the second file from the second storage location.
  • the second file is the file to be read, and the second storage location refers to the storage space where the second file is located.
  • the second storage location may be a hard disk on the data storage device. More specifically, the second storage location may also be a sector on a certain hard disk.
  • the second storage location is determined by the storage control device when the file is stored, and more specifically by the write control unit 101 of the storage control device when the control data storage device stores the second file.
  • the hard disk control unit 103 is connected to the write control unit 101, the readout control unit 102, and the data storage device, and configured to send the first hard disk control indication to the data storage device, so that the data storage device stores the storage medium where the first storage location is located. Performing energy saving control, and sending a second hard disk control indication to the data storage device to control the data storage device to power on the storage medium where the second storage location is located when the storage medium where the second storage location is located is in a power down or sleep state Or hibernate recovery operation.
  • the energy-saving control performed by the storage control device on the storage medium where the first storage location is located may be performing power-down control on the storage medium where the first storage location is located, performing sleep control on the storage medium where the first storage location is located, and
  • the storage medium where the storage location is located performs the speed reduction control, performs the head hovering control on the storage medium where the first storage location is located, or performs the whole machine power failure control on the data storage device where the storage medium where the first storage location is located, but does not Limited to this. That is, the storage control device can implement various energy saving control operations on a certain storage medium on the data storage device by transmitting the first hard disk control indication to the data storage device.
  • the hard disk control unit 103 sends a first hard disk control instruction or a second hard disk control instruction to the data storage device to instruct the data storage device to perform energy saving control on the storage medium where the first storage location is located or where the second storage location is located.
  • the storage medium may also send other hard disk control indications to the data storage device to instruct the data storage device to perform other control than the storage medium on the storage medium for power saving, power-on or hibernation recovery.
  • the data storage device is controlled to perform full-speed control on the storage medium on the storage device or to perform power-on control on the data storage device where the storage medium is located.
  • the storage control device of the embodiment cooperates with the data storage device to mainly provide access control of the archive file, control of the MAID and power-down of the storage medium, and storage management functions. Since the storage control device of the embodiment can perform control such as MAID or power-down on a storage medium on the data storage device, compared with the prior art, the power-on or power-down control of the entire storage system can be improved. Controlling accuracy, in addition, since the storage control device of the embodiment can perform power-saving control such as power-down, sleep, and speed reduction on the storage medium on the data storage device, it is beneficial to save power, thereby reducing storage control cost.
  • FIG. 2 is a schematic structural diagram of a storage control device according to another embodiment of the present invention. This embodiment can be implemented based on the embodiment shown in Fig. 1.
  • the hard disk control unit 103 of this embodiment includes: a first hard disk control subunit 1031 and a second hard disk control subunit 1032.
  • the first hard disk control subunit 1031 is connected to the write control unit 101 and the data storage device, and configured to send a first hard disk control indication to the data storage device when the storage medium where the first storage location is located meets the energy saving control condition, so that The data storage device performs energy saving control on the storage medium where the first storage location is located.
  • the energy-saving control condition includes: the storage time of the first file in the storage medium where the first storage location is located reaches a preset storage time threshold, and the number of accesses of the first file in the storage medium where the first storage location is located reaches a preset access The time threshold, the storage medium where the first storage location is full, and the waiting time after the storage medium where the first storage location is full reaches at least one of a preset waiting time threshold and a preset control period arrival.
  • the first hard disk control subunit 1031 includes: a first obtaining module 10311, a first determining module 10312, a second obtaining module 10313, and a first sending module 10314.
  • the first obtaining module 10311 is connected to the write control unit 101, and configured to, after the write control unit 101 controls the data storage device to write the first file to the first storage location, according to the first storage location provided by the write control unit 101. Information, obtaining status information of the storage medium where the first storage location is located.
  • the data storage device can report the device status information to the storage control device.
  • the device status information includes an identifier of the data storage device, an identifier and status information of each storage medium on the data storage device, and the like.
  • the status information of the storage medium includes which one of the power-on state, the power-down state, and the sleep state, whether the storage medium is in the full state, the number of accesses of each file on the storage medium, the storage time, and the like. Information, and information such as available storage space on the storage medium.
  • the data storage device can actively report the device status information to the storage control device according to a preset period.
  • the data storage device reports the device status information to the storage control device according to the status reporting indication of the storage control device.
  • the storage control device may include a status information receiving unit (not shown) for receiving the device status information reported by the data storage device and responsible for storing the device status information to a certain storage of the storage control device. In space.
  • the first obtaining module 10311 may specifically search the storage device for storing the device state information of the data storage device on the storage control device to obtain the device state information, and obtain state information of the storage medium where the first storage location is located.
  • the first determining module 10312 is connected to the first obtaining module 10311, and configured to determine, according to the state information of the storage medium where the first storage location is located, whether the storage medium where the first storage location is located satisfies the energy saving control condition.
  • the second acquisition module 10313 is connected to the first determination module 10312, and is configured to obtain an energy-saving operation indication corresponding to the energy-saving control condition when the determination result of the first determination module 10312 is satisfied.
  • the energy-saving operation instruction corresponding to the energy-saving control condition includes: performing power-down control on the storage medium that meets the energy-saving control condition, performing sleep control on the storage medium satisfying the energy-saving control condition, and performing a speed-down control on the storage medium satisfying the energy-saving control condition Performing head hover control on a storage medium that satisfies the energy-saving control condition or performing a power-down control on the data storage device in which the storage medium that satisfies the energy-saving control condition is located.
  • the energy-saving operation indication corresponding to the foregoing energy-saving control condition and the energy-saving control condition may be pre-stored on the storage control device as part of the information in the integrated archiving policy.
  • the first obtaining module 10312 can obtain the state information of the storage medium of the hard disk where the first storage location is located, and the first determining module 10312 can determine Whether the time after the first file is stored reaches one month, and when the judgment result is that the time after the first file is stored reaches one month, it is determined that the storage medium storing the first file (ie, the storage medium where the first storage location is located) is satisfied. Conditions for power down control.
  • the first determining module 10312 may determine the first Whether the storage medium where the storage location is full is full, and after determining that the storage medium where the first storage location is full, further determining whether the length of time after the storage medium where the first storage location is full is one week, when the judgment result is Yes, determine the first storage bit The storage medium in which it is placed satisfies the conditions of the power failure control.
  • the first hard disk control sub-unit 1031 writes the first file to the first control data storage device.
  • a timer can be started, and the timer is set to one month.
  • the first determining module 10312 can determine whether the timer corresponding to the storage medium where the first storage location is located ends. Whether the storage medium where the storage location is located satisfies the condition of the above power failure control.
  • the first sending module 10314 is connected to the second obtaining module 10313 and the data storage device, and configured to send the first hard disk control indication to the data storage device, so that the data storage device performs the energy saving operation on the storage medium where the first storage location is located. Indicates the identified energy saving control.
  • the first hard disk control indication includes the energy saving operation indication acquired by the second obtaining module 10313.
  • the write control unit 101 of the present embodiment includes: a first acquisition sub-unit 1011 and a first transmission sub-unit 1012.
  • the first obtaining subunit 1011 is configured to acquire the first storage location according to the storage location selection policy.
  • the storage location selection policy includes selecting a storage location according to device state information of the data storage device.
  • the device status information of the data storage device includes the identifier and status information of each storage medium on the data storage device.
  • the storage location selection policy is pre-stored on the storage control device, for example, in a storage medium of the storage control device.
  • the first obtaining sub-unit 1011 needs to first obtain a storage location selection policy in the storage medium, and then determine a first storage location according to the obtained storage location selection policy.
  • the storage location selection policy includes selecting a storage location according to device state information of the data storage device, but is not limited thereto.
  • the device status information includes an identifier of the data storage device, a status of the data storage device, an identifier of each storage medium on the data storage device, status information, available storage capacity, and total storage capacity.
  • the first acquisition sub-unit 1011 can determine which storage medium to use to store the first file based on the status information of the storage medium and the available storage capacity.
  • the status information of the storage medium mainly includes an unreadable state, such as a power-down state, a sleep state, a damaged state, a read unavailable state, and a readable state, such as a read available state and a power-on state. Whether the storage medium is full and the status information of each file on the storage medium.
  • the first sending subunit 1012, and the first obtaining subunit 1011, the hard disk control unit 103, and the number According to the storage device connection, the information about the first storage location acquired by the first obtaining subunit 1011 is sent to the hard disk control unit 103, and the information of the first storage location and the first file are sent to the data storage device to enable the data.
  • the storage device stores the first file to the first storage location based on the information of the first storage location.
  • the first sending subunit 1012 is specifically connected to the first obtaining module 10311 of the hard disk control unit 103, and is configured to provide information of the first storage location to the first obtaining module 10311.
  • the data storage device may be one or more. If the data storage device is multiple, the first obtaining sub-unit 1011 is specifically configured to determine the first data storage device from the plurality of data storage devices according to the storage location selection policy (for example, may be the data storage device shown in FIG. 2) And determining a first storage location from the first data storage device.
  • the first sending sub-unit 1012 is specifically configured to obtain an IP address of the first data storage device according to the information of the first data storage device determined by the first obtaining sub-unit 1011, and obtain the first acquiring device according to the IP address of the first data storage device.
  • the unit 1011 determines the information of the first storage location and the first file is sent to the first data storage device.
  • the first obtaining sub-unit 1011 can obtain the IP address of the first data storage device directly from the stored correspondence relationship, where the correspondence between the identifier of the data storage device and the IP address thereof can be preset on the storage control device.
  • the first obtaining sub-unit 1011 may further query the third-party device according to the identifier of the first data storage device to obtain an IP address of the first data storage device.
  • the third-party device stores the correspondence between the identifier of the data storage device and its IP address.
  • the third party device may be a server that stores the identifier of the data storage device and the correspondence between the IP addresses thereof.
  • the identifier of the first data storage device is a domain name
  • the third-party device is a domain name system (DNS) server. If the domain name and the corresponding IP address are configured on the DNS server, the first obtaining sub-unit 1011 can pass the DNS.
  • the query obtains the identity of the first data storage device.
  • DNS domain name system
  • the first obtaining subunit 1011 of the write control unit 101 is further configured to acquire the first file.
  • the first obtaining sub-unit 1011 may receive the file archiving request sent by the third-party system, and obtain the first file from the third-party system according to the file archiving request.
  • the file archive request includes an identifier of the first file and storage location information of the first file on the third-party system.
  • the third-party system mainly refers to systems that need to archive files, such as online storage systems and general information technology (IT) systems.
  • the storage control device of the embodiment has a data transfer function externally and supports multiple file transfer modes, such as a File Transfer Protocol (FTP), a Hypertext Transfer Protocol (HTTP), and a Web-based Web-based Distributed Authoring and Versioning (WebDAV), Common Internet File System (CIFS) or Net File System (NFS).
  • FTP File Transfer Protocol
  • HTTP Hypertext Transfer Protocol
  • WebDAV Web-based Web-based Distributed Authoring and Versioning
  • CIFS Common Internet File System
  • NFS Net File System
  • the first obtaining sub-unit 1011 can obtain the first file from the third-party system through FTP, HTTP, WebDAV, CIFS or NFS according to the file archiving request after receiving the file archiving request sent by the third-party system. .
  • the write control unit 101 may process the first file according to the integrated control policy before the first sending subunit 1012 sends the first file to the data storage device.
  • the write control unit 101 can include a processing sub-unit (not shown) that processes the first file in accordance with an integrated control policy.
  • the integrated control policy may be pre-configured on the storage control device, for example, in a storage medium of the storage control device, and the integrated control policy of the embodiment may also be configured or modified through configuration.
  • the processing sub-unit needs to first obtain an integrated control strategy in the storage medium, and then process the first file according to the acquired integrated control policy.
  • the integrated control policy of this embodiment may include whether to perform digital watermark processing on the first file, whether to encrypt the first file, whether to perform integrity check on the first file, whether to perform file cutting on the first file, and according to cutting
  • the subsequent slice file is stored and at least one of storing the copy of the first file and storing the copy of the first file and the first file at the same time, but is not limited thereto.
  • Different policies can be preset for different categories of files, for example, file cutting for file size exceeding a certain threshold; digital watermark processing for video files, and the like.
  • the storage control device may not cache the first file, but directly send the first file by the first sending subunit 1012. Give data storage devices.
  • the storage control device may first cache the first file, the processing sub-unit processes the first file, and then the first transmitting sub-unit 1012 processes the processing.
  • the first file processed by the unit is sent to the data storage device.
  • the processing sub-unit may specifically be used to cut the first file, and assign an identifier to each slice file after cutting.
  • the first obtaining sub-unit 1011 is specifically configured to obtain a first storage location for each fragment file cut by the processing sub-unit according to the storage location selection policy.
  • the second sending sub-unit 1012 is specifically configured to obtain the first obtaining sub-unit 1011.
  • the information of the first storage location corresponding to each fragment file and each fragment file cut by the processing subunit are sent to the data storage device, so that the data storage device according to the first storage location corresponding to each fragment file
  • the information stores each shard file to the first storage location corresponding to each shard file.
  • the processing subunit may be specifically configured to use the first file acquired by the first obtaining subunit 1011.
  • the first obtaining sub-unit 1011 is specifically configured to obtain, respectively, a corresponding first storage location for each copy file backed up by the first file and the processing sub-unit according to the storage location selection policy.
  • the second sending sub-unit 1012 is specifically configured to use the information of the first storage location corresponding to the first file acquired by the first obtaining sub-unit 1011 and the first file, and each copy file acquired by the first acquiring sub-unit 1011.
  • the information of the first storage location and each copy file that is backed up by the processing subunit are sent to the data storage device, so that the data storage device stores the first file to the first file according to the information of the first storage location corresponding to the first file.
  • the first storage location according to the first storage location corresponding to each copy file
  • the information stores each copy file to the first storage location corresponding to each copy file.
  • the second hard disk control subunit 1032 is connected to the readout control unit 102 and the data storage device, and is configured to send the second hard disk control to the data storage device when the storage medium where the second storage location is located is in a power down or sleep state. Instructing to control the data storage device to perform a power-on or sleep recovery operation on the storage medium in which the second storage location is located, in order to control the data storage device to read the second file from the second storage location.
  • the second hard disk control subunit 1032 includes: a third obtaining module 10321, a second determining module 10322, and a second sending module 10323.
  • a third acquisition module 10321 coupled to the readout control unit 102, for providing a second according to the readout control unit 102 before the readout control unit 102 controls the data storage device to read the second file from the second storage location
  • the location information is stored, and the state information of the storage medium where the second storage location is located is obtained.
  • the third obtaining module 10321 may search for the device state information from the storage space of the device state information of the data storage device on the storage control device, and obtain state information of the storage medium where the second storage location is located.
  • the second determining module 10322 is connected to the third obtaining module 10321, and configured to determine, according to the state information of the storage medium where the second storage location is acquired by the third obtaining module 10321, whether the storage medium where the second storage location is located is powered off or Sleep state.
  • the status information of the storage medium where the second location is obtained by the third obtaining module 10321 includes information about whether the storage medium where the second location is located is in a power-down or sleep state, so the second determining module 10322 can directly determine the second Whether the storage medium where the storage location is located is powered off or hibernated.
  • the second sending module 10323 is connected to the second determining module 10322 and the data storage device, and configured to send a second hard disk control indication to the data storage device to control the data storage device pair when the determining result of the second determining module 10322 is YES.
  • the storage medium where the second storage location is located performs a power-on or sleep recovery operation.
  • the readout control unit 102 of the present embodiment includes: a second acquisition subunit 1021, a third acquisition subunit 1022, a second transmission subunit 1023, and a third transmission subunit. 1024.
  • the second obtaining subunit 1021 is configured to obtain an identifier of the second file.
  • the second obtaining sub-unit 1021 can receive the file read request sent by the third-party system, and obtain the identifier of the second file from the file read request.
  • the file read request includes an identifier of the second file.
  • the readout control unit 102 of the embodiment may further determine the status. Send a file unavailable response to a third-party system.
  • the third obtaining sub-unit 1022 is connected to the second obtaining sub-unit 1021, and configured to perform searching in the file metadata according to the identifier of the second file acquired by the second obtaining sub-unit 1021, and obtain storage location information of the second file.
  • the file metadata includes an identifier of a file stored on the data storage device and storage location information of the file, and the storage location information of the second file includes information of the data storage device and information of the second storage location.
  • the information of the data storage device may be any letter that uniquely identifies the data storage device. Information, such as the IP address, MAC address, and name of the data storage device. Similarly, the information of the storage location of the file on the data storage device may also be any information that uniquely identifies the storage location. For example, if the storage medium on the data storage device is a hard disk, the information about the storage location of the file on the data storage device may be an identifier of the hard disk, but is not limited thereto.
  • the file metadata can be stored on the metadata storage device.
  • 1022 may query the metadata of the file according to the identifier of the second file to obtain the information of the second storage location.
  • the second sending subunit 1023 is connected to the third obtaining subunit 1022 and the hard disk control unit 103, and is configured to send information of the second storage location acquired by the third obtaining subunit 1022 to the hard disk control unit 103. Based on the implementation structure of the hard disk control unit 103 and the implementation structure of the second hard disk control subunit 1032, the second sending subunit 1023 is connected to the third obtaining module 10321 of the second hard disk control subunit 1032 for using the third obtaining module. 10321 provides information of the second storage location.
  • the third sending subunit 1024 is connected to the third obtaining subunit 1022 and the data storage device, when the storage medium where the second storage location is located is in a power-on state, or the data storage device is in accordance with the second hard disk control indication After the storage medium where the storage location is located is powered on or the sleep recovery operation is performed, the information of the second storage location is sent to the data storage device according to the information of the data storage device, so that the data storage device reads the second storage location from the second storage location. file.
  • the third sending subunit 1024 can obtain the data storage device according to the identifier of the data storage device.
  • the IP address is then sent to the data storage device based on the IP address of the data storage device.
  • the corresponding hard disk can be found according to the identification of the hard disk, and then the second file is read from the hard disk.
  • the storage control device of this embodiment may further include: an information receiving unit 104 and/or an information sending unit 105.
  • the information receiving unit 104 is connected to the data storage device, and configured to receive an identifier of each file and a storage location information of each file stored by the data storage device reported by the data storage device, where the storage location information of each file includes data. Information about the storage device and information about where each file is stored on the data storage device.
  • the information transmitting unit 105 is connected to the information receiving unit 104 and the metadata storage device for transmitting the identifier of each file received by the information receiving unit 104 and the storage location information of each file.
  • the metadata storage device is provided for the metadata storage device to recover the file metadata.
  • the information receiving unit 104 is specifically configured to receive an identifier of each file stored by the data storage device and a storage location information of each file that is actively reported by the data storage device. Or
  • the information receiving unit 104 is specifically configured to send a metadata reporting indication to the data storage device, to indicate that the data storage device reports the identifier of each file stored therein and the storage location information of each file, and then receives the data storage device reported by the data storage device.
  • the identifier of each file it stores and the storage location information of each file.
  • the storage control device of the present embodiment can re-acquire the identification and storage of each file from the data storage device through the information receiving unit 104 and the information sending unit 105 in the event that the file metadata on the metadata storage device is lost or damaged.
  • the location information is provided to the metadata storage device, so that the metadata storage device can recover the file metadata, which is beneficial to ensure the reliability of the file metadata.
  • the storage control device of this embodiment can directly control the data storage device to store and read files through each unit or sub-unit. After controlling the data storage device to write the file, send a hard disk control indication to the data storage device to write The storage medium of the file is energy-savingly controlled, and before the control data storage device reads the file from the storage medium, if the storage medium is in a power-down or hibernation state, the hard disk control indication may be sent to the data storage device, and the data storage device controls the data storage device to store the file.
  • the storage medium is powered on or hibernated, and the storage medium is used for data archival storage, and energy-saving control such as MAID or power-down of the storage medium pair is realized, thereby reducing the cost of archival storage.
  • FIG. 3 is a schematic structural diagram of a data archive storage system according to an embodiment of the present invention. As shown in FIG. 3, the system of this embodiment includes: a storage control device 11 and a data storage device 12. The storage control device 11 is connected to the data storage device 12.
  • the data storage device 12 includes at least one storage medium for providing a storage space.
  • the storage medium is a medium supporting random access data, and may be, for example, a hard disk, a USB flash drive, a memory, a optical disk, or the like. These storage media can maintain data for a long time.
  • data storage device 12 can be a storage server or other storage device having a number of storage media.
  • the data storage device 12 of the present embodiment supports control of power down or MAID of the storage medium.
  • the data storage device 12 of this embodiment can also support online capacity expansion.
  • the storage control device 11 mainly provides access control of the archive file, control of the MAID and power-down of the storage medium on the data storage device, and storage management functions.
  • the storage control device 11 of the present embodiment includes: a write control unit 101, a readout control unit 102, and a hard disk control unit 103.
  • the data storage device 12 of the present embodiment includes: a writing unit 121, a reading unit 122, and a control processing unit 123.
  • the storage control device 11 of the present embodiment includes a processor, a storage medium, various expansion cards, a connection line, and a power supply in addition to the write control unit 101, the readout control unit 102, and the hard disk control unit 103. And other modules.
  • the data storage device 12 of the present embodiment includes a processor, various expansion cards, a connection line, a power supply and the like in addition to the writing unit 121, the reading unit 122, and the control processing unit 123.
  • the write control unit 101 is connected to the write unit 121 for controlling the data storage device 12 to write the first file to the first storage location of the data storage device 12, and more specifically for controlling the write unit 121.
  • the first file is written to the first storage location of data storage device 12.
  • the first file is a file to be stored, and the first storage location refers to a storage space for storing the first file.
  • the first storage location may refer to a certain hard disk on the data storage device 12, and the specific first storage location may also be a sector on a certain hard disk. .
  • the first storage location is determined by the storage control device 11, and more specifically by the write control unit 101 of the storage control device 11.
  • the writing unit 121 of the embodiment is configured to write the first file to the first storage location under the control of the storage control device 11, and more specifically, to be the first under the control of the write control unit 101.
  • the file is written to the first storage location for archival storage of the file.
  • the writing unit 121 can write the first file to the first storage location through the file system of the data storage device 12.
  • the readout control unit 102 of the embodiment is connected to the readout unit 122, and configured to acquire the identifier of the second file and the storage location information of the second file, and according to the acquired identifier of the second file and the storage of the second file.
  • Location information the control data storage device reads the second file from the second storage location.
  • the second file is the file to be read, and the second storage location refers to the storage space where the second file is located.
  • the second storage location may be a hard disk on the data storage device. More specifically, the second storage location may also be a sector on a certain hard disk.
  • the second storage location is determined by the storage control device when storing the file, and more specifically by the write control unit 101 of the storage control device when the control data storage device stores the second file.
  • the reading unit 122 of the embodiment is used under the control of the storage control device 11
  • the second storage location reads the second file, and more specifically reads the second file from the second storage location under the control of the readout control unit 102 to effect reading of the archive file.
  • the read unit 122 can read the second file from the second storage location through the file system of the data storage device 12.
  • the hard disk control unit 103 of the embodiment is connected to the write control unit 101, the readout control unit 102, and the control processing unit 123, and configured to send a first hard disk control indication to the data storage device, so that the data storage device stores the first storage.
  • the storage medium where the location is located performs energy saving control, and when the storage medium where the second storage location is located is in a power down or sleep state, sends a second hard disk control indication to the data storage device to control the location of the second storage location of the data storage device
  • the storage medium performs a power-on or sleep recovery operation.
  • the energy-saving control performed by the storage control device on the storage medium where the first storage location is located may be performing power-down control on the storage medium where the first storage location is located, performing sleep control on the storage medium where the first storage location is located, and
  • the storage medium where the storage location is located performs the speed reduction control, performs the head hovering control on the storage medium where the first storage location is located, or performs the whole machine power failure control on the data storage device where the storage medium where the first storage location is located, but does not Limited to this. That is, the storage control device can implement various energy saving control operations on a certain storage medium on the data storage device by transmitting the first hard disk control indication to the data storage device.
  • the hard disk control unit 103 sends a first hard disk control instruction or a second hard disk control instruction to the data storage device to instruct the data storage device to perform energy saving control on the storage medium where the first storage location is located or where the second storage location is located.
  • the storage medium may also send other hard disk control indications to the data storage device to instruct the data storage device to perform other control than the storage medium on the storage medium for power saving, power-on or hibernation recovery.
  • the data storage device is controlled to perform full-speed control on the storage medium on the storage device or to perform power-on control on the data storage device where the storage medium is located.
  • control processing unit 123 of the embodiment is configured to receive the first hard disk control indication sent by the hard disk control unit 103, and perform energy saving control on the storage medium where the first storage location is located according to the first hard disk control instruction, and receive the hard disk.
  • the storage control device cooperates with the data storage device to mainly provide access control of the archive file, MAID and power down of the storage medium, and the like. Control, and storage management functions, etc. Because the storage control device in the system of the embodiment can perform control such as MAID or power-down on a storage medium on the data storage device, compared with the prior art, only the entire storage system can be powered on or powered down. The control precision is improved. In addition, since the storage control device in the system of the embodiment can perform energy-saving control such as power-down, sleep, and speed reduction on the storage medium on the data storage device, it is beneficial to save power, thereby reducing storage control cost.
  • FIG. 4 is a schematic structural diagram of a data archive storage system according to another embodiment of the present invention.
  • the present embodiment is implemented based on the foregoing embodiment.
  • the hard disk control unit 103 of the present embodiment includes: a first hard disk control subunit 1031 and a second hard disk control subunit 1032.
  • the first hard disk control subunit 1031 is connected to the write control unit 101 and the control processing unit 123, and is configured to send the first to the control processing unit 123 of the data storage device 12 when the storage medium in which the first storage location is located satisfies the energy saving control condition
  • a hard disk control indication causes the control processing unit 123 of the data storage device 12 to perform energy saving control on the storage medium in which the first storage location is located.
  • the energy-saving control condition includes: the storage time of the first file in the storage medium where the first storage location is located reaches a preset storage time threshold, and the number of accesses of the first file in the storage medium where the first storage location is located reaches a preset access The time threshold, the storage medium where the first storage location is full, and the waiting time after the storage medium where the first storage location is full reaches at least one of a preset waiting time threshold and a preset control period arrival.
  • the first hard disk control subunit 1031 includes: a first obtaining module 10311, a first determining module 10312, a second obtaining module 10313, and a first sending module 10314.
  • the first obtaining module 10311 is connected to the write control unit 101 for writing to the control unit
  • the state information of the storage medium where the first storage location is located is obtained according to the information of the first storage location provided by the write control unit 101. .
  • the data storage device 12 can report the device status information to the storage control device 11.
  • the device status information includes an identifier of the data storage device 12, an identification and status information of each storage medium on the data storage device 12, and the like.
  • the status information of the storage medium includes which one of the power-on state, the power-down state, and the sleep state, whether the storage medium is in the full state, the number of accesses of each file on the storage medium, the storage time, and the like. Information, and information such as available storage space on the storage medium.
  • the data storage device 12 can actively forward to the storage control device 11 according to a preset period. Report device status information. Alternatively, the data storage device 12 reports the device status information to the storage control device 11 according to the status reporting indication of the storage control device 11.
  • the storage control device 12 may include a status information receiving unit (not shown) for receiving the device status information reported by the data storage device 11 and for storing the device status information to the storage control device 11. In a storage space.
  • the first obtaining module 10311 may specifically search the storage device 11 for storing the device state information in the storage space of the device state information of the data storage device 12, and obtain the state information of the storage medium where the first storage location is located.
  • the first determining module 10312 is connected to the first obtaining module 10311, and configured to determine, according to the state information of the storage medium where the first storage location is located, whether the storage medium where the first storage location is located satisfies the energy saving control condition.
  • the second acquisition module 10313 is connected to the first determination module 10312, and is configured to obtain an energy-saving operation indication corresponding to the energy-saving control condition when the determination result of the first determination module 10312 is satisfied.
  • the energy-saving operation instruction corresponding to the energy-saving control condition includes: performing power-down control on the storage medium that meets the energy-saving control condition, performing sleep control on the storage medium satisfying the energy-saving control condition, and performing a speed-down control on the storage medium satisfying the energy-saving control condition Performing head hover control on a storage medium that satisfies the energy-saving control condition or performing a power-down control on the data storage device in which the storage medium that satisfies the energy-saving control condition is located.
  • the energy-saving operation indication corresponding to the foregoing energy-saving control condition and the energy-saving control condition may be pre-stored on the storage control device as part of the information in the integrated archiving policy.
  • the first obtaining module 10312 can obtain the state information of the storage medium of the hard disk where the first storage location is located, and the first determining module 10312 can determine Whether the time after the first file is stored reaches one month, and when the judgment result is that the time after the first file is stored reaches one month, it is determined that the storage medium storing the first file (ie, the storage medium where the first storage location is located) is satisfied. Conditions for power down control.
  • the first determining module 10312 may determine the first Whether the storage medium where the storage location is full is full, and after determining that the storage medium where the first storage location is full, further determining whether the length of time after the storage medium where the first storage location is full is one week, when the judgment result is Yes, determine the first storage bit The storage medium in which it is placed satisfies the conditions of the power failure control.
  • the first hard disk control sub-unit 1031 writes the first file to the first control data storage device.
  • a timer can be started, and the timer is set to one month.
  • the first determining module 10312 can determine whether the timer corresponding to the storage medium where the first storage location is located ends. Whether the storage medium where the storage location is located satisfies the condition of the above power failure control.
  • the first sending module 10314 is connected to the second obtaining module 10313 and the control processing unit 123 of the data storage device 12 for transmitting a first hard disk control indication to the control processing unit 123 of the data storage device 12 to enable control of the data storage device.
  • the processing unit 123 performs the energy saving control indicated by the energy saving operation indication on the storage medium where the first storage location is located.
  • the first hard disk control indication includes the energy saving operation indication acquired by the second obtaining module 10313.
  • the write control unit 101 of the present embodiment includes: a first acquisition sub-unit 1011 and a first transmission sub-unit 1012.
  • the first obtaining subunit 1011 is configured to acquire the first storage location according to the storage location selection policy.
  • the storage location selection policy includes selecting a storage location according to device state information of the data storage device 12.
  • the device status information of the data storage device 12 includes the identifier and status information of each storage medium on the data storage device 12.
  • the storage location selection policy is pre-stored on the storage control device 11, for example, in a storage medium of the storage control device 11.
  • the first obtaining sub-unit 1011 needs to first obtain a storage location selection policy in the storage medium, and then determine a first storage location according to the obtained storage location selection policy.
  • the storage location selection policy includes selecting a storage location according to device state information of the data storage device 12, but is not limited thereto.
  • the device status information includes an identifier of the data storage device 12, a status of the data storage device 12, an identification of each storage medium on the data storage device 12, status information, available storage capacity, and total storage capacity.
  • the first acquisition subunit 1011 may determine which storage medium to use to store the first file according to the state information of the storage medium and the available storage capacity.
  • the status information of the storage medium mainly includes an unreadable state, such as a power-down state, a sleep state, a damaged state, a read unavailable state, and a readable state, such as a read available state and a power-on state. Whether the storage medium is full and the status information of each file on the storage medium.
  • the first sending subunit 1012 is connected to the first obtaining subunit 1011, the hard disk control unit 103, and the writing unit 121 of the data storage device 12, and is configured to send information about the first storage location acquired by the first obtaining subunit 1011 to
  • the hard disk control unit 103 transmits the information of the first storage location and the first file to the writing unit 121 of the data storage device 12, so that the writing unit 121 of the data storage device 12 will first according to the information of the first storage location.
  • the file is stored to the first storage location.
  • the first sending subunit 1012 is specifically connected to the first obtaining module 10311 of the hard disk control unit 103, and is configured to provide information of the first storage location to the first obtaining module 10311.
  • the data storage device 12 may be one or more. If the data storage device 12 is multiple, the first obtaining sub-unit 1011 is specifically configured to determine the first data storage device from the plurality of data storage devices 12 according to the storage location selection policy (for example, may be the data storage shown in FIG. 2) The device 12) then determines a first storage location from the first data storage device. The first sending sub-unit 1012 is specifically configured to obtain an IP address of the first data storage device according to the information of the first data storage device determined by the first obtaining sub-unit 1011, and obtain the first acquiring device according to the IP address of the first data storage device. The unit 1011 determines the information of the first storage location and the first file is sent to the first data storage device.
  • the storage location selection policy for example, may be the data storage shown in FIG. 2
  • the device 12 determines a first storage location from the first data storage device.
  • the first sending sub-unit 1012 is specifically configured to obtain an IP address of the first data storage device according to the information of the first data storage device determined by the first
  • the first obtaining sub-unit 1011 can obtain the IP address of the first data storage device directly from the stored correspondence relationship, where the correspondence between the identifier of the data storage device 12 and the IP address thereof can be preset on the storage control device. .
  • the first obtaining sub-unit 1011 may further query the third-party device according to the identifier of the first data storage device to obtain an IP address of the first data storage device.
  • the third-party device stores the correspondence between the identifier of the data storage device 12 and its IP address.
  • the third-party device may be a server that stores the identifier of the data storage device 12 and its IP address.
  • the identifier of the first data storage device is a domain name
  • the third-party device is a domain name system (DNS) server. If the domain name and the corresponding IP address are configured on the DNS server, the first obtaining sub-unit 1011 can pass the DNS.
  • the query obtains the identity of the first data storage device.
  • DNS domain name system
  • the first obtaining subunit 1011 of the write control unit 101 is further configured to acquire the first file.
  • the first obtaining sub-unit 1011 may receive the file archiving request sent by the third-party system, and obtain the first file from the third-party system according to the file archiving request.
  • file filing please The identification includes the identifier of the first file and the storage location information of the first file on the third party system.
  • the third-party system mainly refers to systems that need to archive files, such as online storage systems and general information technology (IT) systems.
  • the storage control device 11 of the embodiment has a data transfer function externally and supports multiple file transfer methods, such as FTP, HTTP, WebDAV, CIFS or NFS.
  • the first obtaining sub-unit 1011 can obtain the first file from the third-party system through FTP, HTTP, WebDAV, CIFS or NFS according to the file archiving request after receiving the file archiving request sent by the third-party system. .
  • the write control unit 101 may process the first file according to the integrated control policy before the first sending subunit 1012 sends the first file to the writing unit 121 of the data storage device 12.
  • the write control unit 101 can include a processing sub-unit (not shown) that processes the first file in accordance with an integrated control policy.
  • the integrated control policy may be pre-configured on the storage control device 11, for example, in a certain storage medium of the storage control device 11, and the integrated control policy of the embodiment may also be configured or modified through configuration.
  • the processing subunit needs to first obtain an integrated control strategy in the storage medium, and then process the first file according to the acquired integrated control policy.
  • the integrated control policy of this embodiment may include whether to perform digital watermark processing on the first file, whether to encrypt the first file, whether to perform integrity check on the first file, whether to perform file cutting on the first file, and according to cutting
  • the subsequent slice file is stored and at least one of storing the copy of the first file and storing the copy of the first file and the first file at the same time, but is not limited thereto.
  • Different policies can be preset for different categories of files, for example, file cutting for file size exceeding a certain threshold; digital watermark processing for video files, and the like.
  • the storage control device 11 may not cache the first file, but directly the first file by the first sending subunit 1012. Send to the data storage device.
  • the storage control device 11 may first cache the first file, and the processing sub-unit processes the first file, and then the first transmitting sub-unit 1012 will process the first file. The first file processed by the subunit is sent to the data storage device.
  • the processing sub-unit is specifically configured to cut the first file, and assign an identifier to each of the fragmented files.
  • the first obtaining sub-unit 1011 is specifically configured to use the storage location selection policy as the processing sub-unit.
  • Each of the sliced file files is obtained to obtain a first storage location;
  • the second sending sub-unit 1012 is specifically configured to cut the information of the first storage location and the processing subunit corresponding to each of the slice files acquired by the first acquisition subunit 1011.
  • Each of the shard files is sent to the writing unit 121 of the data storage device 12, so that the writing unit 121 of the data storage device 12 will each shard file according to the information of the first storage location corresponding to each shard file. Stored to the first storage location corresponding to each shard file.
  • the processing subunit may be specifically configured to use the first file acquired by the first obtaining subunit 1011.
  • the first obtaining sub-unit 1011 is specifically configured to obtain, respectively, a corresponding first storage location for each copy file backed up by the first file and the processing sub-unit according to the storage location selection policy.
  • the second sending sub-unit 1012 is specifically configured to use the information of the first storage location corresponding to the first file acquired by the first obtaining sub-unit 1011 and the first file, and each copy file acquired by the first acquiring sub-unit 1011.
  • the information of the first storage location and each copy file backed up by the processing subunit are sent to the writing unit 121 of the data storage device 12, so that the writing unit 121 of the data storage device 12 is in accordance with the first storage location corresponding to the first file.
  • Information stores the first file in the first storage location corresponding to the first file, according to each Copy of the file information corresponding to a first storage location to store each copy of a file to a first storage location corresponding to each copy of the file.
  • the second hard disk control subunit 1032 is connected to the readout control unit 102 and the data storage device for controlling the processing unit of the data storage device 12 when the storage medium where the second storage location is located is in a power down or sleep state. 123 transmitting a second hard disk control indication to control the control processing unit 123 of the data storage device to perform a power-on or sleep recovery operation on the storage medium where the second storage location is located, so as to control the readout unit 122 of the data storage device 12 from the second The storage location reads the second file.
  • the second hard disk control subunit 1032 includes: a third obtaining module 10321, a second determining module 10322, and a second sending module 10323.
  • a third acquisition module 10321 coupled to the readout control unit 102, for before the readout control unit 102 controls the readout unit 122 of the data storage device to read the second file from the second storage location,
  • the status information of the storage medium where the second storage location is located is obtained according to the information of the second storage location provided by the read control unit 102.
  • the third obtaining module 10321 may search the storage space of the device state information of the data storage device 12 on the storage control device 11 to find the device state information, and obtain state information of the storage medium where the second storage location is located. .
  • the second determining module 10322 is connected to the third obtaining module 10321, and configured to determine, according to the state information of the storage medium where the second storage location is acquired by the third obtaining module 10321, whether the storage medium where the second storage location is located is powered off or Sleep state.
  • the status information of the storage medium where the second location is obtained by the third obtaining module 10321 includes information about whether the storage medium where the second location is located is in a power-down or sleep state, so the second determining module 10322 can directly determine the second Whether the storage medium where the storage location is located is powered off or hibernated.
  • the second sending module 10323 is connected to the second determining module 10322 and the control processing unit 123 of the data storage device 12, and is configured to send to the control processing unit 123 of the data storage device 12 when the determination result of the second determining module 10322 is YES.
  • the second hard disk control instruction controls the control processing unit 123 of the data storage device to perform a power-on or sleep recovery operation on the storage medium in which the second storage location is located.
  • the readout control unit 102 of the present embodiment includes: a second acquisition subunit 1021, a third acquisition subunit 1022, a second transmission subunit 1023, and a third transmission subunit. 1024.
  • the second obtaining subunit 1021 is configured to obtain an identifier of the second file.
  • the second obtaining sub-unit 1021 can receive the file read request sent by the third-party system, and obtain the identifier of the second file from the file read request.
  • the file read request includes an identifier of the second file.
  • the readout control unit 102 of the embodiment may further determine the status. Send a file unavailable response to a third-party system.
  • the third obtaining sub-unit 1022 is connected to the second obtaining sub-unit 1021, and configured to perform searching in the file metadata according to the identifier of the second file acquired by the second obtaining sub-unit 1021, and obtain storage location information of the second file.
  • the file metadata includes a label of a file stored on the data storage device 12. Storage location information of the file and the file, the storage location information of the second file includes the data storage device
  • the information of the data storage device 12 may be any data storage device that can uniquely identify the data storage device
  • the information of the storage location of the file on the data storage device 12 can also be any information that uniquely identifies the storage location.
  • the storage medium on the data storage device 12 is a hard disk
  • the information of the storage location of the file on the data storage device 12 may be an identifier of the hard disk, but is not limited thereto.
  • system of this embodiment may further include a metadata storage device 13.
  • the file metadata can be stored on the metadata storage device 13. Then, the third obtaining sub-unit 1022 can query the file metadata on the metadata storage device 13 according to the identifier of the second file to obtain the information of the second storage location.
  • the second sending subunit 1023 is connected to the third obtaining subunit 1022 and the hard disk control unit 103, and is configured to send information of the second storage location acquired by the third obtaining subunit 1022 to the hard disk control unit 103. Based on the implementation structure of the hard disk control unit 103 and the implementation structure of the second hard disk control subunit 1032, the second sending subunit 1023 is connected to the third obtaining module 10321 of the second hard disk control subunit 1032 for using the third obtaining module. 10321 provides information of the second storage location.
  • the third sending subunit 1024 is connected to the third obtaining subunit 1022 and the reading unit 122 of the data storage device 12, when the storage medium where the second storage location is located is in the power-on state, or at the data storage device 12 After the power-on or sleep recovery operation is performed on the storage medium where the second storage location is located, the control processing unit 123 sends the information of the second storage location to the data storage device 12 according to the information of the data storage device 12.
  • the control unit 122 is read so that the read unit 122 of the data storage device 12 reads the second file from the second storage location.
  • the third sending subunit 1024 may be based on the identifier of the data storage device 12.
  • the IP address of the data storage device is obtained, and then the identifier of the hard disk is sent to the readout unit 122 of the data storage device 12 according to the IP address of the data storage device 12.
  • the corresponding hard disk can be found based on the identification of the hard disk, and then the second file is read from the hard disk.
  • the storage control device 11 of this embodiment may further include: an information receiving unit 104 and / or information transmitting unit 105.
  • the information receiving unit 104 is connected to the data storage device 12, and configured to receive an identifier of each file and a storage location information of each file stored by the data storage device reported by the data storage device 12, where the storage location information of each file is Information including the data storage device 12 and information on the storage location of each file on the data storage device 12 is included. Specifically, the information receiving unit 104 is connected to the reading unit 122 of the data storage device 12.
  • the information sending unit 105 is connected to the information receiving unit 104 and the metadata storage device 13 for transmitting the identifier of each file received by the information receiving unit 104 and the storage location information of each file to the metadata storage device 13 for the element.
  • the data storage device 13 restores the file metadata.
  • the information receiving unit 104 is specifically configured to receive the identifier of each file stored by the data storage device 12 and the storage location information of each file that is actively reported by the data storage device 12 at the time of startup. Or
  • the information receiving unit 104 is specifically configured to send a metadata reporting indication to the data storage device 12 to instruct the data storage device 12 to report the identifier of each file stored therein and the storage location information of each file, and then receive the data storage device. 12 The identifier of each file stored by it and the storage location information of each file.
  • the storage control device 11 of the present embodiment can reacquire each file from the data storage device 12 through the information receiving unit 104 and the information transmitting unit 105 in the event that the file metadata on the metadata storage device 13 is lost or damaged.
  • the location information is identified and stored, and provided to the metadata storage device 13, so that the metadata storage device 13 can recover the file metadata, which is beneficial to ensure the reliability of the file metadata.
  • the storage control device can directly control the data storage device to store and read the file through each unit or subunit, and send the hard disk control indication to the data storage device after controlling the data storage device to write the file.
  • the hard disk control indication may be sent to the data storage device, and the data storage is controlled.
  • the device performs power-on or hibernation recovery on the storage medium storing the file. While using the storage medium for data archival storage, energy-saving control such as MAID or power-down of the storage medium pair is realized, and the cost of the archive storage is reduced.
  • the storage control device 11 in the foregoing embodiment may be a standalone device, or may be deployed on the data storage device 12 or the metadata storage device 13. That is, the storage control device 11 and the data storage The device 12 may be the same device, or the storage control device 11 may be the same device as the metadata storage device 13.
  • FIG. 5 is a flowchart of a data archive access method according to an embodiment of the present invention. As shown in FIG. 5A, the method in this embodiment includes:
  • Step 501 The storage control device receives the storage control request.
  • the storage control device can receive a storage control request input by the user through a keyboard, a mouse, a touch screen, or the like.
  • the storage control device may also receive a storage control request sent by another device, and the other device may be any device having a function of transmitting information, such as a terminal device of the user, such as a mobile phone, a personal computer, or the like.
  • Step 502 When the storage control request is to write the first file to the data storage device, the write control unit of the storage control device controls the data storage device to write the first file to the first storage location of the data storage device, and store control The hard disk control unit of the device sends a first hard disk control indication to the data storage device, so that the data storage device performs energy saving control on the storage medium where the first storage location is located, where the first file is a file to be stored.
  • the data storage device includes at least one storage medium for providing a storage space.
  • the storage medium is a medium supporting random access data, such as a hard disk, a USB flash drive, a memory, or an optical disk. These storage media maintain data for a long time.
  • Step 503 When the storage control request is to read the second file from the data storage device, the readout control unit of the storage control device acquires the identifier of the second file and the storage location information of the second file; the readout control unit is When the storage medium where the second storage location is in the power-on state, or after the data storage device performs the power-on or sleep recovery operation on the storage medium where the second storage location is located according to the second hard disk control indication, according to the acquired second file The identifier of the element and the storage location information of the second file, the control data storage device reads the second file from the second storage location, and the second file is the file to be read.
  • the storage control device of this embodiment may be the storage control device in the embodiment shown in Fig. 1, Fig. 2, Fig. 3 or Fig. 4.
  • the storage control device controls the data storage device to store the first file through its functional units, reads the second file, performs energy saving control on the storage medium where the first storage location is located, and powers on the storage medium where the second storage location is located or
  • For the process of the sleep recovery operation refer to the description in the embodiment shown in FIG. 1, FIG. 2, FIG. 3 or FIG. 4, and details are not described herein again.
  • the storage control device cooperates with the data storage device to provide primary Access control of file files, control of MAID and power-down of storage media, storage management functions, etc. Since the storage control device of the embodiment can perform control such as MAID or power-down on a storage medium on the data storage device, compared with the prior art, the power-on or power-down control of the entire storage system can be improved. Controlling accuracy, in addition, since the storage control device of the embodiment can perform power-saving control such as power-down, sleep, and speed reduction on the storage medium on the data storage device, it is beneficial to save power, thereby reducing storage control cost.
  • the hard disk control unit of the storage control device sends the first hard disk control indication to the data storage device, so that the data storage device performs energy saving control on the storage medium where the first storage location is located.
  • the hard disk control unit sends a first hard disk control indication to the data storage device when the storage medium where the first storage location meets the power saving control condition, so that the data storage device performs energy saving control on the storage medium in which the first storage location is located.
  • the energy-saving control condition includes: the storage time of the first file in the storage medium where the first storage location is located reaches a preset storage time threshold, and the number of accesses of the first file in the storage medium where the first storage location is located reaches a preset access The time threshold, the storage medium where the first storage location is full, and the waiting time after the storage medium where the first storage location is full reaches at least one of a preset waiting time threshold and a preset control period arrival.
  • the hard disk control unit sends the first hard disk control instruction to the data storage device when the storage medium where the first storage location meets the energy saving control condition, so that the data storage device performs energy saving control on the storage medium where the first storage location is located.
  • Implementations include:
  • the hard disk control unit After the write control unit controls the data storage device to write the first file to the first storage location, the hard disk control unit acquires state information of the storage medium where the first storage location is located according to the information of the first storage location provided by the write control unit;
  • the hard disk control unit determines, according to the state information of the storage medium where the first storage location is located, whether the storage medium where the first storage location is located meets the energy saving control condition;
  • the hard disk control unit acquires the energy saving operation instruction corresponding to the energy saving control condition, and sends a first hard disk control instruction to the data storage device, so that the data storage device performs the energy saving operation on the storage medium where the first storage location is located. Instructing the identified energy saving control; the first hard disk control indication includes the energy saving operation indication.
  • the energy-saving operation instruction corresponding to the energy-saving control condition may include satisfying the energy-saving control condition
  • the storage medium performs power-down control, performs sleep control on a storage medium that satisfies the energy-saving control condition, performs a speed reduction control on a storage medium that satisfies the energy-saving control condition, performs head hover control on the storage medium that satisfies the energy-saving control condition, or satisfies energy saving
  • the data storage device where the storage medium of the control condition is located performs the power-down control of the whole machine.
  • an implementation manner of the write control unit of the storage control device controlling the data storage device to write the first file to the first storage location of the data storage device includes:
  • the write control unit acquires the first storage location according to the storage location selection policy; the storage location selection policy includes: selecting the storage location according to the device state information of the data storage device; wherein the device state information of the data storage device includes each storage medium on the data storage device Identification and status information; the write control unit sends the information of the first storage location to the hard disk control unit, and sends the information of the first storage location and the first file to the data storage device, so that the data storage device is according to the first storage location The information stores the first file to the first storage location.
  • an implementation manner of the read control unit of the storage control device acquiring the identifier of the second file and the storage location information of the second file includes:
  • the readout control unit acquires the identifier of the second file
  • the read control unit searches for the storage location information of the second file according to the identifier of the second file, where the file metadata includes the identifier of the file stored on the data storage device and the storage location information of the file,
  • the storage location information of the second file includes information of the data storage device and information of the second storage location;
  • the readout control unit transmits the information of the second storage location to the hard disk control unit, so that the hard disk control unit acquires the state information of the storage medium where the second storage location is located according to the information of the second storage location.
  • the method of this embodiment further includes: the hard disk control unit, according to the information of the second storage location provided by the readout control unit, before the readout control unit controls the data storage device to read the second file from the second storage location, Obtaining state information of the storage medium where the second storage location is located;
  • the hard disk control unit determines, according to the state information of the storage medium where the second storage location is located, whether the storage medium where the second storage location is located is in a power-down or sleep state;
  • the hard disk control unit When the storage medium where the second storage location is located is in a power-down or sleep state, the hard disk control unit sends a second hard disk control indication to the data storage device to control the data storage device to power on or sleep the storage medium where the second storage location is located. Resume the operation. This will make the readout control unit successful.
  • the control data storage device reads the second file from the second storage location.
  • FIG. 6 is a flowchart of a data archive access method according to another embodiment of the present invention. As shown in FIG. 6, the method of this embodiment includes:
  • Step 601 The write control unit of the storage control device acquires the first file.
  • the first file is a file to be stored.
  • the writing unit of the storage control device can receive the file archiving request sent by the third-party system, and obtain the first file from the third-party system according to the file archiving request.
  • the file archiving request includes the identifier of the first file and the storage location information of the first file on the third party system.
  • the third-party system mainly refers to systems that need to archive files, such as online storage systems, general IT systems, and so on.
  • Step 602 The write control unit of the storage control device selects the first storage location according to the storage location selection policy.
  • the storage location selection policy may include selecting a storage location according to device state information of the data storage device.
  • the device status information of the data storage device may include an identifier of the data storage device, an identifier and status information of each storage medium on the data storage device, and the status information of the storage medium includes whether the storage medium is powered off, hibernated, powered on, or damaged.
  • the status of unavailable, unreadable, etc. also includes the available storage capacity of the storage medium, the total storage capacity, and information about files on the storage medium.
  • the data storage device of this embodiment includes at least one storage medium for use as an archive storage space.
  • Step 603 The write control unit of the storage control device sends the information of the first storage location and the first file to the data storage device, so that the data storage device stores the first file to the first storage location according to the information of the first storage location. in.
  • the storage control device of this embodiment may be the storage control device in the embodiment shown in Fig. 1 or Fig. 2 or Fig. 3 or Fig. 4.
  • the storage control device of this embodiment may be the storage control device in the embodiment shown in Fig. 1 or Fig. 2 or Fig. 3 or Fig. 4.
  • For the process of storing the first file by the write control unit of the storage control device refer to the description in the embodiment shown in FIG. 1 or FIG. 2 or FIG. 3 or FIG. 4, and details are not described herein again.
  • the storage control device and the data storage device cooperate directly to implement archival storage of files.
  • FIG. 7 is a flowchart of a data archive access method according to still another embodiment of the present invention. As shown in FIG. 7, the method of this embodiment includes:
  • Step 701 The storage control device receives the device status information reported by the data storage device.
  • the storage control device can receive device status information that is periodically reported by the data storage device.
  • the storage control device sends a status report indication to the data storage device, and receives the device status information reported by the data storage device according to the status report indication.
  • the device status information of the data storage device may include an identifier of the data storage device, an identifier and status information of each storage medium in the data storage device, and the status information of the storage medium includes whether the storage medium is powered off, hibernated, powered on, The status of the damage is unavailable, unreadable, and the like, and includes the available storage capacity of the storage medium, the total storage capacity, and the like, as well as the information of the files on the storage medium.
  • the data storage device of this embodiment includes at least one storage medium for use as an archive storage space.
  • Step 701 is an optional step.
  • Step 702 The write control unit of the storage control device acquires the first file, and processes the first file according to the integrated control policy.
  • the write control unit of the storage control device may receive the file archive request sent by the third-party system, and obtain the first file from the third-party system according to the file archive request.
  • the file archive request includes an identifier of the first file and storage location information of the first file on the third party system.
  • the third-party system mainly refers to systems that need to archive files, such as online storage systems, general IT systems, and so on.
  • the integrated control strategy may include whether to perform digital watermark processing on the first file, whether to encrypt the first file, whether to perform integrity check on the first file, whether to perform file cutting on the first file, and according to the cut
  • the slice file is stored and whether the first file is backed up and one or a combination of the first file and the first file is stored at the same time, but is not limited thereto.
  • the processing of the first file by the write control unit of the storage control device includes cutting the first file, Each slice file after the cut is assigned an identifier.
  • the processing of the first file by the write control unit of the storage control device includes A file is backed up by a copy, and an identifier is assigned to each copy file.
  • Step 703 The write control unit of the storage control device determines the first storage location according to the storage location selection policy.
  • the storage location selection policy may include selecting a storage location according to device state information of the data storage device.
  • the device status information of the data storage device may include an identifier of the data storage device, an identifier and status information of each storage medium in the data storage device, and the status information of the storage medium includes whether the storage medium is powered off, hibernated, powered on, The status of the damage is unavailable, unreadable, and the like, and includes the available storage capacity of the storage medium, the total storage capacity, and the like, as well as the information of the files on the storage medium.
  • the writing control unit of the storage control device determines that the first storage location comprises: selecting each of the points according to the location selection policy The slice file determines the first storage location.
  • the write control unit of the storage control device determines that the first storage location comprises: The selection policy determines the first storage location for the first file and each copy file.
  • Step 704 The write control unit of the storage control device sends the information of the first storage location and the processed first file to the data storage device, so that the data storage device sends the processed first according to the information of the first storage location.
  • a file is stored in the first storage location, and the information of the first storage location is provided to the hard disk control unit of the storage control device.
  • the write control unit of the storage control device sends the information of the first file and the first storage location to the data storage.
  • the device includes: sending information of the first storage location corresponding to each fragment file and each fragment file to the data storage device.
  • the write control unit of the storage control device sets the first file and the first storage location
  • the sending of the information to the data storage device includes: transmitting the information of the first storage location corresponding to the first file and the first file, and the information of the first storage location corresponding to each copy file and each copy file to the data storage device.
  • Step 705 The hard disk control unit of the storage control device acquires state information of the storage medium where the first storage location is located according to the information of the first storage location provided by the write control unit.
  • Step 706 The hard disk control unit determines, according to the state information of the storage medium where the first storage location is located, whether the storage medium where the first storage location is located meets the energy saving control condition; when the determination result is yes, That is, when satisfied, step 707 is performed; otherwise, the operation is ended.
  • Step 707 The hard disk control unit acquires the energy saving operation instruction corresponding to the energy saving control condition, and sends a first hard disk control instruction to the data storage device, so that the data storage device performs energy saving in the first hard disk control instruction on the storage medium where the first storage location is located.
  • the operation indication indicates the energy saving control; the first hard disk control indication includes an energy saving operation indication of the storage medium where the first storage location is located.
  • the storage control device of this embodiment may be the storage control device in the embodiment shown in Fig. 1 or Fig. 2 or Fig. 3 or Fig. 4.
  • the process of storing the first file by the write control unit of the storage control device and the energy saving control of the storage medium storing the first file by the hard disk control unit can be referred to the embodiment shown in FIG. 1 or FIG. 2 or FIG. 3 or FIG. The description is not repeated here.
  • the storage control device and the data storage device cooperate directly to implement archival storage of files.
  • FIG. 8 is a flowchart of a data archive access method according to still another embodiment of the present invention. As shown in FIG. 8, the method in this embodiment includes:
  • Step 801 The readout control unit of the storage control device acquires an identifier of the second file; the second file is a file to be read.
  • the readout control unit of the storage control device may receive the file read request sent by the third-party system, and obtain the identifier of the second file from the file read request.
  • the file read request includes the identifier of the second file.
  • the data archive reading method of the embodiment further includes: the read control unit of the storage control device sends the second file to the third-party system after acquiring the second file.
  • Step 802 The readout control unit of the storage control device performs a search in the file metadata according to the identifier of the second file, and acquires storage location information of the second file.
  • the file metadata includes an identifier of the file stored on the data storage device and storage location information of the file.
  • the storage location information of the second file includes information of the data storage device and information of the second storage location.
  • Step 803 The readout control unit of the storage control device sends the information of the second storage location to the hard disk control unit of the storage control device.
  • Step 804 The hard disk control unit of the storage control device acquires state information of the storage medium where the second storage location is located according to the information of the second storage location provided by the readout control unit of the storage control device.
  • Step 805 The hard disk control unit of the storage control device determines, according to the state information of the storage medium where the second storage location is located, whether the storage medium where the second storage location is located is in a power-down or sleep state. When the determination result is yes, step 806 is performed. Otherwise, go to step 807.
  • Step 806 The hard disk control unit of the storage control device sends a second hard disk control indication to the data storage device to control the data storage device to perform a power-on or sleep recovery operation on the storage medium where the second storage location is located, and then step 807 is performed.
  • Step 807 The readout control unit of the storage control device sends the information of the second storage location in the storage location information of the second file to the data storage device according to the information of the data storage device in the storage location information of the second file, to control the data.
  • the storage device reads the second file from the second storage location of the data storage device.
  • Step 808 The storage control device receives the second file returned by the data storage device.
  • the storage control device of this embodiment may be the storage control device in the embodiment shown in Fig. 1 or Fig. 2.
  • the read control unit of the storage control device can read the second file and its hard disk control process, and details are not described herein again.
  • the storage control device directly cooperates with the data storage device to cause the data storage device to read the second file, thereby realizing the reading of the archive file.
  • FIG. 9 is a flowchart of a data archive access method according to still another embodiment of the present invention. As shown in FIG. 9, the method in this embodiment includes:
  • Step 901 The readout control unit of the storage control device receives the file read request sent by the third-party system, and obtains the identifier of the second file from the file read request.
  • the file read request includes the identifier of the second file; the second file is the file to be read step 902, and the read control unit of the storage control device searches the file metadata according to the identifier of the second file to obtain the second file.
  • the storage location information of the file includes the identifier of the second file; the second file is the file to be read step 902, and the read control unit of the storage control device searches the file metadata according to the identifier of the second file to obtain the second file.
  • the storage location information of the second file includes information of the data storage device and information of the second storage location.
  • the file metadata of this embodiment may exist on the metadata storage device.
  • Step 903 The readout control unit of the storage control device supplies the storage location information of the second file to the hard disk control unit of the storage control device.
  • Step 904 The hard disk control unit of the storage control device is configured according to the device state of the data storage device. The information is used to determine the state of the second storage location. When the determination result is that the second storage location is in the sleep state or the power-down state in the unreadable state, step 905 is performed; when the determination result is that the second storage location is in the readable state When the determination result is the second storage location damage state or the readout unavailable state, step 908 is performed.
  • Step 905 The hard disk control unit of the storage control device sends a second hard disk control indication to the data storage device to instruct the data storage device to perform a sleep recovery or power-on operation on the second storage location, and then perform step 906.
  • Step 906 The readout control unit of the storage control device sends the information of the second storage location in the storage location information of the second file to the data storage device according to the information of the data storage device in the storage location information of the second file, to control the data.
  • the storage device reads the second file from the second storage location and then performs step 907.
  • Step 907 The readout control unit of the storage control device receives the second file returned by the data storage device, sends the file to the third-party system, and ends the operation.
  • the storage control device can also send the second file to the third-party system.
  • Step 908 The storage control device sends a file unavailable response to the third-party system, and ends the operation.
  • the storage control device of this embodiment may be the storage control device in the embodiment shown in Fig. 1 or Fig. 2 or Fig. 3 or Fig. 4.
  • the readout control unit of the storage control device reads the second file to refer to the description in the embodiment shown in FIG. 1 or FIG. 2 or FIG. 3 or FIG. 4, and details are not described herein again.
  • the storage control device directly cooperates with the data storage device to cause the data storage device to read the second file, thereby realizing the reading of the archive file.
  • the storage control device may receive the identifier of each file and the storage location information of each file stored by the data storage device reported by the data storage device, and upload each file reported by the data storage device.
  • the identification and storage location information for each file is sent to the metadata storage device for the metadata storage device to recover the file metadata.
  • the storage location information of each file includes information of the data storage device and information about a storage location of each file on the data storage device.
  • the storage control device receives the identifier of each stored file and the storage location information of each file that the data storage device actively reports at startup.
  • the storage control device sends a metadata reporting indication to the data storage device, and receives the number.
  • the storage control device and the data storage device directly cooperate, and in the case that the file metadata is lost or damaged, the identifier and each file of each file stored by the data storage device can be obtained from the data storage device.
  • the storage location information is provided to the metadata storage device to enable the metadata storage device to recover the file metadata, thereby ensuring the security and reliability of the file metadata, thereby providing a successful reading or accessing the archive file. The guarantee.
  • the storage of the first file and the process of reading the second file in the data archive access method provided by the embodiment shown in FIG. 5 to FIG. 9 can be performed independently. That is, the storage control device controls the data storage device to perform file storage and control the data storage device for file reading.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Power Sources (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

公开了一种数据归档存储系统。该数据归档存储系统包括数据存储设备和存储控制设备。存储控制设备控制数据存储设备将第一文件写入第一存储位置后,向数据存储设备发送第一硬盘控制指示,以控制对第一存储位置所在的存储介质进行节能控制;并控制数据存储设备对第二位置所在的存储介质进行上电或休眠恢复,然后从第二存储位置读出第二文件;数据存储设备在存储控制设备的控制下执行相应操作。还公开了一种存储控制设备和数据归档存取方法。本方案的存储控制设备和数据存储设备直接配合,实现了对存储硬盘的节能控制,降低了存储成本。

Description

存储控制设备、 数据归档存储系统和数据存取方法 技术领域 本发明涉及数据归档存储技术, 尤其涉及一种存储控制设备、 数据归档 存储系统和数据存取方法。 背景技术
目前归档存储系统主要有两种实现方式, 一种是采用硬盘的归档存储系 统, 一种是采用磁带的归档存储系统。 其中, 与采用磁带的归档存储系统相 比, 由于采用硬盘的归档存储系统允许文件管理系统直接对文件进行存取操 作, 因此, 存取效率较高。
在采用硬盘的归档存储系统中, 文件管理系统一般是通过分布式文件系 统等方式对文件进行存取。 文件管理系统不知道分布式文件系统当前正在对 哪块硬盘进行操作, 例如不知道哪个硬盘正在被读取或写入, 所以难以对归 档文件所在的硬盘进行大规模非活动磁盘阵列存储(Massive Arrays of Idle Disks, MAID )或掉电控制, 因此归档存储的成本较高。 发明内容
本发明提供一种存储控制设备、数据归档存储系统和数据归档存取方法, 用以降低归档存储的成本。
本发明实施例提供一种存储控制设备, 包括:
写入控制单元, 用于控制数据存储设备将第一文件写入所述数据存储设 备的第一存储位置, 所述第一文件为待存储的文件; 其中, 所述数据存储设 备包括至少一个存储介质, 所述存储介质为支持随机存取数据的介质;
读出控制单元, 用于获取第二文件的标识和所述第二文件的存储位置信 息, 并根据获取到的所述第二文件的标识和所述第二文件的存储位置信息, 控制所述数据存储设备从第二存储位置读出所述第二文件, 所述第二文件为 待读取的文件;
硬盘控制单元, 用于向所述数据存储设备发送第一硬盘控制指示, 以使 所述数据存储设备对所述第一存储位置所在的存储介质进行节能控制;以及 在所述第二存储位置所在的存储介质处于掉电或休眠状态时, 向所述数据存 储设备发送第二硬盘控制指示 , 以控制所述数据存储设备对所述第二存储位 置所在的存储介质进行上电或休眠恢复操作。
本发明实施例提供一种数据归档存储系统, 包括: 数据存储设备和存储 控制设备, 所述数据存储设备包括至少一个存储介质, 所述存储介质为支持 随机存取数据的介质;
所述存储控制设备包括:
写入控制单元, 用于控制数据存储设备将第一文件写入所述数据存储设 备的第一存储位置, 所述第一文件为待存储的文件;
读出控制单元, 用于获取第二文件的标识和所述第二文件的存储位置信 息, 并根据获取到的所述第二文件的标识和所述第二文件的存储位置信息, 控制所述数据存储设备从所述第二存储位置读出所述第二文件, 所述第二文 件为待读取的文件;
硬盘控制单元, 用于向所述数据存储设备发送第一硬盘控制指示, 以使 所述数据存储设备对所述第一存储位置所在的存储介质进行节能控制 , 以及 在所述第二存储位置所在的存储介质处于掉电或休眠状态时, 向所述数据存 储设备发送第二硬盘控制指示 , 以控制所述数据存储设备对所述第二存储位 置所在的存储介质进行上电或休眠恢复操作;
所述数据存储设备包括:
写入单元, 用于在所述写入控制单元的控制下将所述第一文件写入所述 第一存储位置;
读出单元, 用于在所述读出控制单元的控制下从所述第二存储位置读出 所述第二文件;
控制处理单元, 用于接收所述第一硬盘控制指示, 并根据所述第一硬盘 控制指示中对所述第一存储位置所在的存储介质进行节能控制 , 以及接收所 述第二硬盘控制指示 , 并根据所述第二硬盘控制指示对所述第二存储位置所 在的存储介质进行上电或休眠恢复操作节能操作。
本发明实施例提供一种数据归档存取方法, 包括:
存储控制设备接收存储控制请求; 当所述存储控制请求为将第一文件写入数据存储设备时, 所述存储控制 设备的写入控制单元控制所述数据存储设备将所述第一文件写入所述数据存 储设备的第一存储位置, 所述第一文件为待存储的文件; 其中, 所述数据存 储设备包括至少一个存储介质, 所述存储介质为支持随机存取数据的介质; 所述存储控制设备的硬盘控制单元向所述数据存储设备发送第一硬盘控制指 示, 以使所述数据存储设备对所述第一存储位置所在的存储介质进行节能控 制;
当所述存储控制请求为从所述数据存储设备中读取第二文件时, 所述存 储控制设备的读出控制单元获取所述第二文件的标识和所述第二文件的存储 位置信息; 所述读出控制单元在第二存储位置所在的存储介质处于上电状态 时 , 或者在所述数据存储设备根据第二硬盘控制指示对所述第二存储位置所 在的存储介质进行上电或休眠恢复操作之后, 根据获取到的所述第二文件元 的标识和所述第二文件的存储位置信息, 控制所述数据存储设备从所述第二 存储位置读出所述第二文件, 所述第二文件为待读取的文件。
本发明实施例提供的存储控制设备、 数据归档存储系统和数据归档存取 方法, 存储控制设备直接控制数据存储设备进行文件的存储和读取, 在控制 数据存储设备写入文件后, 向数据存储设备发送硬盘控制指示, 以对写入文 件的存储介质进行节能控制, 而在控制数据存储设备从存储介质中读出文件 之前, 如果存储介质处于掉电或休眠状态可以向数据存储设备发送硬盘控制 用存储介质进行数据归档存储的同时, 实现了存储介质对的 MAID或掉电等 节能控制, 降低了归档存储的成本。 附图说明 为了更清楚地说明本发明实施例或现有技术中的技术方案, 下面将对实 施例或现有技术描述中所需要使用的附图作一简单地介绍, 显而易见地, 下 面描述中的附图是本发明的一些实施例, 对于本领域普通技术人员来讲, 在 不付出创造性劳动性的前提下, 还可以根据这些附图获得其他的附图。
图 1为本发明一实施例提供的存储控制设备的结构示意图;
图 2为本发明另一实施例提供的存储控制设备的结构示意图; 图 3为本发明一实施例提供的数据归档存储系统的结构示意图; 图 4为本发明另一实施例提供的数据归档存储系统的结构示意图; 图 5为本发明一实施例提供的数据归档存取方法的流程图;
图 6为本发明另一实施例提供的数据归档存取方法的流程图;
图 7为本发明又一实施例提供的数据归档存取方法的流程图;
图 8为本发明又一实施例提供的数据归档存取方法的流程图;
图 9为本发明又一实施例提供的数据归档存取方法的流程图。 具体实施方式 为使本发明实施例的目的、 技术方案和优点更加清楚, 下面将结合本发 明实施例中的附图, 对本发明实施例中的技术方案进行清楚、 完整地描述, 显然, 所描述的实施例是本发明一部分实施例, 而不是全部的实施例。 基于 本发明中的实施例, 本领域普通技术人员在没有做出创造性劳动前提下所获 得的所有其他实施例, 都属于本发明保护的范围。
图 1为本发明一实施例提供的存储控制设备的结构示意图。 本实施例的 存储控制设备主要用于对数据存储设备进行读写控制, 并控制数据存储设备 对数据存储设备上的存储介质进行节能控制等。 本实施例的数据存储设备包 括至少一个存储介质, 用于提供存储空间; 本实施例的数据存储设备中的存 储介质为支持随机存取数据的介质, 例如可以是硬盘、 光盘、 U盘或内存等。 这些存储介质可持久保持数据。 如图 1所示, 本实施例的存储控制设备包括: 写入控制单元 101、 读出控制单元 102和硬盘控制单元 103。
在此说明, 本实施例的存储控制设备除了包括写入控制单元 101、 读出 控制单元 102和硬盘控制单元 103之外, 还包括处理器、 存储介质、 各种扩 展卡、 连接线、 电源等模块。
其中, 写入控制单元 101 , 与数据存储设备连接, 用于控制数据存储设 备将第一文件写入数据存储设备的第一存储位置。 其中, 第一文件为待存储 的文件, 第一存储位置是指用于存储第一文件的存储空间。 以数据存储设备 上的存储介质为硬盘为例, 则第一存储位置可以是数据存储设备上的某个硬 盘, 更为具体的, 第一存储位置还可以是某个硬盘上的扇区等。 通常, 第一 存储位置是由存储控制设备确定的, 例如可以由存储控制设备的写入控制单 元 101确定的。
读出控制单元 102, 与数据存储设备连接, 用于获取第二文件的标识和 第二文件的存储位置信息, 并根据获取到的第二文件的标识和第二文件的存 储位置信息, 控制数据存储设备从第二存储位置读出第二文件。 其中, 第二 文件为待读取的文件, 第二存储位置是指第二文件所在的存储空间。 以数据 存储设备上的存储介质为硬盘为例, 则第二存储位置可以是数据存储设备上 的某个硬盘, 更为具体的, 第二存储位置还可以是某个硬盘上的扇区等。 通 常, 第二存储位置是由存储控制设备在存储文件时确定的, 更为具体的是由 存储控制设备的写入控制单元 101在控制数据存储设备存储第二文件时确定 的。
硬盘控制单元 103 , 与写入控制单元 101、读出控制单元 102和数据存储 设备连接, 用于向数据存储设备发送第一硬盘控制指示, 以使数据存储设备 对第一存储位置所在的存储介质进行节能控制 , 以及在第二存储位置所在的 存储介质处于掉电或休眠状态时, 向数据存储设备发送第二硬盘控制指示, 以控制数据存储设备对第二存储位置所在的存储介质进行上电或休眠恢复操 作。
举例说明, 存储控制设备对第一存储位置所在的存储介质进行的节能控 制可以是对第一存储位置所在的存储介质进行掉电控制、 对第一存储位置所 在的存储介质进行休眠控制、对第一存储位置所在的存储介质进行降速控制、 对第一存储位置所在的存储介质进行磁头悬停控制或对第一存储位置所在的 存储介质所在的数据存储设备进行整机掉电控制, 但不限于此。 也就是说, 存储控制设备通过向数据存储设备发送第一硬盘控制指示, 可以实现对数据 存储设备上的某个存储介质的各种节能控制操作。
在此说明, 硬盘控制单元 103除了向数据存储设备发送第一硬盘控制指 示或第二硬盘控制指示, 以指示数据存储设备对第一存储位置所在的存储介 质进行节能控制或对第二存储位置所在的存储介质进行上电或休眠恢复操作 之外, 还可以向数据存储设备发送其他硬盘控制指示, 以指示数据存储设备 对其上的存储介质进行节能、 上电或休眠恢复之外的其他控制, 例如控制数 据存储设备对其上的存储介质进行全速控制或对存储介质所在数据存储设备 进行整机上电控制等。 由上述可见, 本实施例的存储控制设备通过与数据存储设备相配合, 主 要提供归档文件的存取访问控制, 对存储介质的 MAID及掉电等控制, 以及 存储管理功能等。 由于本实施例的存储控制设备可以对数据存储设备上的某 个存储介质进行 MAID或掉电等控制, 与现有技术中只能对整个存储系统进 行上电或掉电控制相比, 提高了控制精度, 另外, 由于本实施例的存储控制 设备可以对数据存储设备上的存储介质进行掉电、 休眠、 降速等节能控制, 有利于节约电能, 进而降低了存储控制成本。
图 2为本发明另一实施例提供的存储控制设备的结构示意图。 本实施例 可基于图 1所示实施例实现。 如图 2所示, 本实施例的硬盘控制单元 103包 括: 第一硬盘控制子单元 1031和第二硬盘控制子单元 1032。
第一硬盘控制子单元 1031 , 与写入控制单元 101和数据存储设备连接, 用于在第一存储位置所在的存储介质满足节能控制条件时, 向数据存储设备 发送第一硬盘控制指示, 以使数据存储设备对第一存储位置所在的存储介质 进行节能控制。 其中, 节能控制条件包括: 第一存储位置所在的存储介质中 的第一文件的存储时间达到预设存储时间门限、 第一存储位置所在的存储介 质中的第一文件的访问次数达到预设访问次数门限、 第一存储位置所在的存 储介质写满、 第一存储位置所在的存储介质写满后等待的时间达到预设等待 时间门限和预设控制周期到达中的至少一个。
进一步, 第一硬盘控制子单元 1031包括: 第一获取模块 10311、 第一判 断模块 10312、 第二获取模块 10313和第一发送模块 10314。
第一获取模块 10311 , 与写入控制单元 101连接, 用于在写入控制单元 101 控制数据存储设备将第一文件写入第一存储位置后, 根据写入控制单元 101 提供的第一存储位置的信息, 获取第一存储位置所在的存储介质的状态 信息。
可选的, 数据存储设备可以向存储控制设备上报设备状态信息。 所述设 备状态信息包括数据存储设备的标识、 数据存储设备上各存储介质的标识和 状态信息等。 其中, 所述存储介质的状态信息包括存储介质是处于上电状态、 掉电状态和休眠状态中的哪种状态、 存储介质是否处于写满状态、 存储介质 上各文件的访问次数、 存储时间等信息、 以及存储介质上的可用存储空间等 信息。 可选的, 数据存储设备可以按照预设周期, 主动向存储控制设备上报设 备状态信息。 或者, 数据存储设备根据存储控制设备的状态上报指示, 向存 储控制设备上报所述设备状态信息。 例如, 存储控制设备可以包括一个状态 信息接收单元(图中未示出) , 用来接收数据存储设备上报的所述设备状态 信息并负责将所述设备状态信息存储到存储控制设备的某个存储空间中。
基于上述, 第一获取模块 10311具体可以到存储控制设备上存储数据存 储设备的设备状态信息的存储空间中去查找所述设备状态信息, 从中获取第 一存储位置所在的存储介质的状态信息。
第一判断模块 10312, 与第一获取模块 10311 连接, 用于根据第一存储 位置所在的存储介质的状态信息, 判断第一存储位置所在的存储介质是否满 足节能控制条件。
第二获耳 莫块 10313 , 与第一判断模块 10312连接, 用于在第一判断模 块 10312的判断结果为满足时, 获取节能控制条件对应的节能操作指示。
可选的 , 节能控制条件对应的节能操作指示包括对满足节能控制条件的 存储介质进行掉电控制、 对满足节能控制条件的存储介质进行休眠控制、 对 满足节能控制条件的存储介质进行降速控制、 对满足节能控制条件的存储介 质进行磁头悬停控制或对满足节能控制条件的存储介质所在的数据存储设备 进行整机掉电控制。
可选的 , 上述节能控制条件和节能控制条件对应的节能操作指示可以作 为综合归档策略中的部分信息预先存储在存储控制设备上。
举例说明, 如果综合归档策略设定某个文件存入后一个月即掉电, 则第 一获取模块 10311获取到第一存储位置所在硬盘的存储介质的状态信息后, 第一判断模块 10312可以判断第一文件被存储后的时间是否达到一个月, 当 判断结果为第一文件被存储后的时间达到一个月时, 确定存储第一文件的存 储介质 (即第一存储位置所在的存储介质 ) 满足掉电控制的条件。
又例如, 如果综合归档策略设定存储介质写满后等待一周即掉电, 则第 一获取模块 10311获取到第一存储位置所在的存储介质的状态信息后, 第一 判断模块 10312可以判断第一存储位置所在的存储介质是否写满, 并在判断 出第一存储位置所在的存储介质写满后, 进一步判断第一存储位置所在的存 储介质写满后的时间长度是否为一周, 当判断结果为是时, 确定第一存储位 置所在的存储介质满足掉电控制的条件。
再例如,如果综合归档策略设定每一个月对某个存储介质进行一次掉电, 并设定掉电时间,则第一硬盘控制子单元 1031在控制数据存储设备将第一文 件写入第一存储位置后, 可以启动一定时器, 并设置定时器的定时时长为一 个月, 则其第一判断模块 10312可以通过判断第一存储位置所在的存储介质 对应的定时器是否定时结束, 来判断第一存储位置所在的存储介质是否满足 上述掉电控制的条件。
第一发送模块 10314, 与第二获取模块 10313和数据存储设备连接, 用 于向数据存储设备发送第一硬盘控制指示, 以使数据存储设备对第一存储位 置所在的存储介质进行所述节能操作指示所标识的节能控制。 其中, 第一硬 盘控制指示包括第二获取模块 10313获取的所述节能操作指示。
基于上述第一硬盘控制子单元 1031的实现结构,本实施例的写入控制单 元 101包括: 第一获取子单元 1011和第一发送子单元 1012。
第一获取子单元 1011 , 用于根据存储位置选择策略获取第一存储位置。 其中, 存储位置选择策略包括根据数据存储设备的设备状态信息选择存储位 置。 其中, 数据存储设备的设备状态信息包括数据存储设备上各存储介质的 标识和状态信息。
可选的, 存储位置选择策略预先存储在存储控制设备上, 例如存储在存 储控制设备的某个存储介质中。第一获取子单元 1011需要先到该存储介质中 获取存储位置选择策略, 然后在根据获取的存储位置选择策略确定出第一存 储位置。 可选的, 存储位置选择策略包括根据数据存储设备的设备状态信息 选择存储位置, 但不限于此。 其中, 设备状态信息包括数据存储设备的标识, 数据存储设备的状态、 数据存储设备上各存储介质的标识、 状态信息、 可用 存储容量和总存储容量等。
例如,第一获取子单元 1011可以根据存储介质的状态信息以及可用存储 容量确定使用哪个存储介质来存储第一文件。 其中, 存储介质的状态信息主 要包括处于掉电状态、 处于休眠状态、 处于损坏状态、 处于读取不可用状态 等不可读取状态, 以及处于读取可用状态、 处于上电状态等可读取状态、 存 储介质是否写满以及存储介质上各文件的状态信息等。
第一发送子单元 1012, 与第一获取子单元 1011、硬盘控制单元 103和数 据存储设备连接,用于将第一获取子单元 1011获取的第一存储位置的信息发 送给硬盘控制单元 103 , 并将第一存储位置的信息和第一文件发送给数据存 储设备 , 以使数据存储设备根据第一存储位置的信息将第一文件存储到第一 存储位置。基于硬盘控制单元 103的上述实现结构, 第一发送子单元 1012具 体与硬盘控制单元 103的第一获取模块 10311连接, 用于将第一存储位置的 信息提供给第一获取模块 10311。
可选的, 数据存储设备可以是一个也可以是多个。 如果数据存储设备为 多个,则第一获取子单元 1011具体可用于根据存储位置选择策略从多个数据 存储设备中确定第一数据存储设备(例如可以是图 2 中所示的数据存储设 备) , 然后从第一数据存储设备中确定第一存储位置。 第一发送子单元 1012 具体可用于根据第一获取子单元 1011 确定出的第一数据存储设备的信息获 取第一数据存储设备的 IP地址, 根据第一数据存储设备的 IP地址将第一获 取子单元 1011 确定出的第一存储位置的信息和第一文件发送给第一数据存 储设备。
其中,各数据存储设备的标识和其 IP地址的对应关系可以预置在存储控 制设备上,则第一获取子单元 1011可以直接从所存储的对应关系中获取第一 数据存储设备的 IP地址。 另外, 第一获取子单元 1011还可以根据第一数据 存储设备的标识到第三方设备去查询获得第一数据存储设备的 IP地址。其中, 第三方设备存储有数据存储设备的标识和其 IP地址的对应关系。 其中, 第三 方设备可以是一个保存有数据存储设备的标识和其 IP 地址对应关系的服务 器。 例如, 第一数据存储设备的标识是域名, 第三方设备是域名系统 (Domain Name System, DNS)服务器, 在 DNS服务器上配置有域名和对应的 IP地址, 则第一获取子单元 1011可以通过 DNS查询获得第一数据存储设备的标识。
可选的,写入控制单元 101的第一获取子单元 1011还可以用于获取第一 文件。
可选的,第一获取子单元 1011具体可以接收第三方系统发送的文件归档 请求, 根据文件归档请求从第三方系统上获取第一文件。 其中, 文件归档请 求包括第一文件的标识和第一文件在第三方系统上的存储位置信息。 其中, 第三方系统主要是指需要进行文件归档存储的系统, 例如在线存储系统、 一 般的信息技术( Information Technology, IT ) 系统等。 进一步, 本实施例的存储控制设备对外具有数据传送功能, 并且支持多 种文件传送方式, 例如文本传输协议(File Transfer Protocol, FTP ) , 超文本 传输协议( Hypertext Transfer Protocol, HTTP ) , 基于 Web的分布式授权和 版本管理 ( Web-based Distributed Authoring and Versioning, WebDAV ) , 通 用网络文件系统( Common Internet File System, CIFS )或网络文件系统( Net File System, NFS ) 方式等。
基于上述,第一获取子单元 1011更为具体的可以在接收第三方系统发送 的文件归档请求后, 根据文件归档请求通过 FTP, HTTP, WebDAV, CIFS 或 NFS方式从第三方系统上获取第一文件。
可选的,写入控制单元 101在第一发送子单元 1012将第一文件发送给数 据存储设备之前, 可以按照综合控制策略对第一文件进行处理。 例如, 写入 控制单元 101可以包括一处理子单元(图中未示出) , 由该处理子单元按照 综合控制策略对第一文件进行处理。
其中, 综合控制策略可以预先配置在存储控制设备上, 例如存储在存储 控制设备的某个存储介质中, 并且本实施例的综合控制策略还可以通过配置 进行设定或修改。 处理子单元需要先到该存储介质中获取综合控制策略, 然 后在根据获取的综合控制策略对第一文件进行处理。
本实施例的综合控制策略可以包括是否对第一文件进行数字水印处理, 是否对第一文件进行加密处理, 是否对第一文件进行完整性校验、 是否对第 一文件进行文件切割并按照切割后的分片文件进行存储和是否对第一文件进 行副本备份并同时对第一文件和第一文件的副本文件进行存储中的至少一 个, 但不限于此。 其中, 针对不同类别的文件可以预置不同的策略, 例如针 对文件大小超过某个阈值的, 进行文件切割; 对于视频文件均进行数字水印 处理等等。
作为一种实现方式, 如果根据综合控制策略可能判断出无需对第一文件 进行任何处理, 则存储控制设备可以不对第一文件进行緩存, 而是直接由第 一发送子单元 1012将第一文件发送给数据存储设备。 另外, 如果根据综合控 制策略判断出需要对第一文件进行处理 , 则存储控制设备可以先緩存第一文 件, 由处理子单元对第一文件进行处理, 然后由第一发送子单元 1012将处理 子单元处理后的第一文件发送给数据存储设备。 举例说明, 如果综合控制策略包括对第一文件进行切割并按照切割后的 分片文件进行存储, 则处理子单元具体可用于对第一文件进行切割, 为切割 后的每个分片文件分配标识;第一获取子单元 1011具体可用于根据存储位置 选择策略为处理子单元切割出的每个分片文件获取第一存储位置; 第二发送 子单元 1012具体可用于将第一获取子单元 1011获取的每个分片文件对应的 第一存储位置的信息和处理子单元切割出的每个分片文件发送给数据存储设 备, 以使数据存储设备根据每个分片文件对应的第一存储位置的信息将每个 分片文件存储到每个分片文件对应的第一存储位置。
举例说明, 如果综合控制策略包括对第一文件进行副本备份并同时对第 一文件和第一文件的副本文件进行存储, 则处理子单元具体可用于对第一获 取子单元 1011获取的第一文件进行副本备份, 为每个副本文件分配标识; 第 一获取子单元 1011 具体可用于根据存储位置选择策略为第一文件和处理子 单元备份出的每个副本文件获取其分别对应的第一存储位置; 第二发送子单 元 1012具体可用于将第一获取子单元 1011获取的第一文件对应的第一存储 位置的信息和第一文件,以及第一获取子单元 1011获取的每个副本文件对应 的第一存储位置的信息和处理子单元备份出的每个副本文件发送给数据存储 设备, 以使数据存储设备根据第一文件对应的第一存储位置的信息将第一文 件存储到第一文件对应的第一存储位置, 根据每个副本文件对应的第一存储 位置的信息将每个副本文件存储到每个副本文件对应的第一存储位置。
其中, 第二硬盘控制子单元 1032, 与读出控制单元 102和数据存储设备 连接, 用于在第二存储位置所在的存储介质处于掉电或休眠状态时, 向数据 存储设备发送第二硬盘控制指示, 以控制数据存储设备对第二存储位置所在 的存储介质进行上电或休眠恢复操作, 以便于控制数据存储设备从第二存储 位置读出第二文件。
进一步, 第二硬盘控制子单元 1032包括: 第三获取模块 10321、 第二判 断模块 10322和第二发送模块 10323。
第三获耳 莫块 10321 , 与读出控制单元 102连接, 用于在读出控制单元 102控制数据存储设备从第二存储位置读出第二文件之前, 根据读出控制单 元 102提供的第二存储位置的信息, 获取第二存储位置所在的存储介质的状 态信息。 可选的, 第三获取模块 10321 可以从存储控制设备上存储数据存储设备 的设备状态信息的存储空间中去查找所述设备状态信息, 从中获取第二存储 位置所在的存储介质的状态信息。
第二判断模块 10322, 与第三获取模块 10321 连接, 用于根据第三获取 模块 10321获取的第二存储位置所在的存储介质的状态信息, 判断第二存储 位置所在的存储介质是否处于掉电或休眠状态。
其中, 第三获取模块 10321获取到的第二位置所在的存储介质的状态信 息包括第二位置所在的存储介质是否处于掉电或休眠状态的信息, 所以第二 判断模块 10322可以直接判断出第二存储位置所在的存储介质是否处于掉电 或休眠^犬态。
第二发送模块 10323 , 与第二判断模块 10322和数据存储设备连接, 用 于在第二判断模块 10322的判断结果为是时, 向数据存储设备发送第二硬盘 控制指示, 以控制数据存储设备对第二存储位置所在的存储介质进行上电或 休眠恢复操作。
基于上述第二硬盘控制子单元 1032的实现结构,本实施例的读出控制单 元 102包括: 第二获取子单元 1021、 第三获取子单元 1022、 第二发送子单元 1023和第三发送子单元 1024。
第二获取子单元 1021 , 用于获取第二文件的标识。 可选的, 第二获取子 单元 1021可以接收第三方系统发送的文件读取请求,从文件读取请求中获取 第二文件的标识。 其中, 文件读取请求包括第二文件的标识。
可选的,如果第二获取子单元 1021是从第三方系统发送的文件读取请求 中获取到第二文件的标识的, 则本实施例的读出控制单元 102还可以在判断 用状态时, 向第三方系统发送文件不可用响应。
第三获取子单元 1022, 与第二获取子单元 1021 连接, 用于根据第二获 取子单元 1021获取的第二文件的标识在文件元数据中进行查找,获取第二文 件的存储位置信息。 所述文件元数据包括数据存储设备上存储的文件的标识 和文件的存储位置信息, 所述第二文件的存储位置信息包括数据存储设备的 信息和第二存储位置的信息。
其中, 数据存储设备的信息可以是任何可唯一标识该数据存储设备的信 息, 例如数据存储设备的 IP地址、 MAC地址以及名称等。 同理, 文件在数 据存储设备上的存储位置的信息也可以是任何可唯一标识出该存储位置的信 息。 以数据存储设备上的存储介质为硬盘为例, 则文件在数据存储设备上的 存储位置的信息可以是硬盘的标识, 但不限于此。
可选的, 文件元数据可以存储在元数据存储设备上。 则第三获取子单元
1022可以根据第二文件的标识到元数据设备上去查询文件元数据, 获取第二 存储位置的信息。
第二发送子单元 1023 , 与第三获取子单元 1022和硬盘控制单元 103连 接,用于将第三获取子单元 1022获取的第二存储位置的信息发送给硬盘控制 单元 103。 基于上述硬盘控制单元 103 的实现结构以及第二硬盘控制子单元 1032的实现结构, 第二发送子单元 1023与第二硬盘控制子单元 1032的第三 获取模块 10321连接,用于向第三获取模块 10321提供第二存储位置的信息。
第三发送子单元 1024, 与第三获取子单元 1022和数据存储设备连接, 用于在第二存储位置所在的存储介质处于上电状态时, 或在数据存储设备根 据第二硬盘控制指示对第二存储位置所在的存储介质进行上电或休眠恢复操 作之后, 根据数据存储设备的信息, 将第二存储位置的信息发送给数据存储 设备, 以使数据存储设备从第二存储位置读出第二文件。
例如, 如果数据存储设备的信息为数据存储设备的标识, 第二存储位置 的信息为数据存储设备上某个硬盘的标识,则第三发送子单元 1024可以根据 数据存储设备的标识获取数据存储设备的 IP地址, 然后根据数据存储设备的 IP地址将该硬盘的标识发送给数据存储设备。 对数据存储设备来说, 可以根 据该硬盘的标识找到相应的硬盘, 然后从该硬盘中读出第二文件。
可选的, 本实施例的存储控制设备还可以包括: 信息接收单元 104和 /或 信息发送单元 105。
信息接收单元 104, 与数据存储设备连接, 用于接收数据存储设备上报 的数据存储设备所存储的每个文件的标识和每个文件的存储位置信息, 所述 每个文件的存储位置信息包括数据存储设备的信息和每个文件在数据存储设 备上的存储位置的信息。
信息发送单元 105, 与信息接收单元 104和元数据存储设备连接, 用于 将信息接收单元 104接收的每个文件的标识和每个文件的存储位置信息发送 给元数据存储设备以供元数据存储设备对文件元数据进行恢复。
其中, 信息接收单元 104具体可用于接收数据存储设备在启动时主动上 报的其所存储的每个文件的标识和每个文件的存储位置信息。 或者
信息接收单元 104具体可用于向数据存储设备发送元数据上报指示, 以 指示该数据存储设备上报其所存储的每个文件的标识和每个文件的存储位置 信息, 然后接收该数据存储设备上报的其所存储的每个文件的标识和每个文 件的存储位置信息。
本实施例的存储控制设备通过信息接收单元 104和信息发送单元 105, 可以在元数据存储设备上的文件元数据发生丟失或损坏等情况下从数据存储 设备上重新获取每个文件的标识和存储位置信息,并提供给元数据存储设备, 这样元数据存储设备就可以对文件元数据进行恢复, 有利于保证文件元数据 的可靠性。
本实施例的存储控制设备, 通过各单元或子单元可以直接控制数据存储 设备进行文件的存储和读取, 在控制数据存储设备写入文件后, 向数据存储 设备发送硬盘控制指示, 以对写入文件的存储介质进行节能控制, 而在控制 数据存储设备从存储介质中读出文件之前, 如果存储介质处于掉电或休眠状 态可以向数据存储设备发送硬盘控制指示, 控制数据存储设备对存储文件的 存储介质进行上电或休眠恢复, 在采用存储介质进行数据归档存储的同时, 实现了存储介质对的 MAID或掉电等节能控制 , 降低了归档存储的成本。
图 3为本发明一实施例提供的数据归档存储系统的结构示意图。 如图 3 所示, 本实施例的系统包括: 存储控制设备 11和数据存储设备 12。 存储控 制设备 11和数据存储设备 12连接。
其中, 数据存储设备 12包括至少一个存储介质, 用于提供存储空间, 所 述存储介质为支持随机存取数据的介质, 例如可以是硬盘、 U盘、 内存、 光 盘等。 这些存储介质可以持久保持数据。 在具体实现上, 数据存储设备 12可 以是具有若干存储介质的存储服务器或其他存储设备。 本实施例的数据存储 设备 12支持对存储介质的掉电或 MAID等控制。
可选的, 本实施例的数据存储设备 12还可以支持在线扩容。
其中, 存储控制设备 11主要提供归档文件的存取访问控制, 对数据存储 设备上的存储介质的 MAID及掉电等控制, 以及存储管理功能等。 具体的, 本实施例的存储控制设备 11包括: 写入控制单元 101、 读出控 制单元 102和硬盘控制单元 103。 本实施例的数据存储设备 12包括: 写入单 元 121、 读出单元 122和控制处理单元 123。
在此说明, 本实施例的存储控制设备 11除了包括写入控制单元 101、 读 出控制单元 102和硬盘控制单元 103之外, 还包括处理器、 存储介质、 各种 扩展卡、 连接线、 电源等模块。 本实施例的数据存储设备 12除了包括写入单 元 121、 读出单元 122和控制处理单元 123之外, 还包括处理器、 各种扩展 卡、 连接线、 电源等模块。
其中, 写入控制单元 101 , 与写入单元 121连接, 用于控制数据存储设 备 12将第一文件写入数据存储设备 12的第一存储位置, 更为具体的用于控 制写入单元 121将第一文件写入数据存储设备 12的第一存储位置。 其中, 第 一文件为待存储的文件, 第一存储位置是指用于存储第一文件的存储空间。 以数据存储设备 12的存储介质为硬盘为例,则第一存储位置可以是指数据存 储设备 12上的某个硬盘,更为具体的第一存储位置还可以是某个硬盘上的扇 区等。 通常, 第一存储位置是由存储控制设备 11确定的, 更为具体的是由存 储控制设备 11的写入控制单元 101确定的。
相应的, 本实施例的写入单元 121 , 用于在存储控制设备 11的控制下将 第一文件写入第一存储位置, 更为具体的是在写入控制单元 101 的控制下将 第一文件写入第一存储位置, 实现对文件的归档存储。 例如, 写入单元 121 可以通过数据存储设备 12的文件系统, 将第一文件写入第一存储位置。
本实施例的读出控制单元 102, 与读出单元 122连接, 用于获取第二文 件的标识和第二文件的存储位置信息, 并根据获取到的第二文件的标识和第 二文件的存储位置信息, 控制数据存储设备从第二存储位置读出第二文件。 其中, 第二文件为待读取的文件, 第二存储位置是指第二文件所在的存储空 间。 以数据存储设备上的存储介质为硬盘为例, 则第二存储位置可以是数据 存储设备上的某个硬盘, 更为具体的, 第二存储位置还可以是某个硬盘上的 扇区等。 通常, 第二存储位置是由存储控制设备在存储文件时确定的, 更为 具体的是由存储控制设备的写入控制单元 101在控制数据存储设备存储第二 文件时确定的。
相应的, 本实施例的读出单元 122, 用于在存储控制设备 11的控制下从 第二存储位置读出第二文件, 更为具体的是在读出控制单元 102的控制下从 第二存储位置读出第二文件, 实现对存档文件的读取。 例如, 读出单元 122 可以通过数据存储设备 12的文件系统从第二存储位置中读出第二文件。
本实施例的硬盘控制单元 103 , 与写入控制单元 101、 读出控制单元 102 和控制处理单元 123连接, 用于向数据存储设备发送第一硬盘控制指示, 以 使数据存储设备对第一存储位置所在的存储介质进行节能控制 , 以及在第二 存储位置所在的存储介质处于掉电或休眠状态时, 向数据存储设备发送第二 硬盘控制指示, 以控制数据存储设备对第二存储位置所在的存储介质进行上 电或休眠恢复操作。
举例说明, 存储控制设备对第一存储位置所在的存储介质进行的节能控 制可以是对第一存储位置所在的存储介质进行掉电控制、 对第一存储位置所 在的存储介质进行休眠控制、对第一存储位置所在的存储介质进行降速控制、 对第一存储位置所在的存储介质进行磁头悬停控制或对第一存储位置所在的 存储介质所在的数据存储设备进行整机掉电控制, 但不限于此。 也就是说, 存储控制设备通过向数据存储设备发送第一硬盘控制指示, 可以实现对数据 存储设备上的某个存储介质的各种节能控制操作。
在此说明, 硬盘控制单元 103除了向数据存储设备发送第一硬盘控制指 示或第二硬盘控制指示, 以指示数据存储设备对第一存储位置所在的存储介 质进行节能控制或对第二存储位置所在的存储介质进行上电或休眠恢复操作 之外, 还可以向数据存储设备发送其他硬盘控制指示, 以指示数据存储设备 对其上的存储介质进行节能、 上电或休眠恢复之外的其他控制, 例如控制数 据存储设备对其上的存储介质进行全速控制或对存储介质所在数据存储设备 进行整机上电控制等。
相应的, 本实施例的控制处理单元 123 , 用于接收硬盘控制单元 103发 送的第一硬盘控制指示, 并根据第一硬盘控制指示对第一存储位置所在的存 储介质的节能控制, 并接收硬盘控制单元 103发送的第二硬盘控制指示, 并 根据第二硬盘控制指示对第二存储位置所在的存储介质进行上电或休眠恢复 操作。
在本实施例的数据存储归档系统中, 存储控制设备通过与数据存储设备 相配合, 主要提供归档文件的存取访问控制, 对存储介质的 MAID及掉电等 控制, 以及存储管理功能等。 由于本实施例系统中的存储控制设备可以对数 据存储设备上的某个存储介质进行 MAID或掉电等控制, 与现有技术中只能 对整个存储系统进行上电或掉电控制相比, 提高了控制精度, 另外, 由于本 实施例系统中的存储控制设备可以对数据存储设备上的存储介质进行掉电、 休眠、 降速等节能控制, 有利于节约电能, 进而降低了存储控制成本。
图 4为本发明另一实施例提供的数据归档存储系统的结构示意图。 本实 施例基于上述实施例实现, 如图 4所示, 本实施例的硬盘控制单元 103包括: 第一硬盘控制子单元 1031和第二硬盘控制子单元 1032。
第一硬盘控制子单元 1031 , 与写入控制单元 101和控制处理单元 123连 接, 用于在第一存储位置所在的存储介质满足节能控制条件时, 向数据存储 设备 12的控制处理单元 123发送第一硬盘控制指示, 以使数据存储设备 12 的控制处理单元 123对第一存储位置所在的存储介质进行节能控制。 其中, 节能控制条件包括: 第一存储位置所在的存储介质中的第一文件的存储时间 达到预设存储时间门限、 第一存储位置所在的存储介质中的第一文件的访问 次数达到预设访问次数门限、 第一存储位置所在的存储介质写满、 第一存储 位置所在的存储介质写满后等待的时间达到预设等待时间门限和预设控制周 期到达中的至少一个。
进一步, 第一硬盘控制子单元 1031包括: 第一获取模块 10311、 第一判 断模块 10312、 第二获取模块 10313和第一发送模块 10314。
第一获取模块 10311 , 与写入控制单元 101连接, 用于在写入控制单元
101控制数据存储设备 12的写入单元 121将第一文件写入第一存储位置后, 根据写入控制单元 101提供的第一存储位置的信息, 获取第一存储位置所在 的存储介质的状态信息。
可选的, 数据存储设备 12可以向存储控制设备 11上报设备状态信息。 所述设备状态信息包括数据存储设备 12的标识、 数据存储设备 12上各存储 介质的标识和状态信息等。 其中, 所述存储介质的状态信息包括存储介质是 处于上电状态、 掉电状态和休眠状态中的哪种状态、 存储介质是否处于写满 状态、 存储介质上各文件的访问次数、 存储时间等信息、 以及存储介质上的 可用存储空间等信息。
可选的, 数据存储设备 12可以按照预设周期, 主动向存储控制设备 11 上报设备状态信息。 或者, 数据存储设备 12根据存储控制设备 11的状态上 报指示, 向存储控制设备 11 上报所述设备状态信息。 例如, 存储控制设备 12可以包括一个状态信息接收单元(图中未示出) , 用来接收数据存储设备 11上报的所述设备状态信息并负责将所述设备状态信息存储到存储控制设备 11的某个存储空间中。
基于上述,第一获取模块 10311具体可以到存储控制设备 11上存储数据 存储设备 12的设备状态信息的存储空间中去查找所述设备状态信息,从中获 取第一存储位置所在的存储介质的状态信息。
第一判断模块 10312, 与第一获取模块 10311 连接, 用于根据第一存储 位置所在的存储介质的状态信息, 判断第一存储位置所在的存储介质是否满 足节能控制条件。
第二获耳 莫块 10313 , 与第一判断模块 10312连接, 用于在第一判断模 块 10312的判断结果为满足时, 获取节能控制条件对应的节能操作指示。
可选的 , 节能控制条件对应的节能操作指示包括对满足节能控制条件的 存储介质进行掉电控制、 对满足节能控制条件的存储介质进行休眠控制、 对 满足节能控制条件的存储介质进行降速控制、 对满足节能控制条件的存储介 质进行磁头悬停控制或对满足节能控制条件的存储介质所在的数据存储设备 进行整机掉电控制。
可选的 , 上述节能控制条件和节能控制条件对应的节能操作指示可以作 为综合归档策略中的部分信息预先存储在存储控制设备上。
举例说明, 如果综合归档策略设定某个文件存入后一个月即掉电, 则第 一获取模块 10311获取到第一存储位置所在硬盘的存储介质的状态信息后, 第一判断模块 10312可以判断第一文件被存储后的时间是否达到一个月, 当 判断结果为第一文件被存储后的时间达到一个月时, 确定存储第一文件的存 储介质 (即第一存储位置所在的存储介质 ) 满足掉电控制的条件。
又例如, 如果综合归档策略设定存储介质写满后等待一周即掉电, 则第 一获取模块 10311获取到第一存储位置所在的存储介质的状态信息后, 第一 判断模块 10312可以判断第一存储位置所在的存储介质是否写满, 并在判断 出第一存储位置所在的存储介质写满后, 进一步判断第一存储位置所在的存 储介质写满后的时间长度是否为一周, 当判断结果为是时, 确定第一存储位 置所在的存储介质满足掉电控制的条件。
再例如,如果综合归档策略设定每一个月对某个存储介质进行一次掉电, 并设定掉电时间,则第一硬盘控制子单元 1031在控制数据存储设备将第一文 件写入第一存储位置后, 可以启动一定时器, 并设置定时器的定时时长为一 个月, 则其第一判断模块 10312可以通过判断第一存储位置所在的存储介质 对应的定时器是否定时结束, 来判断第一存储位置所在的存储介质是否满足 上述掉电控制的条件。
第一发送模块 10314, 与第二获取模块 10313和数据存储设备 12的控制 处理单元 123连接,用于向数据存储设备 12的控制处理单元 123发送第一硬 盘控制指示, 以使数据存储设备的控制处理单元 123对第一存储位置所在的 存储介质进行所述节能操作指示所标识的节能控制。 其中, 第一硬盘控制指 示包括第二获取模块 10313获取的所述节能操作指示。
基于上述第一硬盘控制子单元 1031的实现结构,本实施例的写入控制单 元 101包括: 第一获取子单元 1011和第一发送子单元 1012。
第一获取子单元 1011 , 用于根据存储位置选择策略获取第一存储位置。 其中,存储位置选择策略包括根据数据存储设备 12的设备状态信息选择存储 位置。 其中, 数据存储设备 12的设备状态信息包括数据存储设备 12上各存 储介质的标识和状态信息。
可选的, 存储位置选择策略预先存储在存储控制设备 11上, 例如存储在 存储控制设备 11的某个存储介质中。 第一获取子单元 1011需要先到该存储 介质中获取存储位置选择策略, 然后在根据获取的存储位置选择策略确定出 第一存储位置。 可选的, 存储位置选择策略包括根据数据存储设备 12的设备 状态信息选择存储位置, 但不限于此。 其中, 设备状态信息包括数据存储设 备 12的标识, 数据存储设备 12的状态、数据存储设备 12上各存储介质的标 识、 状态信息、 可用存储容量和总存储容量等。
例如,第一获取子单元 1011可以根据存储介质的状态信息以及可用存储 容量确定使用哪个存储介质来存储第一文件。 其中, 存储介质的状态信息主 要包括处于掉电状态、 处于休眠状态、 处于损坏状态、 处于读取不可用状态 等不可读取状态, 以及处于读取可用状态、 处于上电状态等可读取状态、 存 储介质是否写满以及存储介质上各文件的状态信息等。 第一发送子单元 1012, 与第一获取子单元 1011、硬盘控制单元 103和数 据存储设备 12的写入单元 121连接, 用于将第一获取子单元 1011获取的第 一存储位置的信息发送给硬盘控制单元 103 , 并将第一存储位置的信息和第 一文件发送给数据存储设备 12的写入单元 121 , 以使数据存储设备 12的写 入单元 121根据第一存储位置的信息将第一文件存储到第一存储位置。 基于 硬盘控制单元 103的上述实现结构,第一发送子单元 1012具体与硬盘控制单 元 103的第一获取模块 10311连接, 用于将第一存储位置的信息提供给第一 获取模块 10311。
可选的, 数据存储设备 12可以是一个也可以是多个。 如果数据存储设备 12为多个, 则第一获取子单元 1011具体可用于根据存储位置选择策略从多 个数据存储设备 12中确定第一数据存储设备(例如可以是图 2中所示的数据 存储设备 12 ) , 然后从第一数据存储设备中确定第一存储位置。 第一发送子 单元 1012具体可用于根据第一获取子单元 1011确定出的第一数据存储设备 的信息获取第一数据存储设备的 IP地址, 根据第一数据存储设备的 IP地址 将第一获取子单元 1011 确定出的第一存储位置的信息和第一文件发送给第 一数据存储设备。
其中, 各数据存储设备 12的标识和其 IP地址的对应关系可以预置在存 储控制设备上,则第一获取子单元 1011可以直接从所存储的对应关系中获取 第一数据存储设备的 IP地址。 另外, 第一获取子单元 1011还可以根据第一 数据存储设备的标识到第三方设备去查询获得第一数据存储设备的 IP地址。 其中, 第三方设备存储有数据存储设备 12的标识和其 IP地址的对应关系。 其中, 第三方设备可以是一个保存有数据存储设备 12的标识和其 IP地址对 应关系的服务器。 例如, 第一数据存储设备的标识是域名, 第三方设备是域 名系统 (Domain Name System, DNS)服务器, 在 DNS服务器上配置有域名和 对应的 IP地址, 则第一获取子单元 1011可以通过 DNS查询获得第一数据存 储设备的标识。
可选的,写入控制单元 101的第一获取子单元 1011还可以用于获取第一 文件。
可选的,第一获取子单元 1011具体可以接收第三方系统发送的文件归档 请求, 根据文件归档请求从第三方系统上获取第一文件。 其中, 文件归档请 求包括第一文件的标识和第一文件在第三方系统上的存储位置信息。 其中, 第三方系统主要是指需要进行文件归档存储的系统, 例如在线存储系统、 一 般的信息技术( Information Technology, IT ) 系统等。
进一步, 本实施例的存储控制设备 11对外具有数据传送功能, 并且支持 多种文件传送方式, 例如 FTP, HTTP, WebDAV, CIFS或 NFS方式等。
基于上述,第一获取子单元 1011更为具体的可以在接收第三方系统发送 的文件归档请求后, 根据文件归档请求通过 FTP, HTTP, WebDAV, CIFS 或 NFS方式从第三方系统上获取第一文件。
可选的,写入控制单元 101在第一发送子单元 1012将第一文件发送给数 据存储设备 12的写入单元 121之前,可以按照综合控制策略对第一文件进行 处理。 例如, 写入控制单元 101可以包括一处理子单元(图中未示出) , 由 该处理子单元按照综合控制策略对第一文件进行处理。
其中, 综合控制策略可以预先配置在存储控制设备 11上, 例如存储在存 储控制设备 11的某个存储介质中,并且本实施例的综合控制策略还可以通过 配置进行设定或修改。处理子单元需要先到该存储介质中获取综合控制策略, 然后在根据获取的综合控制策略对第一文件进行处理。
本实施例的综合控制策略可以包括是否对第一文件进行数字水印处理, 是否对第一文件进行加密处理, 是否对第一文件进行完整性校验、 是否对第 一文件进行文件切割并按照切割后的分片文件进行存储和是否对第一文件进 行副本备份并同时对第一文件和第一文件的副本文件进行存储中的至少一 个, 但不限于此。 其中, 针对不同类别的文件可以预置不同的策略, 例如针 对文件大小超过某个阈值的, 进行文件切割; 对于视频文件均进行数字水印 处理等等。
作为一种实现方式, 如果根据综合控制策略可能判断出无需对第一文件 进行任何处理, 则存储控制设备 11可以不对第一文件进行緩存, 而是直接由 第一发送子单元 1012将第一文件发送给数据存储设备。 另外, 如果根据综合 控制策略判断出需要对第一文件进行处理,则存储控制设备 11可以先緩存第 一文件, 由处理子单元对第一文件进行处理, 然后由第一发送子单元 1012将 处理子单元处理后的第一文件发送给数据存储设备。
举例说明, 如果综合控制策略包括对第一文件进行切割并按照切割后的 分片文件进行存储, 则处理子单元具体可用于对第一文件进行切割, 为切割 后的每个分片文件分配标识;第一获取子单元 1011具体可用于根据存储位置 选择策略为处理子单元切割出的每个分片文件获取第一存储位置; 第二发送 子单元 1012具体可用于将第一获取子单元 1011获取的每个分片文件对应的 第一存储位置的信息和处理子单元切割出的每个分片文件发送给数据存储设 备 12的写入单元 121 , 以使数据存储设备 12的写入单元 121根据每个分片 文件对应的第一存储位置的信息将每个分片文件存储到每个分片文件对应的 第一存储位置。
举例说明, 如果综合控制策略包括对第一文件进行副本备份并同时对第 一文件和第一文件的副本文件进行存储, 则处理子单元具体可用于对第一获 取子单元 1011获取的第一文件进行副本备份, 为每个副本文件分配标识; 第 一获取子单元 1011 具体可用于根据存储位置选择策略为第一文件和处理子 单元备份出的每个副本文件获取其分别对应的第一存储位置; 第二发送子单 元 1012具体可用于将第一获取子单元 1011获取的第一文件对应的第一存储 位置的信息和第一文件,以及第一获取子单元 1011获取的每个副本文件对应 的第一存储位置的信息和处理子单元备份出的每个副本文件发送给数据存储 设备 12的写入单元 121 , 以使数据存储设备 12的写入单元 121根据第一文 件对应的第一存储位置的信息将第一文件存储到第一文件对应的第一存储位 置, 根据每个副本文件对应的第一存储位置的信息将每个副本文件存储到每 个副本文件对应的第一存储位置。
其中, 第二硬盘控制子单元 1032, 与读出控制单元 102和数据存储设备 连接, 用于在第二存储位置所在的存储介质处于掉电或休眠状态时, 向数据 存储设备 12的控制处理单元 123发送第二硬盘控制指示,以控制数据存储设 备的控制处理单元 123对第二存储位置所在的存储介质进行上电或休眠恢复 操作,以便于控制数据存储设备 12的读出单元 122从第二存储位置读出第二 文件。
进一步, 第二硬盘控制子单元 1032包括: 第三获取模块 10321、 第二判 断模块 10322和第二发送模块 10323。
第三获耳 莫块 10321 , 与读出控制单元 102连接, 用于在读出控制单元 102控制数据存储设备的读出单元 122从第二存储位置读出第二文件之前, 根据读出控制单元 102提供的第二存储位置的信息, 获取第二存储位置所在 的存储介质的状态信息。
可选的,第三获取模块 10321可以到存储控制设备 11上存储数据存储设 备 12的设备状态信息的存储空间中去查找所述设备状态信息,从中获取第二 存储位置所在的存储介质的状态信息。
第二判断模块 10322, 与第三获取模块 10321 连接, 用于根据第三获取 模块 10321获取的第二存储位置所在的存储介质的状态信息, 判断第二存储 位置所在的存储介质是否处于掉电或休眠状态。
其中, 第三获取模块 10321获取到的第二位置所在的存储介质的状态信 息包括第二位置所在的存储介质是否处于掉电或休眠状态的信息, 所以第二 判断模块 10322可以直接判断出第二存储位置所在的存储介质是否处于掉电 或休眠状态。
第二发送模块 10323 , 与第二判断模块 10322和数据存储设备 12的控制 处理单元 123连接, 用于在第二判断模块 10322的判断结果为是时, 向数据 存储设备 12的控制处理单元 123发送第二硬盘控制指示,以控制数据存储设 备的控制处理单元 123对第二存储位置所在的存储介质进行上电或休眠恢复 操作。
基于上述第二硬盘控制子单元 1032的实现结构,本实施例的读出控制单 元 102包括: 第二获取子单元 1021、 第三获取子单元 1022、 第二发送子单元 1023和第三发送子单元 1024。
第二获取子单元 1021 , 用于获取第二文件的标识。 可选的, 第二获取子 单元 1021可以接收第三方系统发送的文件读取请求,从文件读取请求中获取 第二文件的标识。 其中, 文件读取请求包括第二文件的标识。
可选的,如果第二获取子单元 1021是从第三方系统发送的文件读取请求 中获取到第二文件的标识的, 则本实施例的读出控制单元 102还可以在判断 用状态时, 向第三方系统发送文件不可用响应。
第三获取子单元 1022, 与第二获取子单元 1021 连接, 用于根据第二获 取子单元 1021获取的第二文件的标识在文件元数据中进行查找,获取第二文 件的存储位置信息。所述文件元数据包括数据存储设备 12上存储的文件的标 识和文件的存储位置信息, 所述第二文件的存储位置信息包括数据存储设备
12的信息和第二存储位置的信息。
其中, 数据存储设备 12 的信息可以是任何可唯一标识该数据存储设备
12的信息, 例如数据存储设备的 IP地址、 MAC地址以及名称等。 同理, 文 件在数据存储设备 12 上的存储位置的信息也可以是任何可唯一标识出该存 储位置的信息。 以数据存储设备 12上的存储介质为硬盘为例, 则文件在数据 存储设备 12上的存储位置的信息可以是硬盘的标识, 但不限于此。
可选的, 本实施例的系统还可以包括元数据存储设备 13。
基于此, 文件元数据可以存储在元数据存储设备 13上。 则第三获取子单 元 1022可以根据第二文件的标识到元数据存储设备 13上去查询文件元数据, 获取第二存储位置的信息。 可选的, 第三获取子单元 1022与元数据存储设备
13连接。
第二发送子单元 1023 , 与第三获取子单元 1022和硬盘控制单元 103连 接,用于将第三获取子单元 1022获取的第二存储位置的信息发送给硬盘控制 单元 103。 基于上述硬盘控制单元 103 的实现结构以及第二硬盘控制子单元 1032的实现结构, 第二发送子单元 1023与第二硬盘控制子单元 1032的第三 获取模块 10321连接,用于向第三获取模块 10321提供第二存储位置的信息。
第三发送子单元 1024, 与第三获取子单元 1022和数据存储设备 12的读 出单元 122连接, 用于在第二存储位置所在的存储介质处于上电状态时, 或 在数据存储设备 12的控制处理单元 123根据第二硬盘控制指示对第二存储位 置所在的存储介质进行上电或休眠恢复操作之后,根据数据存储设备 12的信 息, 将第二存储位置的信息发送给数据存储设备 12的读出控制单元 122, 以 使数据存储设备 12的读出单元 122从第二存储位置读出第二文件。
例如, 如果数据存储设备 12的信息为数据存储设备 12的标识, 第二存 储位置的信息为数据存储设备 12上某个硬盘的标识,则第三发送子单元 1024 可以根据数据存储设备 12的标识获取数据存储设备的 IP地址, 然后根据数 据存储设备 12的 IP地址将该硬盘的标识发送给数据存储设备 12的读出单元 122。 对数据存储设备 12的读出单元 122来说, 可以根据该硬盘的标识找到 相应的硬盘, 然后从该硬盘中读出第二文件。
可选的, 本实施例的存储控制设备 11还可以包括: 信息接收单元 104和 /或信息发送单元 105。
信息接收单元 104, 与数据存储设备 12连接, 用于接收数据存储设备 12 上报的数据存储设备所存储的每个文件的标识和每个文件的存储位置信息, 所述每个文件的存储位置信息包括数据存储设备 12 的信息和每个文件在数 据存储设备 12上的存储位置的信息。 具体的, 信息接收单元 104与数据存储 设备 12的读出单元 122连接。
信息发送单元 105 , 与信息接收单元 104和元数据存储设备 13连接, 用 于将信息接收单元 104接收的每个文件的标识和每个文件的存储位置信息发 送给元数据存储设备 13以供元数据存储设备 13对文件元数据进行恢复。
其中,信息接收单元 104具体可用于接收数据存储设备 12在启动时主动 上报的其所存储的每个文件的标识和每个文件的存储位置信息。 或者
信息接收单元 104具体可用于向数据存储设备 12发送元数据上报指示, 以指示该数据存储设备 12 上报其所存储的每个文件的标识和每个文件的存 储位置信息,然后接收该数据存储设备 12上报的其所存储的每个文件的标识 和每个文件的存储位置信息。
本实施例的存储控制设备 11通过信息接收单元 104和信息发送单元 105 , 可以在元数据存储设备 13 上的文件元数据发生丟失或损坏等情况下从数据 存储设备 12上重新获取每个文件的标识和存储位置信息,并提供给元数据存 储设备 13 , 这样元数据存储设备 13就可以对文件元数据进行恢复, 有利于 保证文件元数据的可靠性。
本实施例的数据归档存储系统, 存储控制设备通过各单元或子单元可以 直接控制数据存储设备进行文件的存储和读取, 在控制数据存储设备写入文 件后, 向数据存储设备发送硬盘控制指示, 以对写入文件的存储介质进行节 能控制, 而在控制数据存储设备从存储介质中读出文件之前, 如果存储介质 处于掉电或休眠状态可以向数据存储设备发送硬盘控制指示, 控制数据存储 设备对存储文件的存储介质进行上电或休眠恢复, 在采用存储介质进行数据 归档存储的同时, 实现了存储介质对的 MAID或掉电等节能控制, 降低了归 档存储的成本。
在此说明, 上述实施例中存储控制设备 11可以是独立设备, 也可以部署 在数据存储设备 12或元数据存储设备 13上。即存储控制设备 11和数据存储 设备 12可以是同一设备,或者存储控制设备 11可以和元数据存储设备 13是 同一设备。
图 5为本发明一实施例提供的数据归档存取方法的流程图。 如图 5A所 示, 本实施例的方法包括:
步骤 501、 存储控制设备接收存储控制请求。
其中, 存储控制设备可以接收由用户通过键盘、 鼠标、 触屏等方式输入 的存储控制请求。 或者, 存储控制设备也可以接收由其他设备发送的存储控 制请求, 所述其他设备可以是任何具有发送信息功能的设备, 例如可以是用 户的终端设备, 例如手机、 个人计算机等。
步骤 502、 当所述存储控制请求为将第一文件写入数据存储设备时, 存 储控制设备的写入控制单元控制数据存储设备将第一文件写入数据存储设备 的第一存储位置, 存储控制设备的硬盘控制单元向数据存储设备发送第一硬 盘控制指示, 以使数据存储设备对第一存储位置所在的存储介质进行节能控 制, 所述第一文件为待存储的文件。
其中, 数据存储设备包括至少一个存储介质, 用于提供存储空间; 所述 存储介质为支持随机存取数据的介质, 例如硬盘、 U盘、 内存或光盘等。 这 些存储介质可持久保持数据。
步骤 503、 当所述存储控制请求为从数据存储设备中读取第二文件时, 存储控制设备的读出控制单元获取第二文件的标识和第二文件的存储位置信 息; 读出控制单元在第二存储位置所在的存储介质处于上电状态时, 或者在 数据存储设备根据第二硬盘控制指示对第二存储位置所在的存储介质进行上 电或休眠恢复操作之后, 根据获取到的第二文件元的标识和第二文件的存储 位置信息, 控制数据存储设备从第二存储位置读出第二文件, 所述第二文件 为待读取的文件。
本实施例的存储控制设备可以是图 1、 图 2、 图 3或图 4所示实施例中的 存储控制设备。 关于存储控制设备通过其各功能单元控制数据存储设备存储 第一文件, 读取第二文件、 对第一存储位置所在的存储介质进行节能控制以 及对第二存储位置所在的存储介质进行上电或休眠恢复操作的过程可参见图 1、 图 2、 图 3或图 4所示实施例中的描述, 在此不再赘述。
在本实施例中, 存储控制设备通过与数据存储设备相配合, 主要提供归 档文件的存取访问控制, 对存储介质的 MAID及掉电等控制, 以及存储管理 功能等。 由于本实施例的存储控制设备可以对数据存储设备上的某个存储介 质进行 MAID或掉电等控制, 与现有技术中只能对整个存储系统进行上电或 掉电控制相比, 提高了控制精度, 另外, 由于本实施例的存储控制设备可以 对数据存储设备上的存储介质进行掉电、 休眠、 降速等节能控制, 有利于节 约电能, 进而降低了存储控制成本。
可选的, 存储控制设备的硬盘控制单元向数据存储设备发送第一硬盘控 制指示 , 以使数据存储设备对第一存储位置所在的存储介质进行节能控制的 一种实施方式包括:
硬盘控制单元在第一存储位置所在的存储介质满足节能控制条件时, 向 数据存储设备发送第一硬盘控制指示, 以使数据存储设备对第一存储位置所 在的存储介质进行节能控制。
其中, 节能控制条件包括: 第一存储位置所在的存储介质中的第一文件 的存储时间达到预设存储时间门限、 第一存储位置所在的存储介质中的第一 文件的访问次数达到预设访问次数门限、第一存储位置所在的存储介质写满、 第一存储位置所在的存储介质写满后等待的时间达到预设等待时间门限和预 设控制周期到达中的至少一个。
进一步, 硬盘控制单元在第一存储位置所在的存储介质满足节能控制条 件时, 向数据存储设备发送第一硬盘控制指示, 以使数据存储设备对第一存 储位置所在的存储介质进行节能控制的一种实施方式包括:
硬盘控制单元在写入控制单元控制数据存储设备将第一文件写入第一存 储位置后 , 根据写入控制单元提供的第一存储位置的信息获取第一存储位置 所在的存储介质的状态信息;
硬盘控制单元根据第一存储位置所在的存储介质的状态信息 , 判断第一 存储位置所在的存储介质是否满足节能控制条件;
当判断结果为满足时 , 硬盘控制单元获取节能控制条件对应的节能操作 指示, 向数据存储设备发送第一硬盘控制指示, 以使数据存储设备对第一存 储位置所在的存储介质进行所述节能操作指示所标识的节能控制; 第一硬盘 控制指示包括所述节能操作指示。
其中, 节能控制条件对应的节能操作指示可以包括对满足节能控制条件 的存储介质进行掉电控制、 对满足节能控制条件的存储介质进行休眠控制、 对满足节能控制条件的存储介质进行降速控制、 对满足节能控制条件的存储 介质进行磁头悬停控制或对满足节能控制条件的存储介质所在的数据存储设 备进行整机掉电控制。
可选的, 存储控制设备的写入控制单元控制数据存储设备将第一文件写 入数据存储设备的第一存储位置的一种实施方式包括:
写入控制单元根据存储位置选择策略获取第一存储位置; 存储位置选择 策略包括根据数据存储设备的设备状态信息选择存储位置; 其中, 数据存储 设备的设备状态信息包括数据存储设备上各存储介质的标识和状态信息; 写入控制单元将第一存储位置的信息发送给硬盘控制单元, 并将第一存 储位置的信息和第一文件发送给数据存储设备, 以使数据存储设备根据第一 存储位置的信息将第一文件存储到第一存储位置。
可选的, 存储控制设备的读出控制单元获取第二文件的标识和第二文件 的存储位置信息的一种实施方式包括:
读出控制单元获取第二文件的标识;
读出控制单元根据第二文件的标识在文件元数据中进行查找, 获取第二 文件的存储位置信息; 其中, 文件元数据包括数据存储设备上存储的文件的 标识和文件的存储位置信息, 第二文件的存储位置信息包括数据存储设备的 信息和第二存储位置的信息;
读出控制单元将第二存储位置的信息发送给硬盘控制单元, 以便于硬盘 控制单元根据第二存储位置的信息获取第二存储位置所在的存储介质的状态 信息。
可选的, 本实施例的方法还包括: 硬盘控制单元在读出控制单元控制数 据存储设备从第二存储位置读出第二文件之前, 根据读出控制单元提供的第 二存储位置的信息, 获取第二存储位置所在的存储介质的状态信息;
硬盘控制单元根据第二存储位置所在的存储介质的状态信息 , 判断第二 存储位置所在的存储介质是否处于掉电或休眠状态;
当第二存储位置所在的存储介质处于掉电或休眠状态时, 硬盘控制单元 向数据存储设备发送第二硬盘控制指示, 以控制数据存储设备对第二存储位 置所在的存储介质进行上电或休眠恢复操作。 这样可以使读出控制单元成功 控制数据存储设备从第二存储位置读出第二文件。
图 6为本发明另一实施例提供的数据归档存取方法的流程图。 如图 6所 示, 本实施例的方法包括:
步骤 601、 存储控制设备的写入控制单元获取第一文件。
其中, 第一文件为待存储文件。
可选的, 存储控制设备的写入单元可以接收第三方系统发送的文件归档 请求, 根据文件归档请求从第三方系统上获取第一文件。 其中, 文件归档请 求包括第一文件的标识和第一文件在第三方系统上的存储位置信息。 其中, 第三方系统主要是指需要进行文件归档存储的系统, 例如在线存储系统、 一 般的 IT系统等。
步骤 602、 存储控制设备的写入控制单元根据存储位置选择策略选择第 一存储位置。
其中, 存储位置选择策略可以包括根据数据存储设备的设备状态信息选 择存储位置。 数据存储设备的设备状态信息可以包括数据存储设备的标识, 数据存储设备上各存储介质的标识和状态信息等, 所述存储介质的状态信息 包括存储介质是否处于掉电、 休眠、 上电、 损坏不可用、 不可读取等状态, 也包括存储介质的可用存储容量、 总存储容量, 还包括存储介质上的文件的 信息等。 本实施例的数据存储设备包括至少一个存储介质, 用于作为归档存 储空间。
步骤 603、 存储控制设备的写入控制单元将第一存储位置的信息和第一 文件发送给数据存储设备, 以使数据存储设备根据第一存储位置的信息将第 一文件存储到第一存储位置中。
本实施例的存储控制设备可以是图 1或图 2或图 3或图 4所示实施例中 的存储控制设备。 关于存储控制设备的写入控制单元对第一文件进行存储的 过程可参见图 1或图 2或图 3或图 4所示实施例中的描述, 在此不再赘述。
在本实施例中, 存储控制设备和数据存储设备直接配合, 实现对文件的 归档存储。
图 7为本发明又一实施例提供的数据归档存取方法的流程图。 如图 7所 示, 本实施例的方法包括:
步骤 701、 存储控制设备接收数据存储设备上报的设备状态信息。 可选的 ,存储控制设备可以接收数据存储设备定时上报的设备状态信息。 可选的, 存储控制设备向数据存储设备发送状态上报指示, 并接收数据 存储设备根据状态上报指示上报的设备状态信息。
数据存储设备的设备状态信息可以包括数据存储设备的标识, 数据存储 设备中每个存储介质的标识和状态信息等 , 所述存储介质的状态信息包括存 储介质是否处于掉电、 休眠、 上电、 损坏不可用、 不可读取等状态, 还包括 存储介质的可用存储容量、 总存储容量等, 还包括存储介质上的文件的信息 等。 本实施例的数据存储设备包括至少一个存储介质, 用于作为归档存储空 间。
其中, 步骤 701为一可选步骤。
步骤 702、 存储控制设备的写入控制单元获取第一文件, 并按照综合控 制策略对第一文件进行处理。
可选的, 存储控制设备的写入控制单元可以接收第三方系统发送的文件 归档请求, 根据文件归档请求从第三方系统上获取第一文件。 其中, 文件归 档请求包括第一文件的标识和第一文件在第三方系统上的存储位置信息。 其 中, 第三方系统主要是指需要进行文件归档存储的系统, 例如在线存储系统、 一般的 IT系统等。
其中, 综合控制策略可以包括是否对第一文件进行数字水印处理, 是否 对第一文件进行加密处理, 是否对第一文件进行完整性校验、 是否对第一文 件进行文件切割并按照切割后的分片文件进行存储和是否对第一文件进行副 本备份并同时对第一文件和第一文件的副本文件进行存储其中之一或其组 合, 但不限于此。
可选的, 如果综合控制策略包括对第一文件进行切割并按照切割后的分 片文件进行存储, 则存储控制设备的写入控制单元对第一文件的处理包括对 第一文件进行切割, 为切割后的每个分片文件分配标识。
可选的, 如果综合控制策略包括对第一文件进行副本备份并同时对第一 文件和第一文件的副本文件进行存储, 则存储控制设备的写入控制单元对第 一文件的处理包括对第一文件进行副本备份, 为每个副本文件分配标识。
步骤 703、 存储控制设备的写入控制单元根据存储位置选择策略确定第 一存储位置。 其中, 存储位置选择策略可以包括根据数据存储设备的设备状态信息选 择存储位置。 数据存储设备的设备状态信息可以包括数据存储设备的标识, 数据存储设备中每个存储介质的标识和状态信息等, 所述存储介质的状态信 息包括存储介质是否处于掉电、 休眠、 上电、 损坏不可用、 不可读取等状态, 还包括存储介质的可用存储容量、 总存储容量等, 还包括存储介质上的文件 的信息等。
可选的, 如果综合控制策略包括对第一文件进行切割并按照切割后的分 片文件进行存储, 则存储控制设备的写入控制单元确定第一存储位置包括: 根据位置选择策略为每个分片文件确定第一存储位置。
可选的, 如果综合控制策略包括对第一文件进行副本备份并同时对第一 文件和第一文件的副本文件进行存储, 则存储控制设备的写入控制单元确定 第一存储位置包括: 根据位置选择策略为第一文件和每个副本文件确定第一 存储位置。
步骤 704、 存储控制设备的写入控制单元将第一存储位置的信息和处理 后的第一文件发送给数据存储设备, 以使数据存储设备根据第一存储位置的 信息将所述处理后的第一文件存储到第一存储位置中, 并将第一存储位置的 信息提供给存储控制设备的硬盘控制单元。
可选的, 如果综合控制策略包括对第一文件进行切割并按照切割后的分 片文件进行存储, 则存储控制设备的写入控制单元将第一文件和第一存储位 置的信息发送给数据存储设备包括: 将每个分片文件对应的第一存储位置的 信息和每个分片文件发送给数据存储设备。
可选的, 如果综合控制策略包括对第一文件进行副本备份并同时对第一 文件和第一文件的副本文件进行存储, 则存储控制设备的写入控制单元将第 一文件和第一存储位置的信息发送给数据存储设备包括: 将第一文件对应的 第一存储位置的信息和第一文件, 以及每个副本文件对应的第一存储位置的 信息和每个副本文件发送给数据存储设备。
步骤 705、 存储控制设备的硬盘控制单元根据写入控制单元提供的第一 存储位置的信息获取第一存储位置所在的存储介质的状态信息。
步骤 706、 硬盘控制单元根据第一存储位置所在的存储介质的状态信息, 判断第一存储位置所在的存储介质是否满足节能控制条件; 当判断结果为是, 即满足时, 执行步骤 707; 反之, 结束操作。
步骤 707、 硬盘控制单元获取节能控制条件对应的节能操作指示, 向数 据存储设备发送第一硬盘控制指示, 以使数据存储设备对第一存储位置所在 的存储介质进行第一硬盘控制指示中的节能操作指示所标识的节能控制; 第 —硬盘控制指示包括对第一存储位置所在的存储介质的节能操作指示。
本实施例的存储控制设备可以是图 1或图 2或图 3或图 4所示实施例中 的存储控制设备。 关于存储控制设备的写入控制单元对第一文件进行存储以 及硬盘控制单元对存储第一文件的存储介质进行节能控制的过程可参见图 1 或图 2或图 3或图 4所示实施例中的描述, 在此不再赘述。
在本实施例中, 存储控制设备和数据存储设备直接配合, 实现对文件的 归档存储。
图 8为本发明又一实施例提供的数据归档存取方法的流程图。 如图 8所 示, 本实施例的方法包括:
步骤 801、 存储控制设备的读出控制单元获取第二文件的标识; 所述第 二文件为待读取的文件。
可选的, 存储控制设备的读出控制单元可以接收第三方系统发送的文件 读取请求, 从文件读取请求中获取第二文件的标识。 其中, 文件读取请求包 括第二文件的标识。
基于此, 本实施例的数据归档读取方法还包括: 存储控制设备的读出控 制单元在获取第二文件之后, 将第二文件发送给第三方系统。
步骤 802、 存储控制设备的读出控制单元根据第二文件的标识在文件元 数据中进行查找, 获取第二文件的存储位置信息。
其中, 文件元数据包括所述数据存储设备上存储的文件的标识和文件的 存储位置信息; 第二文件的存储位置信息包括数据存储设备的信息和第二存 储位置的信息。
步骤 803、 存储控制设备的读出控制单元将第二存储位置的信息发送给 存储控制设备的硬盘控制单元。
步骤 804、 存储控制设备的硬盘控制单元根据存储控制设备的读出控制 单元提供的第二存储位置的信息 , 获取第二存储位置所在的存储介质的状态 信息。 步骤 805、 存储控制设备的硬盘控制单元根据第二存储位置所在的存储 介质的状态信息, 判断第二存储位置所在的存储介质是否处于掉电或休眠状 态; 当判断结果为是时, 执行步骤 806; 反之, 执行步骤 807。
步骤 806、 存储控制设备的硬盘控制单元向数据存储设备发送第二硬盘 控制指示, 以控制数据存储设备对第二存储位置所在的存储介质进行上电或 休眠恢复操作, 然后执行步骤 807。
步骤 807、 存储控制设备的读出控制单元根据第二文件的存储位置信息 中数据存储设备的信息, 将第二文件的存储位置信息中第二存储位置的信息 发送给数据存储设备, 以控制数据存储设备从数据存储设备第二存储位置中 读出第二文件。
步骤 808、 存储控制设备接收数据存储设备返回的第二文件。
本实施例的存储控制设备可以是图 1或图 2所示实施例中的存储控制设 备。 关于存储控制设备的读出控制单元对第二文件进行读取以及其硬盘控制 过程可参见图 1或图 2或图 3或图 4所示实施例中的描述, 在此不再赘述。
在本实施例中, 存储控制设备与数据存储设备直接配合, 使数据存储设 备读出第二文件, 实现了对归档文件的读取。
图 9为本发明又一实施例提供的数据归档存取方法的流程图。 如图 9所 示, 本实施例的方法包括:
步骤 901、 存储控制设备的读出控制单元接收第三方系统发送的文件读 取请求, 从文件读取请求中获取第二文件的标识。
其中, 文件读取请求包括第二文件的标识; 第二文件为待读取的文件 步骤 902、 存储控制设备的读出控制单元根据第二文件的标识在文件元 数据中进行查找, 获取第二文件的存储位置信息。
其中, 第二文件的存储位置信息包括数据存储设备的信息和第二存储位 置的信息。
可选的, 本实施例的文件元数据可以存在于元数据存储设备上。
步骤 903、 存储控制设备的读出控制单元将第二文件的存储位置信息提 供给存储控制设备的硬盘控制单元。
步骤 904、 存储控制设备的硬盘控制单元根据数据存储设备的设备状态 信息, 判断第二存储位置的状态; 当判断结果为第二存储位置处于不可读取 状态中的休眠状态或掉电状态时, 执行步骤 905 ; 当判断结果为第二存储位 置处于可读取状态时, 执行步骤 906; 当判断结果为第二存储位置损坏状态 或读出不可用状态时, 执行步骤 908。
步骤 905、 存储控制设备的硬盘控制单元向数据存储设备发送第二硬盘 控制指示 , 以指示数据存储设备对第二存储位置进行休眠恢复或上电操作 , 然后执行步骤 906。
步骤 906、 存储控制设备的读出控制单元根据第二文件的存储位置信息 中数据存储设备的信息, 将第二文件的存储位置信息中第二存储位置的信息 发送给数据存储设备,以控制数据存储设备从第二存储位置中读出第二文件, 然后执行步骤 907。
步骤 907、 存储控制设备的读出控制单元接收数据存储设备返回的第二 文件, 发送给第三方系统, 结束操作。
可选的, 存储控制设备还可以将第二文件发送给第三方系统。
步骤 908、 存储控制设备向第三方系统发送文件不可用响应, 结束操作。 本实施例的存储控制设备可以是图 1或图 2或图 3或图 4所示实施例中 的存储控制设备。 关于存储控制设备的读出控制单元对第二文件进行读取以 参见图 1或图 2或图 3或图 4所示实施例中的描述, 在此不再赘述。
在本实施例中, 存储控制设备通过和数据存储设备直接配合, 使数据存 储设备读出第二文件, 实现了对归档文件的读取。
进一步, 在上述各实施例中, 存储控制设备可以接收数据存储设备上报 的数据存储设备所存储的每个文件的标识和每个文件的存储位置信息, 并将 数据存储设备上报的每个文件的标识和每个文件的存储位置信息发送给元数 据存储设备以供元数据存储设备对文件元数据进行恢复。
其中, 每个文件的存储位置信息包括数据存储设备的信息和每个文件在 数据存储设备上的存储位置的信息。
可选的, 存储控制设备接收数据存储设备在启动时主动上报的所存储的 每个文件的标识和每个文件的存储位置信息。
可选的, 存储控制设备向数据存储设备发送元数据上报指示, 并接收数 据存储设备根据元数据上报指示上报的所存储的每个文件的标识和每个文件 的存储位置信息。
在此说明, 该操作与其他步骤的执行顺序不做限定。
在本实施例中, 存储控制设备和数据存储设备直接配合, 在文件元数据 发生丟失或损坏的情况下, 可以通过从数据存储设备获取数据存储设备所存 储的每个文件的标识和每个文件的存储位置信息, 并将这些信息提供给元数 据存储设备使元数据存储设备对文件元数据进行恢复, 有利于保证文件元数 据的安全性和可靠性, 进而为成功读取或访问归档文件提供了保障。
在此说明, 图 5-图 9所示实施例提供的数据归档存取方法中第一文件的 存储与对第二文件的读取过程可以独立执行。 即存储控制设备控制数据存储 设备进行文件存储和控制数据存储设备进行文件读取的过程可以并行操作。
本领域普通技术人员可以理解: 实现上述方法实施例的全部或部分步骤 可以通过程序指令相关的硬件来完成, 前述的程序可以存储于一计算机可读 取存储介质中, 该程序在执行时, 执行包括上述方法实施例的步骤; 而前述 的存储介质包括: ROM、 RAM, 磁碟或者光盘等各种可以存储程序代码的介 质。
最后应说明的是: 以上各实施例仅用以说明本发明的技术方案, 而非对 其限制; 尽管参照前述各实施例对本发明进行了详细的说明, 本领域的普通 技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改, 或者对其中部分或者全部技术特征进行等同替换; 而这些修改或者替换, 并 不使相应技术方案的本质脱离本发明各实施例技术方案的范围。

Claims

权 利 要求 书
1、 一种存储控制设备, 其特征在于, 包括:
写入控制单元, 用于控制数据存储设备将第一文件写入所述数据存储设 备的第一存储位置, 所述第一文件为待存储的文件; 其中, 所述数据存储设 备包括至少一个存储介质, 所述存储介质为支持随机存取数据的介质;
读出控制单元, 用于获取第二文件的标识和所述第二文件的存储位置信 息, 并根据获取到的所述第二文件的标识和所述第二文件的存储位置信息, 控制所述数据存储设备从第二存储位置读出所述第二文件, 所述第二文件为 待读取的文件;
硬盘控制单元, 用于向所述数据存储设备发送第一硬盘控制指示, 以使 所述数据存储设备对所述第一存储位置所在的存储介质进行节能控制;以及 在所述第二存储位置所在的存储介质处于掉电或休眠状态时, 向所述数据存 储设备发送第二硬盘控制指示 , 以控制所述数据存储设备对所述第二存储位 置所在的存储介质进行上电或休眠恢复操作。
2、 根据权利要求 1所述的存储控制设备, 其特征在于, 所述硬盘控制单 元包括:
第一硬盘控制子单元, 用于在所述第一存储位置所在的存储介质满足节 能控制条件时, 向所述数据存储设备发送所述第一硬盘控制指示, 以使所述 数据存储设备对所述第一存储位置所在的存储介质进行节能控制;
其中, 所述节能控制条件包括: 所述第一存储位置所在的存储介质中的 所述第一文件的存储时间达到预设存储时间门限、 所述第一存储位置所在的 存储介质中的所述第一文件的访问次数达到预设访问次数门限、 所述第一存 储位置所在的存储介质写满、 所述第一存储位置所在的存储介质写满后等待 的时间达到预设等待时间门限和预设控制周期到达中的至少一个;
第二硬盘控制子单元, 用于在所述第二存储位置所在的存储介质处于掉 电或休眠状态时, 向所述数据存储设备发送第二硬盘控制指示, 以控制所述 数据存储设备对所述第二存储位置所在的存储介质进行上电或休眠恢复操 作。
3、 根据权利要求 2所述的存储控制设备, 其特征在于, 所述第一硬盘控 制子单元包括: 第一获取模块, 用于在所述写入控制单元控制所述数据存储设备将所述 第一文件写入所述第一存储位置后, 根据所述写入控制单元提供的所述第一 存储位置的信息, 获取所述第一存储位置所在的存储介质的状态信息;
第一判断模块,用于根据所述第一存储位置所在的存储介质的状态信息, 判断所述第一存储位置所在的存储介质是否满足所述节能控制条件;
第二获取模块, 用于在所述第一判断模块的判断结果为满足时, 获取所 述节能控制条件对应的节能操作指示;
第一发送模块, 用于向所述数据存储设备发送所述第一硬盘控制指示 , 以使所述数据存储设备对所述第一存储位置所在的存储介质进行所述节能操 作指示所标识的节能控制;所述第一硬盘控制指示包括对所述节能操作指示。
4、 根据权利要求 1或 2或 3所述的存储控制设备, 其特征在于, 所述写 入控制单元包括:
第一获取子单元, 用于根据存储位置选择策略获取所述第一存储位置; 所述存储位置选择策略包括根据所述数据存储设备的设备状态信息选择存储 位置; 所述数据存储设备的设备状态信息包括所述数据存储设备上各存储介 质的标识和状态信息;
第一发送子单元, 用于将所述第一存储位置的信息发送给所述硬盘控制 单元 , 并将所述第一存储位置的信息和所述第一文件发送给所述数据存储设 备, 以使所述数据存储设备根据所述第一存储位置的信息将所述第一文件存 储到所述第一存储位置。
5、 根据权利要求 2或 3或 4所述的存储控制设备, 其特征在于, 所述第 二硬盘控制子单元包括:
第三获取模块 , 用于在所述读出控制单元控制所述数据存储设备从所述 第二存储位置读出所述第二文件之前, 根据所述读出控制单元提供的所述第 二存储位置的信息, 获取所述第二存储位置所在的存储介质的状态信息; 第二判断模块,用于根据所述第二存储位置所在的存储介质的状态信息, 判断所述第二存储位置所在的存储介质是否处于掉电或休眠状态;
第二发送模块, 用于在所述第二判断模块的判断结果为是时, 向所述数 据存储设备发送所述第二硬盘控制指示 , 以控制所述数据存储设备对所述第 二存储位置所在的存储介质进行上电或休眠恢复操作。
6、 根据权利要求 1-5任一项所述的存储控制设备, 其特征在于, 所述读 出控制单元包括:
第二获取子单元, 用于获取所述第二文件的标识;
第三获取子单元, 用于根据所述第二文件的标识在文件元数据中进行查 找, 获取所述第二文件的存储位置信息; 所述文件元数据包括所述数据存储 设备上存储的文件的标识和文件的存储位置信息, 所述第二文件的存储位置 信息包括所述数据存储设备的信息和所述第二存储位置的信息;
第二发送子单元, 用于将所述第二存储位置的信息发送给所述硬盘控制 单元;
第三发送子单元, 用于在所述第二存储位置所在的存储介质处于上电状 态时 , 或在所述数据存储设备根据所述第二硬盘控制指示对所述第二存储位 置所在的存储介质进行上电或休眠恢复操作之后, 根据所述数据存储设备的 信息, 将所述第二存储位置的信息发送给所述数据存储设备, 以使所述数据 存储设备从所述第二存储位置读出所述第二文件。
7、 根据权利要求 3-6任一项所述的存储控制设备, 其特征在于, 所述节 能控制条件对应的节能操作指示包括对满足所述节能控制条件的存储介质进 行掉电控制、 对满足所述节能控制条件的存储介质进行休眠控制、 对满足所 述节能控制条件的存储介质进行降速控制、 对满足所述节能控制条件的存储 介质进行磁头悬停控制或对满足所述节能控制条件的存储介质所在的数据存 储设备进行整机掉电控制。
8、 一种数据归档存储系统, 其特征在于, 包括: 数据存储设备和存储控 制设备, 所述数据存储设备包括至少一个存储介质, 所述存储介质为支持随 机存取数据的介质;
所述存储控制设备包括:
写入控制单元, 用于控制数据存储设备将第一文件写入所述数据存储设 备的第一存储位置, 所述第一文件为待存储的文件;
读出控制单元, 用于获取第二文件的标识和所述第二文件的存储位置信 息, 并根据获取到的所述第二文件的标识和所述第二文件的存储位置信息, 控制所述数据存储设备从所述第二存储位置读出所述第二文件, 所述第二文 件为待读取的文件; 硬盘控制单元, 用于向所述数据存储设备发送第一硬盘控制指示, 以使 所述数据存储设备对所述第一存储位置所在的存储介质进行节能控制 , 以及 在所述第二存储位置所在的存储介质处于掉电或休眠状态时, 向所述数据存 储设备发送第二硬盘控制指示 , 以控制所述数据存储设备对所述第二存储位 置所在的存储介质进行上电或休眠恢复操作;
所述数据存储设备包括:
写入单元, 用于在所述写入控制单元的控制下将所述第一文件写入所述 第一存储位置;
读出单元, 用于在所述读出控制单元的控制下从所述第二存储位置读出 所述第二文件;
控制处理单元, 用于接收所述第一硬盘控制指示, 并根据所述第一硬盘 控制指示中对所述第一存储位置所在的存储介质进行节能控制 , 以及接收所 述第二硬盘控制指示 , 并根据所述第二硬盘控制指示对所述第二存储位置所 在的存储介质进行上电或休眠恢复操作节能操作。
9、 根据权利要求 8所述的数据归档存储系统, 其特征在于, 所述硬盘控 制单元包括:
第一硬盘控制子单元, 用于在所述第一存储位置所在的存储介质满足节 能控制条件时, 向所述数据存储设备发送所述第一硬盘控制指示, 以使所述 数据存储设备对所述第一存储位置所在的存储介质进行节能控制; 所述节能 控制条件包括: 所述第一存储位置所在的存储介质中的所述第一文件的存储 时间达到预设存储时间门限、 所述第一存储位置所在的存储介质中的所述第 一文件的访问次数达到预设访问次数门限、 所述第一存储位置所在的存储介 质写满、 所述第一存储位置所在的存储介质写满后等待的时间达到预设等待 时间门限和预设控制周期到达中的至少一个;
第二硬盘控制子单元, 用于在所述第二存储位置所在的存储介质处于掉 电或休眠状态时, 向所述数据存储设备发送第二硬盘控制指示, 以控制所述 数据存储设备对所述第二存储位置所在的存储介质进行上电或休眠恢复操 作。
10、 根据权利要求 9所述的数据归档存储系统, 其特征在于, 所述第一 硬盘控制子单元包括: 第一获取模块, 用于在所述写入控制单元控制所述数据存储设备将所述 第一文件写入所述第一存储位置后, 根据所述写入控制单元提供的所述第一 存储位置的信息, 获取所述第一存储位置所在的存储介质的状态信息;
第一判断模块,用于根据所述第一存储位置所在的存储介质的状态信息, 判断所述第一存储位置所在的存储介质是否满足所述节能控制条件;
第二获取模块, 用于在所述第一判断模块的判断结果为满足时, 获取所 述节能控制条件对应的节能操作指示;
第一发送模块, 用于向所述数据存储设备发送所述第一硬盘控制指示 , 以使所述数据存储设备对所述第一存储位置所在的存储介质进行所述节能操 作指示所标识的节能控制;所述第一硬盘控制指示包括对所述节能操作指示。
11、 根据权利要求 8-10任一项所述的数据归档存储系统, 其特征在于, 所述写入控制单元包括:
第一获取子单元, 用于根据存储位置选择策略获取所述第一存储位置; 所述存储位置选择策略包括根据所述数据存储设备的设备状态信息选择存储 位置; 所述数据存储设备的设备状态信息包括所述数据存储设备上各存储介 质的标识和状态信息;
第一发送子单元, 用于将所述第一存储位置的信息发送给所述硬盘控制 单元 , 并将所述第一存储位置的信息和所述第一文件发送给所述数据存储设 备, 以使所述数据存储设备根据所述第一存储位置的信息将所述第一文件存 储到所述第一存储位置。
12、根据权利要求 9或 10或 11所述的数据归档存储系统, 其特征在于, 所述第二硬盘控制子单元包括:
第三获取模块 , 用于在所述读出控制单元控制所述数据存储设备从所述 第二存储位置读出所述第二文件之前, 根据所述读出控制单元提供的所述第 二存储位置的信息, 获取所述第二存储位置所在的存储介质的状态信息; 第二判断模块,用于根据所述第二存储位置所在的存储介质的状态信息, 判断所述第二存储位置所在的存储介质是否处于掉电或休眠状态;
第二发送模块, 用于在所述第二判断模块的判断结果为是时, 向所述数 据存储设备发送所述第二硬盘控制指示 , 以控制所述数据存储设备对所述第 二存储位置所在的存储介质进行上电或休眠恢复操作。
13、 根据权利要求 8-12任一项所述的数据归档存储系统, 其特征在于, 所述读出控制单元包括:
第二获取子单元, 用于获取所述第二文件的标识;
第三获取子单元, 用于根据所述第二文件的标识在文件元数据中进行查 找, 获取所述第二文件的存储位置信息; 所述文件元数据包括所述数据存储 设备上存储的文件的标识和文件的存储位置信息, 所述第二文件的存储位置 信息包括所述数据存储设备的信息和所述第二存储位置的信息;
第二发送子单元, 用于将所述第二存储位置的信息发送给所述硬盘控制 单元;
第三发送子单元, 用于在所述第二存储位置所在的存储介质处于上电状 态时 , 或者在所述数据存储设备根据所述第二硬盘控制指示对所述第二存储 位置所在的存储介质进行上电或休眠恢复操作之后, 根据所述数据存储设备 的信息, 将所述第二存储位置的信息发送给所述数据存储设备, 以使所述数 据存储设备从所述第二存储位置读出所述第二文件。
14、 根据权利要求 10-13任一项所述的数据归档存储系统, 其特征在于, 所述节能控制条件对应的节能操作指示包括对满足所述节能控制条件的存储 介质进行掉电控制、 对满足所述节能控制条件的存储介质进行休眠控制、 对 满足所述节能控制条件的存储介质进行降速控制、 对满足所述节能控制条件 的存储介质进行磁头悬停控制或对满足所述节能控制条件的存储介质所在的 数据存储设备进行整机掉电控制。
15、 根据权利要求 14所述的数据归档存储系统, 其特征在于, 还包括: 元数据存储设备;
所述元数据存储设备, 用于存储所述文件元数据, 以向所述第三获取子 单元提供所述文件元数据。
16、 一种数据归档存取方法, 其特征在于, 包括:
存储控制设备接收存储控制请求;
当所述存储控制请求为将第一文件写入数据存储设备时, 所述存储控制 设备的写入控制单元控制所述数据存储设备将所述第一文件写入所述数据存 储设备的第一存储位置, 所述第一文件为待存储的文件; 其中, 所述数据存 储设备包括至少一个存储介质, 所述存储介质为支持随机存取数据的介质; 所述存储控制设备的硬盘控制单元向所述数据存储设备发送第一硬盘控制指 示, 以使所述数据存储设备对所述第一存储位置所在的存储介质进行节能控 制;
当所述存储控制请求为从所述数据存储设备中读取第二文件时, 所述存 储控制设备的读出控制单元获取所述第二文件的标识和所述第二文件的存储 位置信息; 所述读出控制单元在第二存储位置所在的存储介质处于上电状态 时 , 或者在所述数据存储设备根据第二硬盘控制指示对所述第二存储位置所 在的存储介质进行上电或休眠恢复操作之后, 根据获取到的所述第二文件元 的标识和所述第二文件的存储位置信息, 控制所述数据存储设备从所述第二 存储位置读出所述第二文件, 所述第二文件为待读取的文件。
17、 根据权利要求 16所述的数据归档存取方法, 其特征在于, 所述存储 控制设备的硬盘控制单元向所述数据存储设备发送第一硬盘控制指示, 以使 所述数据存储设备对所述第一存储位置所在的存储介质进行节能控制包括: 所述硬盘控制单元在所述第一存储位置所在的存储介质满足节能控制条 件时, 向所述数据存储设备发送所述第一硬盘控制指示, 以使所述数据存储 设备对所述第一存储位置所在的存储介质进行节能控制;
其中, 所述节能控制条件包括: 所述第一存储位置所在的存储介质中的 所述第一文件的存储时间达到预设存储时间门限、 所述第一存储位置所在的 存储介质中的所述第一文件的访问次数达到预设访问次数门限、 所述第一存 储位置所在的存储介质写满、 所述第一存储位置所在的存储介质写满后等待 的时间达到预设等待时间门限和预设控制周期到达中的至少一个。
18、 根据权利要求 17所述的数据归档存取方法, 其特征在于, 所述硬盘 控制单元在所述第一存储位置所在的存储介质满足节能控制条件时, 向所述 数据存储设备发送所述第一硬盘控制指示, 以使所述数据存储设备对所述第 一存储位置所在的存储介质进行节能控制包括:
所述硬盘控制单元在所述写入控制单元控制所述数据存储设备将所述第 一文件写入所述第一存储位置后, 根据所述写入控制单元提供的所述第一存 储位置的信息获取所述第一存储位置所在的存储介质的状态信息;
所述硬盘控制单元根据所述第一存储位置所在的存储介质的状态信息, 判断所述第一存储位置所在的存储介质是否满足所述节能控制条件; 当判断结果为满足时, 所述硬盘控制单元获取所述节能控制条件对应的 节能操作指示, 向所述数据存储设备发送所述第一硬盘控制指示, 以使所述 数据存储设备对所述第一存储位置所在的存储介质进行所述节能操作指示所 标识的节能控制; 所述第一硬盘控制指示包括对所述节能操作指示。
19、根据权利要求 16或 17或 18所述的数据归档存取方法,其特征在于, 所述存储控制设备的写入控制单元控制所述数据存储设备将所述第一文件写 入所述数据存储设备的第一存储位置包括:
所述写入控制单元根据存储位置选择策略获取所述第一存储位置; 所述 存储位置选择策略包括根据所述数据存储设备的设备状态信息选择存储位 置; 所述数据存储设备的设备状态信息包括所述数据存储设备上各存储介质 的标识和状态信息;
所述写入控制单元将所述第一存储位置的信息发送给所述硬盘控制单 元,并将所述第一存储位置的信息和所述第一文件发送给所述数据存储设备, 以使所述数据存储设备根据所述第一存储位置的信息将所述第一文件存储到 所述第一存储位置。
20、 根据权利要求 16-19任一项所述的数据归档存取方法, 其特征在于, 所述硬盘控制单元判断第二存储位置所在的存储介质的状态包括:
所述硬盘控制单元在所述读出控制单元控制所述数据存储设备从所述第 二存储位置读出所述第二文件之前, 根据所述读出控制单元提供的所述第二 存储位置的信息, 获取所述第二存储位置所在的存储介质的状态信息;
所述硬盘控制单元根据所述第二存储位置所在的存储介质的状态信息, 判断所述第二存储位置所在的存储介质是否处于掉电或休眠状态。
21、 根据权利要求 16-20任一项所述的数据归档存取方法, 其特征在于, 所述存储控制设备的读出控制单元获取所述第二文件的标识和所述第二文件 的存储位置信息包括:
所述读出控制单元获取所述第二文件的标识;
所述读出控制单元根据所述第二文件的标识在文件元数据中进行查找, 获取所述第二文件的存储位置信息; 所述文件元数据包括所述数据存储设备 上存储的文件的标识和文件的存储位置信息, 所述第二文件的存储位置信息 包括所述数据存储设备的信息和所述第二存储位置的信息; 所述读出控制单元将所述第二存储位置的信息发送给所述硬盘控制单 元;
所述数据归档存取方法还包括:
所述硬盘控制单元根据所述第二存储位置的信息 , 获取所述第二存储位 置所在的存储介质的状态信息, 判断所述第二存储位置所在的存储介质是否 处于掉电或休眠状态, 当所述第二存储位置所在的存储介质处于掉电或休眠 状态时, 向所述数据存储设备发送所述第二硬盘控制指示, 以控制所述数据 存储设备对所述第二存储位置所在的存储介质进行上电或休眠恢复操作。
22、 根据权利要求 18-21任一项所述的数据归档存取方法, 其特征在于, 所述节能控制条件对应的节能操作指示包括对满足所述节能控制条件的存储 介质进行掉电控制、 对满足所述节能控制条件的存储介质进行休眠控制、 对 满足所述节能控制条件的存储介质进行降速控制、 对满足所述节能控制条件 的存储介质进行磁头悬停控制或对满足所述节能控制条件的存储介质所在的 数据存储设备进行整机掉电控制。
PCT/CN2012/074825 2012-04-27 2012-04-27 存储控制设备、数据归档存储系统和数据存取方法 WO2013159337A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201280000592.6A CN103069380B (zh) 2012-04-27 2012-04-27 存储控制设备、数据归档存储系统和数据存取方法
PCT/CN2012/074825 WO2013159337A1 (zh) 2012-04-27 2012-04-27 存储控制设备、数据归档存储系统和数据存取方法
EP12805422.8A EP2757461B1 (en) 2012-04-27 2012-04-27 Storage control device, data archival storage system and data access method
US13/744,788 US20130290658A1 (en) 2012-04-27 2013-01-18 Storage Control Device, Data Archive Storage System, and Data Access Method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/074825 WO2013159337A1 (zh) 2012-04-27 2012-04-27 存储控制设备、数据归档存储系统和数据存取方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/744,788 Continuation US20130290658A1 (en) 2012-04-27 2013-01-18 Storage Control Device, Data Archive Storage System, and Data Access Method

Publications (1)

Publication Number Publication Date
WO2013159337A1 true WO2013159337A1 (zh) 2013-10-31

Family

ID=48110622

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/074825 WO2013159337A1 (zh) 2012-04-27 2012-04-27 存储控制设备、数据归档存储系统和数据存取方法

Country Status (4)

Country Link
US (1) US20130290658A1 (zh)
EP (1) EP2757461B1 (zh)
CN (1) CN103069380B (zh)
WO (1) WO2013159337A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114692229A (zh) * 2022-03-30 2022-07-01 中国电信股份有限公司 硬盘无权访问检测方法、装置、计算机设备和存储介质

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9197655B2 (en) * 2013-07-16 2015-11-24 Bank Of America Corporation Steganography detection
CN103714146B (zh) * 2013-12-26 2017-01-04 华为技术有限公司 存储方法及装置
CN104702872B (zh) * 2014-02-12 2018-11-13 杭州海康威视数字技术股份有限公司 一种录像文件的备份方法和装置
WO2015175720A1 (en) * 2014-05-13 2015-11-19 Netapp, Inc. Storage operations utilizing a multiple-data-storage-devices cartridge
CN104991737B (zh) * 2015-06-18 2018-08-17 杭州电子科技大学 一种基于存储卡阵列架构的硬盘实现方法
CN106484073A (zh) * 2016-09-28 2017-03-08 华为技术有限公司 系统节能的方法和节能系统
JP6942977B2 (ja) * 2017-03-08 2021-09-29 日本電気株式会社 ファイル分散記憶装置、プログラム、ファイル分散管理方法
CN108108126B (zh) * 2017-12-15 2021-05-28 北京奇艺世纪科技有限公司 一种数据处理方法、装置及设备
CN108345510B (zh) * 2018-01-11 2022-02-08 中国人民解放军国防科技大学 一种自动巡检检测大规模离线归档系统可靠性的方法
CN108650481B (zh) * 2018-04-19 2021-08-10 北京软通智慧城市科技有限公司 一种视频流数据的存储方法及装置
KR20200019420A (ko) * 2018-08-14 2020-02-24 에스케이하이닉스 주식회사 입력데이터를 분산저장하기 위한 메모리 시스템 및 데이터 처리 시스템
CN111090652B (zh) * 2019-12-20 2023-05-23 山大地纬软件股份有限公司 一种可水平扩展归档数据库的数据归档方法和装置
CN111459261A (zh) * 2020-04-03 2020-07-28 北京云宽志业网络技术有限公司 磁盘唤醒方法、装置、电子设备及存储介质
CN111464419B (zh) * 2020-04-13 2021-08-27 中国人民解放军国防科技大学 一种基于总线网络通信的数据传输控制方法
CN111984554B (zh) * 2020-07-31 2023-03-28 新华三技术有限公司成都分公司 一种数据处理方法及装置
CN113568570B (zh) * 2021-06-22 2024-04-12 阿里巴巴创新公司 数据处理方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005063591A (ja) * 2003-08-18 2005-03-10 Matsushita Electric Ind Co Ltd ディスクアレイ装置
US7100013B1 (en) * 2002-08-30 2006-08-29 Nvidia Corporation Method and apparatus for partial memory power shutoff
CN101192093A (zh) * 2006-11-20 2008-06-04 泽玮科技股份有限公司 外接式硬盘的省电方法
CN101582015A (zh) * 2008-05-14 2009-11-18 巴比禄股份有限公司 控制装置、外部存储装置以及它们的控制方法
US20110040938A1 (en) * 2009-08-12 2011-02-17 Samsung Electronics Co., Ltd. Electronic apparatus and method of controlling the same
CN102123167A (zh) * 2010-12-31 2011-07-13 成都市华为赛门铁克科技有限公司 分布式文件系统及其数据存储处理方法和装置

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5423046A (en) * 1992-12-17 1995-06-06 International Business Machines Corporation High capacity data storage system using disk array
US7266668B2 (en) * 2003-11-24 2007-09-04 Copan Systems Inc. Method and system for accessing a plurality of storage devices
US20060184719A1 (en) * 2005-02-16 2006-08-17 Sinclair Alan W Direct data file storage implementation techniques in flash memories
CN1869880A (zh) * 2005-05-25 2006-11-29 儒园系统股份有限公司 安全省电的硬盘存储系统及其方法
US7702853B2 (en) * 2007-05-04 2010-04-20 International Business Machines Corporation Data storage system with power management control and method
US8060759B1 (en) * 2007-06-29 2011-11-15 Emc Corporation System and method of managing and optimizing power consumption in a storage system
JP4971895B2 (ja) * 2007-07-06 2012-07-11 株式会社日立製作所 記憶システム及び消費電力削減方法並びに情報処理装置
US7870409B2 (en) * 2007-09-26 2011-01-11 Hitachi, Ltd. Power efficient data storage with data de-duplication
JP5134915B2 (ja) * 2007-11-02 2013-01-30 株式会社日立製作所 記憶領域の構成最適化方法、計算機システム及び管理計算機
JP2010003149A (ja) * 2008-06-20 2010-01-07 Hitachi Ltd ストレージ装置及びディスク装置制御方法
CN101625586A (zh) * 2008-07-09 2010-01-13 联想(北京)有限公司 一种管理存储设备节能的方法、设备和计算机
CN101325610B (zh) * 2008-07-30 2011-12-28 杭州华三通信技术有限公司 虚拟磁带库备份系统以及磁盘电源控制方法
CN101739114A (zh) * 2008-11-10 2010-06-16 中兴通讯股份有限公司 一种存储设备及实现存储设备中硬盘节能的方法
US8301852B2 (en) * 2008-11-13 2012-10-30 International Business Machines Corporation Virtual storage migration technique to minimize spinning disks
US8201001B2 (en) * 2009-08-04 2012-06-12 Lsi Corporation Method for optimizing performance and power usage in an archival storage system by utilizing massive array of independent disks (MAID) techniques and controlled replication under scalable hashing (CRUSH)

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7100013B1 (en) * 2002-08-30 2006-08-29 Nvidia Corporation Method and apparatus for partial memory power shutoff
JP2005063591A (ja) * 2003-08-18 2005-03-10 Matsushita Electric Ind Co Ltd ディスクアレイ装置
CN101192093A (zh) * 2006-11-20 2008-06-04 泽玮科技股份有限公司 外接式硬盘的省电方法
CN101582015A (zh) * 2008-05-14 2009-11-18 巴比禄股份有限公司 控制装置、外部存储装置以及它们的控制方法
US20110040938A1 (en) * 2009-08-12 2011-02-17 Samsung Electronics Co., Ltd. Electronic apparatus and method of controlling the same
CN102123167A (zh) * 2010-12-31 2011-07-13 成都市华为赛门铁克科技有限公司 分布式文件系统及其数据存储处理方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2757461A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114692229A (zh) * 2022-03-30 2022-07-01 中国电信股份有限公司 硬盘无权访问检测方法、装置、计算机设备和存储介质
CN114692229B (zh) * 2022-03-30 2023-11-10 中国电信股份有限公司 硬盘无权访问检测方法、装置、计算机设备和存储介质

Also Published As

Publication number Publication date
US20130290658A1 (en) 2013-10-31
EP2757461A1 (en) 2014-07-23
EP2757461A4 (en) 2014-12-24
EP2757461B1 (en) 2018-04-04
CN103069380B (zh) 2014-11-05
CN103069380A (zh) 2013-04-24

Similar Documents

Publication Publication Date Title
WO2013159337A1 (zh) 存储控制设备、数据归档存储系统和数据存取方法
KR101736384B1 (ko) 비휘발성 메모리 시스템
JP5961218B2 (ja) ストレージ・クラスタにおける適応的な電力節約の方法
WO2017107900A1 (zh) 一种虚拟机恢复的方法及虚拟机管理设备
US8627130B2 (en) Power saving archive system
WO2015033451A1 (ja) 分散ストレージシステム及びそのデータアクセス方法
JP2007086843A (ja) ディスクの回転を制御するシステム
WO2015081470A1 (zh) 数据处理设备和数据处理的方法
WO2009134932A2 (en) Maintaining checkpoints during backup of live system
WO2020098654A1 (zh) 基于云存储的数据存储方法、装置和存储介质
JP4813872B2 (ja) 計算機システム及び計算機システムのデータ複製方法
WO2018076633A1 (zh) 一种远程数据复制方法、存储设备及存储系统
US11662925B2 (en) Data processing method and distributed storage system
US20150160711A1 (en) Method for switching a device between hibernat mode and wake-up
TWI510933B (zh) 遠端存取資料的方法以及本地端裝置
CN109753222B (zh) 数据删除方法、服务器及计算机可读介质
JP2008065706A (ja) 記憶システム及びその制御方法並びに記憶制御装置
US20090013137A1 (en) Storage system and power consumption reduction method, and information processing apparatus
US20090249003A1 (en) Method and system for multiplexing concatenated storage disk arrays to form a rules-based array of disks
US8171324B2 (en) Information processing device, data writing method, and program for the same
US8959235B1 (en) Techniques for determining an optimal connection duration for a connection between a client and a server across a network
WO2020094063A1 (zh) 存储数据的方法、装置、存储介质及电子装置
JP5807942B2 (ja) ディスクアレイ装置及びその制御方法
US10346044B2 (en) Preloading of directory data in data storage devices
KR20120035089A (ko) Nas

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201280000592.6

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2012805422

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12805422

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE