PatentTips - Hierarchical RAID system including multiple RAIDs
BACKGROUND OF THE INVENTION
The present invention relates to a storage system offering large capacitance, high performance, and high availability through a hierarchical construction of RAID and a method for controlling the storage system; and more particularly, to a hierarchical RAID system including virtual disks, each of which is composed of a traditional RAID with a number of disks, and to a method for controlling the RAID system and a recording medium capable of being read through a computer having a writing of a program to realize the inventive method.
In the last few years, we have experienced huge disparity between I/O subsystem performance and processing power of a computer system that has been growing steadily. Myers has reported that processor power doubled every 2.25 years since 1978, however the I/O performance has not kept pace with the gains in processing power. As the gap between the performance of processors and I/O systems is becoming large, the overall performance of a computer system will depend on the I/O bottleneck. Therefore, it is essential to balancing the I/O bandwidth and the computational power.
Improving I/O performance, known as data declustering and disk striping in disk array systems has been one of the main research topic for computer architects in recent years. Patterson et al. have proposed Redundant Arrays of Inexpensive Disks (RAID) that is defined by five different levels of RAID (Level 1˜5) depending on the data and parity placement scheme. The RAID offers large capacity and high performance using a number of disks, and is a reliable storage system that prevents from data loss by means of single disk redundancy, even if a disk fails.
Redundant arrays of inexpensive disks (hereinafter, referred to as "RAID") offer fault tolerance against disk failures. However a storage system having more disks suffer from less reliability and performance. A RAID architecture tolerating multiple disks failures shows extremely poor performance in comparison with one of the RAID Level 5 due to the complexity of implementation.
Nowadays, the demand on huge data-storing capacity required by video on demand, internet data center, data warehousing, digital imaging, nonlinear video editing, and etc increases the number of disks of a RAID. As these trends accelerate, traditional RAID cannot protect from the simultaneous loss of more than one disk. As a result, a lot of research has arisen in disk array system that will not lose data even when multiple disks fails simultaneously.
A RAID is a storage system that offers large capacity and high performance using a number of disks, and is a reliable system that prevents from data loss by means of data redundancy, even if a disk fails. RAID Levels such as Level 0, Level 1, Level 5, Level 6, etc, show different characteristic of reliability and performance. A RAID showing better reliability offers generally poor performance.
The RAID Level 0 is a performance-oriented technology with no redundant data. Therefore the storage system requiring high performance uses this scheme. In this Level, the performance is very good but the reliability falls in proportion to the number of the disks.
The RAID Level 1, or disk mirroring, protects against disk failure by replicating all data stored on the virtual disk at least once. It offers extremely high data reliability, and improves performance. However there is a drawback that extremely many disks are required for this scheme.
The RAID Level 5 protects data loss from single disk failure using single parity disk, however more disks degrade the performance. It suffers still from data reliability because of small amount of parities. The RAID Level 6 improves data reliability using two parity disks, however it suffers from extremely degraded performance in comparison with the RAID Level 5.
Previous works have presented fault tolerant schemes for a disk array tolerating against two disk failures, and another works have presented three-disk-tolerant schemes offering better reliability of a disk array. Their schemes at least double the complexity of implementation in comparison with the RAID Level 5, thus a disk array offering better reliability suffers from severe performance degradation, since practical engineers hesitate to adopt these schemes into a commercial RAID system.
RAID Level 3+1 and Level 5+1 have been introduced to dissolve the performance degradation with attaining high reliability. The RAID Level 3+1 is mirroring of the RAID Level 3, and the RAID Level 5+1 is mirroring of the RAID Level 5. However, there is the drawback that these Levels require too many redundant disks, and their disk utilization is lower than 50%. FIGS. 1A and 1B show the structure of RAID Level 3+1 and 5+1. In the drawing, a RAID 110 is constructed as a copy of two RAID Level 3s 111, 112, and a RAID 120 is constructed as a copy of two RAID Level 5s 121, 122. However, such method also has a weakness that a waste of the disk is serious in comparison with the RAID Level 1.
SUMMARY OF THE INVENTION
Therefore, it is an object of the present invention to provide a hierarchical RAID system having a plurality of RAIDs in which a traditional RAID composed of a large number of disks is used as a virtual disk, in order for a data storing based on large capacitance, high performance, and high availability, and to provide a method for controlling the RAID system, and a record medium capable of being read through a computer having a writing of a program to realize the inventive method.
In accordance with an aspect of the present invention, there is provided a hierarchical RAID system having a plurality of RAIDs, in which at least one RAID having a large number of disks is used as a virtual disk, said hierarchical RAID system comprising: a host computing unit; at least one upper level RAID controlling unit having a first RAID Level (X), for controlling a plurality of first lower level RAID controlling units having a second RAID Level (Y); and the plurality of first lower level RAID controlling units, each of which includes member disks.
In accordance with another aspect of the present invention, there is provided a method for controlling a hierarchical RAID system having a plurality of RAIDs in which at least one RAID composed of a large number of disks is used as a virtual disk, the method includes the steps of: a) giving a read-command of data and parity from an upper level RAID controlling unit to a lower level RAID controlling unit when a write-command for new data is given from a host computer; b) performing an exclusive OR operation of the new data, existing data, and the parity, and executing a write-transmission in the lower RAID controlling unit so as to perform a renewal of the parity and the data according to the execution result of the exclusive OR; c) generating a command for reading the parity and data of a hard disk in the lower level RAID controlling unit according to the read-command of the step a), and transmitting it to the high RAID controlling unit; and d) evoking a reading for the data and a parity value and performing the exclusive OR operation according that the write-command given from the upper level RAID controlling unit becomes the write-transmission of each corresponding lower level RAID controlling unit, and executing the write-transmission for the renewal of parity and data.
In accordance with further another aspect of the present invention, there is provided a hierarchical RAID system having a microprocessor, which is provided so as to utilize at least one RAID composed of a large number of disks as a virtual disk, it is provided for a record medium capable of being read through a computer having a writing of a program, the program being for realizing a first function of giving a reading command for data and parity from a high RAID controlling unit to a lower level RAID controlling unit when a write-command for new data is given from a host computer; a second function of performing an exclusive OR operation of the new data, existing data and the parity, and executing a write-transmission in the lower RAID controlling unit so as to perform a renewal of the parity and the data according to the execution result of the exclusive OR; a third function of generating a command for reading the parity and data of a hard disk in the lower level RAID controlling unit according to the reading command of the first function, and transmitting it to the upper level RAID controlling unit; and a fourth function of evoking a reading for the data and a parity value and performing the exclusive OR operation according that the write-command given from the upper level RAID controlling unit becomes the write-transmission of each corresponding lower RAID controlling unit, and executing the write-transmission for the renewal of parity and data.
PREFERRED EMBODIMENT OF THE INVENTION
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
In a general RAID, a disk is directly constructed with the RAID, meantime, an inventive hierarchical RAID system has the construction that the RAID is provided with a virtual disk as another RAID.
FIG. 2 is a block diagram of one embodiment for a hierarchical RAID system in accordance with the present invention.
As shown in the drawing, the inventive hierarchical RAID system includes a host computer 200 and numerous RAID controllers based on a hierarchical structure. The upper level RAID controller 210 of a RAID Level X connected to the host computer 200 contains a plurality of lower RAID controllers 220, 230, 240 of a RAID Level Y, and the lower level RAID controllers 220, 230, 240 respectively include member disks 221˜223, 231˜233,241˜243, wherein X and Y indicate, e.g., numbers of traditional RAID Levels such as 0, 1, 3, 5 and 6 etc. The following RAID constructed by the above-described system is named as the homogeneous hierarchical RAID Level X×Y.
The RAID Levels may individually exist in independent RAID controllers, or exist in one RAID controller partially or overall. It is represented 2 as a depth of the hierarchical RAID Level that the high RAID 210 contains the lower level RAIDs 220, 230, 240, the lower level RAID being constructed by disks.
For reference, as shown in FIG. 3, a RAID Level W 310 contains a lower level RAID Level X 320. This lower level RAID also contains a RAID Level V 350. Such construction represents 3 as the depth of the hierarchical RAID constructed with the disks. Like this, the depth of the hierarchical RAID can be extended as 2 or more according to a necessity.
FIG. 3 is a block diagram of another embodiment for the inventive hierarchical RAID system.
In another hierarchical RAID system of the invention shown in this drawing, it shows the construction of one embodiment for a heterogeneous hierarchical RAID, and the RAID controllers of each hierarchy respectively have optional RAID Levels. That is, only one RAID Level exists in the RAID controller 320, but two or more of RAID Levels may exist as shown in a RAID controller 330. In such heterogeneous hierarchical RAID, the hierarchical RAID 350 can be provided by member disks. In addition, all the above RAID Levels may be contained into one RAID controller. Such hierarchical RAID Levels are represented as the heterogeneous hierarchical RAID.
As afore-described, the RAID Level 6 having prominent reliability offers very bad performance in comparison with the widely used RAID Level 5. The hierarchical RAID Level 5×5 means that the upper level RAID includes the Level 5 and each of the lower level RAIDs includes the Level 5, and its performance is similar to the RAID Level 5 and its reliability is more prominent than the RAID Level 6. It can also be made up hierarchical RAID Levels 0×5, 5×0, 1×3, 3×1, 1×5, 5×1, 5×5, 5×6, 6×5 or 6×6, which offers different performance and reliability from each other.
These respective hierarchical RAID Levels provide various characteristics of better reliability and performance than the traditional RAID.
The reliability between the traditional RAID and the hierarchical RAID is compared with each other by means of Markov process, as follows.
In general, the reliability of the RAID is measured in mean-time-to-data-loss (MTTDL). The MTTDL can be numerically obtained as follows, in order to get the reliability based on various construction of the inventive hierarchical RAID.
The reliability of the hierarchical RAID can be obtained from the Markov process for the failure/repair model as shown in FIGS. 4A to 4D. If the failure rate and repair rate of the disk are characterized by the exponential distribution and disks are independent (Reference to "R. Billinton and R. Allian, 'Reliability Evaluation of Engineering System: Concepts and Techniques', Perseus Publishing January 1992"). FIGS. 4A to 4D are an exemplary diagrams of one embodiment of a Markov process for the reliability per RAID Level.
Each branch of a state denotes transition rate to next state. For example, (N−2)λ of two-disk-down state is failure rate (transition rate to three-disk-down state) when two disks have failed. 2μ of two-disk-down state is repair rate (transition rate to single-disk-down state) when two disk have failed, where N is the number of total disks, the repair rate per disk μ is 1/MTTR (mean-time-to-repair), and the failure rate per disk λ equals 1/MTTF (mean-time-to-failure)
Mean-time-to-data-loss (MTTDL) cannot be obtained only using the differential equation, but also the fundamental matrix M that is defined as the following equation (1).
where, Q is the truncated stochastic transitional probability matrix.
The truncated stochastic transitional probability matrixes Q5, Q6, Q7 for the single-disk, two-disk, and three-disk fault tolerant RAID of (A), (B), and (C) for FIG. 4, can be written as the following equation (2).
From the equations (1) and (2), the fundamental matrix M5 of the RAID Level 5 is defined by the following equation (3).
The element mij of M5 is the average time spent in state j given that the process starts in state i before reaching the data-loss state. It was assumed that the system start in state 1 (all-disk-up) and therefore MTTDL is the sum of the average time spent in all state j given that the process starts in state 1. It can formally be written as the following equation (4).
where d+1 is the column size of the fundamental matrix. The MTTDL of the RAID Level 5 can be written as the following equation (5).
In the same ways, the MTTDL of the RAID Level 6 and 7 can be derived by equations (6) and (7).
The MTTDL of the single-disk, two-disk, three-disk fault tolerant RAID can be obtained simply, meanwhile the MTTDL of the RAID Level 1 is somewhat complex. The transitional probability from single-disk-down state to two-disk-down state is neither zero nor one, because if a second failed disk does not correspond to the mirror of the first failed disk, there is no data loss. FIG. 4D shows the Markov diagram of the RAID Level 1. Transitions from single-disk-down state to (d−1)-disk-down state have the probability P′(n) that one more disk fails without data loss in the (n−1)-disk-down state. (N−k)P′(k+1) means the probabilistic number of fault tolerable disks without data loss in the k-disk-down state. The P′(n) is defined by the following equation (8).
where $P(n)$ is the safety probability function that there is no data loss when n disks fail simultaneously. In the mirroring, the data is safe, if each of n mirroring set of N/2 mirroring groups has only one faulty disk. Hence the safety probability function P1(n) of the RAID Level 1 can be written as the following equation (9).
From the equations 1, 8 and 9, and FIG. 4D, the inverse of the fundamental matrix of the RAID Level 1 can be drived by the following equation (10).
where d is the maximum number of fault-tolerable disks. In the case of the RAID Level 1, d is equal to N/2. The symbolic equation of the inverse of M−1 cannot be simply derived from Numerical Expression 10, thus we choose numerical method to calculate the MTTDL.
The hierarchical RAID Level 5×5 tolerates at least three disk failures, and at most i+j−1 disk failures. Where, i is the number of virtual disks comprising the upper level RAID, and j is the number of physical disks comprising each lower level RAID. The total number of disks including check and information disks is equal to i×j.
Derivation of the MTTDL of the HiRAID Level 5×5 is also complex. It is similar to the HiRAID Level 1, if P1(n) of equation 10 is replaced with P5×5(n), which can be defined by the following equation (11).
By the above-mentioned method, P5×5(5) is defined by the following equation (12).
From the above two expressions, P5×5 can be generalized by the following equation (13).
If the information of the lower level RAID is unknown to the upper level RAID, the safety probability function P0×5(n) of the hierarchical RAID Level 0×5 is the probability that n disks fail in n separate groups without data loss.
The safety probability function P5×0(n) of the hierarchical RAID Level 5×0 is the probability that n disks fail in a same group without data loss.
The safety probability functions of the hierarchical RAID Level 1×5 and 5×1 are obtained by assigning i=2 and j=2 to the equation (13), respectively.
In FIG. 5, the MTTDLs based on various structures in the traditional RAID and the inventive homogeneous hierarchical RAID are compared through the MTTDL gained in the above expression, where the mean time to failure MTTF is five years and the mean time to repair is one week. The RAID Levels 7 and 8 mean virtual three-disk-failure and four-disk-failure tolerant RAID, respectively.
Referring to FIG. 5, it can be noted that the hierarchical RAID Level 5×1 is most prominent in an aspect of the reliability. However the disk utilization is less than 50%. Meanwhile, the disk utilization of the inventive hierarchical RAID Level 5×5 equals (i−1)(j−1)/(ij), which is 81% when i=j=10. The hierarchical RAID Level 5×5 offers better reliability than the three-disk-failure tolerant RAID (Level 7) that can hardly be implemented in real system due to its complexity. As the number of disks increases, the reliabilities of the hierarchical RAIDs decrease more slowly than those of traditional RAIDs. By this reason, the Level 5×5 outruns the four-disk-failure tolerant RAID (Level 8) when the number of disks is large, where the number of disks of this condition depends on MTTF and MTTR, The Level 0×5 also outruns the Level 6 when the number of disks is large.
We can know that the Level 5+1 (Level 1×5) is poorer than the Level 1 and the Level 5×1, hence the reciprocal configuration of the Level 1×5 is better. The Level 0×5 is also better than the Level 5×0.
The RAID Level 5×5 has prominent excellent reliability and good performance. The worst shortcoming of the RAID Level 6 is that the RAID Level 6 has very bad performance in comparison with the RAID Level 5., while, the hierarchical RAID Level 5×5 has performance similar to the RAID Level 5.
FIGS. 6A and 6B are exemplary diagrams of one embodiment for a small-write operation of the RAID Level 5 in the invention, and FIGS. 7A and 7B are exemplary diagrams of one embodiment for an operation of a small-write operation of the hierarchical RAID Level 5×5 of the invention. W.tr, R.tr, R.c, and XOR in the drawings respectively represent a write-transmission, a read-transmission, a read-command and an exclusive OR.
FIG. 6B illustrates a sequence diagram generated in the host computer and the RAID controller, matching to the operation of FIG. 6A.
As shown in FIGS. 6A and 6B, when a write-command for new data D1 is transmitted (W1.tr), a read-command R1.c, R2.c is sent to a disk through a lower channel in order to read the data D1 and parity P1. Then a transmission of R1 and R2 corresponding to that is performed in the disk (R1.tr, R2.tr), and an exclusive OR for the new data D1, previous data D1, and the parity P1 is executed (XOR). Finally, the write-transmission (W3.tr) for renewing a result value of the exclusive OR to the parity P1 and the write-transmission (W2.tr) for renewing the new data D1 are generated.
FIG. 7B depicts a sequence diagram generated in three RAID controllers of the host computer and the hierarchical RAID, matching to the operation of FIG. 7A.
As shown in FIGS. 7A and 7B, when the write-command for the new data D1 is given from the host computer to the upper level RAID controller (W1.tr), the upper level RAID controller sends the read-command for the data D1 and the parity P1 to the lower level RAID controller (R1.c, R2.c). Next, when the read-transmission corresponding to that is performed (R1.tr, R2.tr), the exclusive OR for the new data D1, the previous data D2 and the parity P1 is executed (XOR). Then, the write-transmission (W2.tr) to the lower level RAID controller is generated in order for the renewal (W3.tr) of the parity P1 for its result value and the new data D1.
During the execution of such operation, the read-command R1.c transmitted from the upper level RAID controller to the lower level RAID controller is generated as the read-command (R3.c) and transmission (R3.tr) for reading the data D1 of the hard disk in the lower level RAID controller, and the lower level controller transmits it to the upper level controller (R1.tr).
Further, the read-command R2.c transmitted from the upper level RAID controller to the lower level RAID controller is generated as the read-command (R5.c) and transmission (R5.tr) for reading the parity P1 of the hard disk in the lower level RAID controller. Then the lower level controller transmits it to the high controller (R2.tr).
Finally, write-transmissions W2 and W3 transmitted from the upper level RAID controller become write-transmissions W4 and W5 of the lower RAID controller, respectively. Such two write-operations correspond to the data D1 and the parity P1 shown in FIG. 7. The operations are independently generated in two RAID controllers.
The write-command W4 from the upper level RAID controller generates a reading for the data D1 and a reading (R4.c+R4.tr) for parity values of D1 and D3. The exclusive OR is also performed. Then the write-transmission (W7.tr) for the renewal of the parity of D1 and D3 and the renewal (W6.tr) of the data D1 are generated.
The write-command W5 from the upper level RAID controller generates a reading of the parity P1 and a reading for parity values of P1 and D4 (R6.c +R6.tr). Then the exclusive OR is executed, and the write-transmission (W9.tr) for the renewal of the parity of P1 and D4, and the renewal (W8.tr) of the parity P1.
The complexity of the hierarchical RAID Level 5×5 is about three times of that of the RAID Level 5, however the operations of the hierarchical RAID disperse throughout three RAID controllers. From FIGS. 6A and 6B, the operation of the RAID Level 5, 05, can be written as the following equation (17).
Operations of the controllers 1, 2 and 3 of the RAID Level 5×5 shown in FIG. 7 can be written as the following equation (18).
The RAID controller 2 and the RAID controller 3 have one more read-command and one more read-transmission comprising single read-transaction. In other words, the RAID Level 5 requires five data transmission requests by one small-write request, and in a case of the hierarchical RAID transmission Level 5×5, the upper level RAID controller generates five data transmissions and the lower level RAID controller generates six data transmissions. However the additional read-transaction resides in the upper channel interfacing the upper level RAID, thus it does not bottleneck the overall performance, because the lower channel has more read/write transactions. Also, the large-write and read operation of the hierarchical RAID Level 5×5 is equal to that of the RAID Level 5 except slight extra latency that it takes for commands to pass through the upper level RAID controller.
The inventive method described above can be embodied as a program and this program can be stored as a type of being read through a computer at a record medium such as CDROM, RAM, ROM, a floppy disk, a hard disk, and an optical magnetic disk etc.
As afore-mentioned, in accordance with the present invention, the inventive technique is provided to remarkably settle problems of a general RAID, for instances, the more the number of the disks is getting, the lower a reliability becomes rapidly, or many disks are required for good performance, or a seriously bad performance is caused in order to heighten the reliability. That is, there is a prominent effect that the disk utilization is considerably increased and high reliability is also provided in an aspect of failure repair, by using, as a virtual disk, the traditional RAID constructing with a large number of disks.