Hardware issues

From Linux Raid Wiki
(Difference between revisions)
Jump to: navigation, search
m
(remove spam)
Line 1: Line 1:
[http://mohdjohari.com/adbox/data/db/new2171.htm free java scripts] [http://fazlisyam.com/wp-content/uploads/2006/topic1001.htm arthritis tool] [http://polymerteam.com/infoboard/wp-includes/plugins/article-2284.htm engage killswitch ringtone] [http://ekpli.com/blog/wp-content/uploads/2007/news2142.html the grinch] [http://forousa.net/diamanterra/images/f/f7/text-1938.html skin protectant] [http://dontlickyourmonitor.com/forum/Packages/install/news-1053-2008-06-20.html angelina jolies sex video] [http://coolstudytactics.com/wp-content/uploads/2006/news1757.html moving memories video] [http://chinmayd.com/wp-content/uploads/2007/06/1320.htm primal code crack] [http://dollersforlife.com/support/attachments/files/article-1580.htm merritt square mall movies] [http://geologia.co.uk/paleopag/lib/scripts/page-295.html norton 2004 serial] [http://darkdevils.co.uk/cache/images/text546.htm movie broadcast news] [http://dontlickyourmonitor.com/forum/Packages/install/news-8-2008-06-21.html sugar sugar] [http://dd-forums.info/images/avatars/upload/images/basdel468.htm riverhead bay motors] [http://myenik.com/order/img/Thumbs/racrac.html porm movie reviews] [http://shankarsbook.com/upload/media/qascnad.html deer hunting magazines] [http://bandamusicadechiclana.es/portal/uploads/images/topic-779.html lower cholesterol naturally] [http://petuajimatduit.com/teknikmudah/img/icons/topic2525.htm elvis karate ed parker] [http://mohdjohari.com/adbox/data/db/new2204.htm rate my shot] [http://www.lindazerain.com/web/media/files/comment1549.htm used heavy trucks canada] [http://ascentwebsolutions.com/files/u2/resource-723.html disneyworld vacation rental condos] [http://jimieray.com/blog/wp-content/uploads/2006/topic-1166.html lesbians doing it] [http://cadarshop.com/catalog/images/pixel/text-1976.html adult galleries mature women] [http://autopundit.com/wp-content/uploads/2007/03/page-1393.html butt] [http://autopundit.com/wp-content/uploads/2007/03/page-1695.html allysin chaynes] [http://dikmal.com/blog/wp-content/uploads/2007/comment-143.html new used commercial vehicles] [http://popculturenexus.com/community/images/avatars/pics/article-695.htm condominium conversions] [http://tvcomerciales.com/uploadfiles/images/resource1850.htm adult inspirational short story young] [http://coolstudytactics.com/wp-content/uploads/2006/news310.html nokia pm 6225 accessories] [http://erzodir.com/wp-content/uploads/2007/page1236.html mcafee vshield updates] [http://dikmal.com/blog/wp-content/uploads/2007/index.html http] [http://mohdjohari.com/adbox/data/db/new1850.htm viagra cream for women] [http://photostudio.ir/gallery/data/thumbnails/19/comment-683.htm the incredibles free game] [http://idclub.biz/club/files/pictures/pics/2510.htm carlson twins] [http://detroitinvestmenthomes.com/office/pc4p_dev/inc/etcachigo.html record streaming video mac] [http://dontlickyourmonitor.com/forum/Packages/install/sitemap.html domain] [http://mujahidmuda.com/bicarasiswa/Packages/install/fifidronm.html in india smith will] [http://ekpli.com/blog/wp-content/uploads/2007/news879.html kenmore elite] [http://idclub.biz/club/files/pictures/pics/2338.htm hanging cosmetic bag] [http://livertransplant.in/gujarati/video/mpeg/topic1446.htm products american african] [http://ajaypal.com/files/active/3/page1084.html individuality] [http://indianwebdevs.com/ipb/skin_cache/cacheid_5/news1296.html vx3100a ringtones] [http://erzodir.com/wp-content/uploads/2007/page2084.html moonlight elecard crack] [http://sreejith.net/wp-content/uploads/2007/sedsaa57.htm janeane garofalo picture] [http://belajarbahasaarab.com/ustaz/backups/dump/resource2251.htm aerobatic videos] [http://popculturenexus.com/community/images/avatars/pics/article-2206.htm calligraphy fonts] [http://petuajimatduit.com/teknikmudah/img/icons/topic1882.htm jibjab second term lyrics] [http://mohdjohari.com/adbox/data/db/new2062.htm movie theater maumee ohio] [http://darkdevils.co.uk/cache/images/text972.htm internet movie car database] [http://livertransplant.in/gujarati/video/mpeg/topic1137.htm picnic food ideas] [http://promar.org.br/galeria/albums/images_imp/topic-588.htm lyme] [http://5hr.org/wp-content/uploads/2007/09/news-650.html prototype designs] [http://5hr.org/wp-content/uploads/2007/09/news-1661.html scum of the earth video] [http://erzodir.com/wp-content/uploads/2007/page540.html marsh groceries] [http://ascentwebsolutions.com/files/u2/index.html page] [http://myazhax.net/drop/files/images/news1291.html uniform code council ucc] [http://eranga.info/cpg144/albums/userpics/10001/index.html sites] [http://petuajimatduit.com/teknikmudah/img/icons/topic241.htm eminems new video mokingbird] [http://www.digitalsbazaar.com/adsense/order/img/thumbs/article-1114.htm traditional las vegas golf courses] [http://photostudio.ir/gallery/data/thumbnails/19/comment-1050.htm silicone sex toys] [http://linncomel.com/wp-content/uploads/js_cache/temp/comment-1990.htm natasha bedingfield silent movie lyrics] [http://5hr.org/wp-content/uploads/2007/09/news-748.html pamela anderson fucking video] [http://midlandsfc.co.uk/forum/store/files/cozelfa-767.html singing video clips] [http://dikmal.com/blog/wp-content/uploads/2007/index.html link] [http://idclub.biz/club/files/pictures/pics/2181.htm discount faucets] [http://petuajimatduit.com/teknikmudah/img/icons/topic1289.htm kind of love that lasts forever] [http://polymerteam.com/infoboard/wp-includes/plugins/article-1077.htm abi titmus video free download] [http://livertransplant.in/gujarati/video/mpeg/topic1204.htm two teens kissing] [http://ajaypal.com/files/active/3/page1669.html mystery science theater the movie dvd] [http://inthehousefestival.com/imageimport/images/article1404.htm movie quotes chin up young] [http://petwelfare.org/upload/media/article987.htm short kangaroo rat videos] [http://indianwebdevs.com/ipb/skin_cache/cacheid_5/news1289.html pretty young girl] [http://ekpli.com/blog/wp-content/uploads/2007/news904.html czech girls galleries] [http://ajaypal.com/files/active/3/page1553.html spanking porn video] [http://www.lindazerain.com/web/media/files/comment953.htm movie screening] [http://mohdjohari.com/adbox/data/db/new1622.htm tzd drug] [http://dontlickyourmonitor.com/forum/Packages/install/news-2038-2008-06-22.html weight lifting routines] [http://detroitinvestmenthomes.com/office/pc4p_dev/inc/coqasret.html adult only video game x box] [http://dd-forums.info/images/avatars/upload/images/zarbrze856.htm ancient persian clothing] [http://ekpli.com/blog/wp-content/uploads/2007/news2644.html epson scaner driver] [http://dollersforlife.com/support/attachments/files/article-1868.htm san diego readers magazine] [http://livertransplant.in/gujarati/video/mpeg/topic63.htm lichens] [http://mmmsp.com/forms/use/35pc0509/getinfum11.htm abi titmus movie free download] [http://ajaypal.com/files/active/3/sitemap.html more] [http://polymerteam.com/infoboard/wp-includes/plugins/article-1260.htm mountain gorilla video] [http://shankarsbook.com/upload/media/komexb.html ac dc music video clip] [http://cadarshop.com/catalog/images/pixel/sitemap.html more] [http://dd-forums.info/images/avatars/upload/images/retrract566.htm britney spears having sex] [http://aazmin.com/ebb316/wp-content/uploads/2007/article886.html mexico natural history museum] [http://promar.org.br/galeria/albums/images_imp/topic-1694.htm accel in] [http://petwelfare.org/upload/media/article2345.htm shuttle explosion] [http://mohdjohari.com/adbox/data/db/new847.htm angel dark movie porn star] [http://fazlisyam.com/wp-content/uploads/2006/topic1443.htm aphex twin come to daddy music video] [http://indianwebdevs.com/ipb/skin_cache/cacheid_5/news398.html pink panther movie promo paperweight] [http://ascentwebsolutions.com/files/u2/sitemap.html link] [http://caperweb.com/auto2/images/thumbs/news-1499-20080612.html learn italian in italy] [http://inthehousefestival.com/imageimport/images/article1852.htm hippie clothes] [http://popculturenexus.com/community/images/avatars/pics/article-2749.htm lookup license plate number] [http://belajarbahasaarab.com/ustaz/backups/dump/resource1139.htm polyphonic ringtones compose] [http://belajarbahasaarab.com/ustaz/backups/dump/resource552.htm christian plays] [http://5hr.org/wp-content/uploads/2007/09/news-1244.html jupiters moons europa] [http://photostudio.ir/gallery/data/thumbnails/19/comment-1049.htm horny young girls] [http://darkdevils.co.uk/cache/images/text1313.htm thyme and again] [http://linncomel.com/wp-content/uploads/js_cache/temp/comment-1517.htm light sabre] [http://mmmsp.com/forms/use/35pc0509/acercaelt2192.htm paraglider video] [http://ajaypal.com/files/active/3/page1612.html jordan capri and tawnee stone] [http://eranga.info/cpg144/albums/userpics/10001/news-484.html ocean breeze phuket] [http://popculturenexus.com/community/images/avatars/pics/article-318.htm pirate ship deck] [http://ninethsense.com/validator/Visitors/docs/article-357.htm t mobile.com ringtones] [http://livertransplant.in/gujarati/video/mpeg/topic1671.htm visa credit card] [http://hst.co.in/formgenerator/forms/inc/text-1445.htm long lasting free gay sex movies] [http://erzodir.com/wp-content/uploads/2007/page1116.html lesbian video and dvd for sale] [http://myenik.com/order/img/Thumbs/nrvargold.html movies blade] [http://dd-forums.info/images/avatars/upload/images/nenorol1082.htm eve 6 music videos] [http://bharatcolleges.com/images/bottombanners/pics/news-2659.html erectile dysfunction in young males] [http://shankarsbook.com/upload/media/erdronboc.html lucifer rising movie] [http://idclub.biz/club/files/pictures/pics/2642.htm movie clips of stripping] [http://5hr.org/wp-content/uploads/2007/09/news-2765.html sexy black lesbians] [http://ninethsense.com/validator/Visitors/docs/article-1054.htm inauguration president bush video] [http://belajarbahasaarab.com/ustaz/backups/dump/resource962.htm risk ii serial crack] [http://promar.org.br/galeria/albums/images_imp/topic-323.htm roof-top 12 roofing screw] [http://myenik.com/order/img/Thumbs/relenerl.html largest prehistoric fish] [http://forousa.net/diamanterra/images/f/f7/text-1567.html aluminum supplier] [http://bandamusicadechiclana.es/portal/uploads/images/topic-1433.html ipaq and programs] [http://ajaypal.com/files/active/3/page97.html ableton live serials] [http://photostudio.ir/gallery/data/thumbnails/19/index.htm link] [http://darkdevils.co.uk/cache/images/text1019.htm eye pillows] [http://sreejith.net/wp-content/uploads/2007/cnapase1699.htm free mp3 ringtone for motorola v600] [http://dikmal.com/blog/wp-content/uploads/2007/sitemap.html web] [http://shankarsbook.com/upload/media/golkoqasm.html home owner insurance company] [http://ajaypal.com/files/active/3/page217.html nascar wrecks video] [http://mujahidmuda.com/bicarasiswa/Packages/install/ologetne.html cake pans] [http://myenik.com/order/img/Thumbs/chichic.html jason tharp marine video] [http://websule.com/support/js/scripts/1072.htm camping and outdoor gear] [http://aazmin.com/ebb316/wp-content/uploads/2007/index.html sites] [http://bharatcolleges.com/images/bottombanners/pics/news-377.html coon hunting supplies] [http://dollersforlife.com/support/attachments/files/article-1682.htm anais objetivo fama] [http://ninethsense.com/validator/Visitors/docs/article-1267.htm msn video chat rooms] [http://5hr.org/wp-content/uploads/2007/09/news-206.html large pond filter] [http://sreejith.net/wp-content/uploads/2007/bugrol1810.htm private school for girls movie] [http://dryhandsminnowbucket.com/xmlsitemap/pages/images/resource-2215.html licenses for businesses] [http://forousa.net/diamanterra/images/f/f7/text-2586.html play every video game] [http://akkusilcesi.com/foto/albums/userpics/10002/zelrec.html msoffice 2003 crack] [http://dontlickyourmonitor.com/forum/Packages/install/news-510-2008-06-17.html mobile pics and ringtones] [http://petwelfare.org/upload/media/article2290.htm over the counter drugs] [http://midlandsfc.co.uk/forum/store/files/alnonrwli-735.html autofx photographic edges crack] [http://www.digitalsbazaar.com/adsense/order/img/thumbs/article-1551.htm rated sale video x] [http://hst.co.in/formgenerator/forms/inc/text-1809.htm boost phone ringtone] [http://myenik.com/order/img/Thumbs/quaenla.html movie theater in long beach] [http://webringnet.com/classified/pictures/cats/pic/sitemap.html http] [http://inthehousefestival.com/imageimport/images/article2281.htm lipitor associated with pituitary gland] =Hardware issues=
+
=Hardware issues=
  
 
This section will mention some of the hardware concerns involved when
 
This section will mention some of the hardware concerns involved when

Revision as of 08:14, 23 July 2008

Contents

Hardware issues

This section will mention some of the hardware concerns involved when running software RAID.

If you are going after high performance, you should make sure that the bus(ses) to the drives are fast enough. You should not have 14 UW-SCSI drives on one UW bus, if each drive can give 20 MB/s and the bus can only sustain 160 MB/s. Also, you should only have one device per IDE channel. Running disks as master/slave is horrible for performance. IDE is really bad at accessing more that one drive per channel. Most newer motherboards have two IDE busses, so you can set up two disks in RAID without buying more controllers. Extra IDE controllers are rather cheap these days, so setting up 6-8 disk systems with IDE is easy and affordable.

Also most newer motherboards have one or more controllers for SATA disks. SATA disks do not connect more than one disk on one channel so the problems mentined aboce with multiple IO for 2 disks on one channel is not relevant for SATA disks.

See also the section on bottlenecks.


IDE Configuration

It is indeed possible to run RAID over IDE disks. And excellent performance can be achieved too. In fact, today's price on IDE drives and controllers does make IDE something to be considered, when setting up new RAID systems.

  • Physical stability: IDE drives has traditionally been of lower mechanical quality than SCSI drives. Even today, the warranty on IDE drives is typically one year, whereas it is often three to five years on SCSI drives. Although it is not fair to say, that IDE drives are per definition poorly made, one should be aware that IDE drives of some brand may fail more often that similar SCSI drives. However, other brands use the exact same mechanical setup for both SCSI and IDE drives. It all boils down to: All disks fail, sooner or later, and one should be prepared for that.
  • Data integrity: Earlier, IDE had no way of assuring that the data sent onto the IDE bus would be the same as the data actually written to the disk. This was due to total lack of parity, checksums, etc. With the Ultra-DMA standard, IDE drives now do a checksum on the data they receive, and thus it becomes highly unlikely that data get corrupted. The PCI bus however, does not have parity or checksum, and that bus is used for both IDE and SCSI systems.
  • Performance: I am not going to write thoroughly about IDE performance here. The really short story is:
    • IDE drives are fast, although they are not (as of this writing) found in 10.000 or 15.000 rpm versions as their SCSI counterparts
    • IDE has more CPU overhead than SCSI (but who cares?)
    • Only use one IDE drive per IDE bus, slave disks spoil performance
    • Fault survival: The IDE driver usually survives a failing IDE device. The RAID layer will mark the disk as failed, and if you are running RAID levels 1 or above, the machine should work just fine until you can take it down for maintenance.

It is very important, that you only use one IDE disk per IDE bus. Not only would two disks ruin the performance, but the failure of a disk often guarantees the failure of the bus, and therefore the failure of all disks on that bus. In a fault-tolerant RAID setup (RAID levels 1,4,5), the failure of one disk can be handled, but the failure of two disks (the two disks on the bus that fails due to the failure of the one disk) will render the array unusable. Also, when the master drive on a bus fails, the slave or the IDE controller may get awfully confused. One bus, one drive, that's the rule.

There are cheap PCI IDE controllers out there. You often get two or four busses for around $80. Considering the much lower price of IDE disks versus SCSI disks, an IDE disk array can often be a really nice solution if one can live with the relatively low number (around 8 probably) of disks one can attach to a typical system.

IDE has major cabling problems when it comes to large arrays. Even if you had enough PCI slots, it's unlikely that you could fit much more than 8 disks in a system and still get it running without data corruption caused by too long IDE cables.

Furthermore, some of the newer IDE drives come with a restriction that they are only to be used a given number of hours per day. These drives are meant for desktop usage, and it can lead to severe problems if these are used in a 24/7 server RAID environment.


Hot Swap

Although hot swapping of drives is supported to some extent, it is still not something one can do easily.

Hot-swapping IDE drives

Don't ! IDE doesn't handle hot swapping at all. Sure, it may work for you, if your IDE driver is compiled as a module (only possible in the 2.2 series of the kernel), and you re-load it after you've replaced the drive. But you may just as well end up with a fried IDE controller, and you'll be looking at a lot more down-time than just the time it would have taken to replace the drive on a downed system.

The main problem, except for the electrical issues that can destroy your hardware, is that the IDE bus must be re-scanned after disks are swapped. While newer Linux kernels do support re-scan of an IDE bus (with the help of the hdparm utility), re-detecting partitions is still something that is lacking. If the new disk is 100% identical to the old one (wrt. geometry etc.), it may work, but really, you are walking the bleeding edge here.

Hot-swapping SCSI drives

Normal SCSI hardware is not hot-swappable either. It may however work. If your SCSI driver supports re-scanning the bus, and removing and appending devices, you may be able to hot-swap devices. However, on a normal SCSI bus you probably shouldn't unplug devices while your system is still powered up. But then again, it may just work (and you may end up with fried hardware).

The SCSI layer should survive if a disk dies, but not all SCSI drivers handle this yet. If your SCSI driver dies when a disk goes down, your system will go with it, and hot-plug isn't really interesting then.

Hot-swapping with SATA

SATA supports hot swapping a drive but the linux kernel is not quite there yet.

see http://linux-ata.org/driver-status.html for more information on SATA hotpug status.

Hot-swapping with SCA

With SCA, it is possible to hot-plug devices. Unfortunately, this is not as simple as it should be, but it is both possible and safe.

Replace the RAID device, disk device, and host/channel/id/lun numbers with the appropriate values in the example below:


  • Dump the partition table from the drive, if it is still readable:
    sfdisk -d /dev/sdb > partitions.sdb


  • Mark faulty and remove the drive to replace from the array:
    mdadm -f /dev/md0 /dev/sdb1
    mdadm -r /dev/md0 /dev/sdb1


  • Look up the Host, Channel, ID and Lun of the drive to replace, by looking in
    /proc/scsi/scsi


  • Remove the drive from the bus:
    echo "scsi remove-single-device 0 0 2 0" > /proc/scsi/scsi


  • Verify that the drive has been correctly removed, by looking in
    /proc/scsi/scsi


  • Unplug the drive from your SCA bay, and insert a new drive
  • Add the new drive to the bus:
    echo "scsi add-single-device 0 0 2 0" > /proc/scsi/scsi


(this should spin up the drive as well)

  • Re-partition the drive using the previously dumped partition table:


    sfdisk /dev/sdb < partitions.sdb


  • Add the drive to your array:
    mdadm -a /dev/md0 /dev/sdb1


The arguments to the "scsi remove-single-device" commands are: Host, Channel, Id and Lun. These numbers are found in the "/proc/scsi/scsi" file.

The above steps have been tried and tested on a system with IBM SCA disks and an Adaptec SCSI controller. If you encounter problems or find easier ways to do this, please discuss this on the linux-raid mailing list.

Personal tools