OracleZFSStorageApplianceCustomer ServiceManual PartNo:E48492 January2014E48492–02 Copyright©2009-2014,Oracleand/oritsaffiliates.Allrightsreserved. Thissoftwareandrelateddocumentationareprovidedunderalicenseagreementcontainingrestrictionsonuseanddisclosureandareprotectedbyintellectual propertylaws.Exceptasexpresslypermittedinyourlicenseagreementorallowedbylaw,youmaynotuse,copy,reproduce,translate,broadcast,modify,license, transmit,distribute,exhibit,perform,publishordisplayanypart,inanyform,orbyanymeans.Reverseengineering,disassembly,ordecompilationofthissoftware, unlessrequiredbylawforinteroperability,isprohibited. Theinformationcontainedhereinissubjecttochangewithoutnoticeandisnotwarrantedtobeerror-free.Ifyoufindanyerrors,pleasereportthemtousinwriting. IfthisissoftwareorrelateddocumentationthatisdeliveredtotheU.S.GovernmentoranyonelicensingitonbehalfoftheU.S.Government,thefollowingnoticeis applicable: U.S.GOVERNMENTENDUSERS.Oracleprograms,includinganyoperatingsystem,integratedsoftware,anyprogramsinstalledonthehardware,and/or documentation,deliveredtoU.S.Governmentendusersare"commercialcomputersoftware"pursuanttotheapplicableFederalAcquisitionRegulationand agency-specificsupplementalregulations.Assuch,use,duplication,disclosure,modification,andadaptationoftheprograms,includinganyoperatingsystem, integratedsoftware,anyprogramsinstalledonthehardware,and/ordocumentation,shallbesubjecttolicensetermsandlicenserestrictionsapplicabletothe programs.NootherrightsaregrantedtotheU.S.Government. Thissoftwareorhardwareisdevelopedforgeneraluseinavarietyofinformationmanagementapplications.Itisnotdevelopedorintendedforuseinanyinherently dangerousapplications,includingapplicationsthatmaycreateariskofpersonalinjury.Ifyouusethissoftwareorhardwareindangerousapplications,thenyoushall beresponsibletotakeallappropriatefail-safe,backup,redundancy,andothermeasurestoensureitssafeuse.OracleCorporationanditsaffiliatesdisclaimany liabilityforanydamagescausedbyuseofthissoftwareorhardwareindangerousapplications. OracleandJavaareregisteredtrademarksofOracleand/oritsaffiliates.Othernamesmaybetrademarksoftheirrespectiveowners. IntelandIntelXeonaretrademarksorregisteredtrademarksofIntelCorporation.AllSPARCtrademarksareusedunderlicenseandaretrademarksorregistered trademarksofSPARCInternational,Inc.AMD,Opteron,theAMDlogo,andtheAMDOpteronlogoaretrademarksorregisteredtrademarksofAdvancedMicro Devices.UNIXisaregisteredtrademarkofTheOpenGroup. Thissoftwareorhardwareanddocumentationmayprovideaccesstoorinformationoncontent,products,andservicesfromthirdparties.OracleCorporationand itsaffiliatesarenotresponsibleforandexpresslydisclaimallwarrantiesofanykindwithrespecttothird-partycontent,products,andservices.OracleCorporation anditsaffiliateswillnotberesponsibleforanyloss,costs,ordamagesincurredduetoyouraccesstooruseofthird-partycontent,products,orservices. Copyright©2009-2014,Oracleet/ousesaffiliés.Tousdroitsréservés. Celogicieletladocumentationquil’accompagnesontprotégésparlesloissurlapropriétéintellectuelle.Ilssontconcédéssouslicenceetsoumisàdesrestrictions d’utilisationetdedivulgation.Saufdispositiondevotrecontratdelicenceoudelaloi,vousnepouvezpascopier,reproduire,traduire,diffuser,modifier,breveter, transmettre,distribuer,exposer,exécuter,publierouafficherlelogiciel,mêmepartiellement,sousquelqueformeetparquelqueprocédéquecesoit.Parailleurs,ilest interditdeprocéderàtouteingénierieinversedulogiciel,deledésassembleroudeledécompiler,exceptéàdesfinsd’interopérabilitéavecdeslogicielstiersoutelque prescritparlaloi. Lesinformationsfourniesdanscedocumentsontsusceptiblesdemodificationsanspréavis.Parailleurs,OracleCorporationnegarantitpasqu’ellessoientexemptes d’erreursetvousinvite,lecaséchéant,àluienfairepartparécrit. Sicelogiciel,ouladocumentationquil’accompagne,estconcédésouslicenceauGouvernementdesEtats-Unis,ouàtouteentitéquidélivrelalicencedecelogiciel oul’utilisepourlecompteduGouvernementdesEtats-Unis,lanoticesuivantes’applique: U.S.GOVERNMENTENDUSERS.Oracleprograms,includinganyoperatingsystem,integratedsoftware,anyprogramsinstalledonthehardware,and/or documentation,deliveredtoU.S.Governmentendusersare"commercialcomputersoftware"pursuanttotheapplicableFederalAcquisitionRegulationand agency-specificsupplementalregulations.Assuch,use,duplication,disclosure,modification,andadaptationoftheprograms,includinganyoperatingsystem, integratedsoftware,anyprogramsinstalledonthehardware,and/ordocumentation,shallbesubjecttolicensetermsandlicenserestrictionsapplicabletothe programs.NootherrightsaregrantedtotheU.S.Government. Celogicieloumatérielaétédéveloppépourunusagegénéraldanslecadred’applicationsdegestiondesinformations.Celogicieloumatérieln’estpasconçunin’est destinéàêtreutilisédansdesapplicationsàrisque,notammentdansdesapplicationspouvantcauserdesdommagescorporels.Sivousutilisezcelogicieloumatériel danslecadred’applicationsdangereuses,ilestdevotreresponsabilitédeprendretouteslesmesuresdesecours,desauvegarde,deredondanceetautresmesures nécessairesàsonutilisationdansdesconditionsoptimalesdesécurité.OracleCorporationetsesaffiliésdéclinenttouteresponsabilitéquantauxdommagescausés parl’utilisationdecelogicieloumatérielpourcetyped’applications. OracleetJavasontdesmarquesdéposéesd’OracleCorporationet/oudesesaffiliés.Toutautrenommentionnépeutcorrespondreàdesmarquesappartenantà d’autrespropriétairesqu’Oracle. IntelXeonsontdesmarquesoudesmarquesdéposéesd'IntelCorporation.TouteslesmarquesSPARCsontutiliséessouslicenceetsontdesmarquesoudesmarques déposéesdeSPARCInternational,Inc.AMD,Opteron,lelogoAMDetlelogoAMDOpteronsontdesmarquesoudesmarquesdéposéesd'AdvancedMicroDevices. UNIXestunemarquedéposéed'TheOpenGroup. Celogicieloumatérieletladocumentationquil'accompagnepeuventfournirdesinformationsoudesliensdonnantaccèsàdescontenus,desproduitsetdesservices émanantdetiers.OracleCorporationetsesaffiliésdéclinenttouteresponsabilitéougarantieexpressequantauxcontenus,produitsouservicesémanantdetiers.En aucuncas,OracleCorporationetsesaffiliésnesauraientêtretenuspourresponsablesdespertessubies,descoûtsoccasionnésoudesdommagescausésparl'accèsà descontenus,produitsouservicestiers,ouàleurutilisation. 140127@25097 Contents Preface.....................................................................................................................................................9 1 Introduction .........................................................................................................................................11 Overview...............................................................................................................................................11 Introduction .................................................................................................................................11 Hardware..............................................................................................................................................14 HardwareView.............................................................................................................................15 BUI.................................................................................................................................................15 CLI .................................................................................................................................................21 Tasks..............................................................................................................................................23 2 HardwareMaintenance......................................................................................................................27 Maintenance ........................................................................................................................................27 Introduction .................................................................................................................................27 ZS3-2.....................................................................................................................................................28 ZS3-2HardwareOverview .........................................................................................................28 ControllerOverview....................................................................................................................29 PhysicalSpecifications.................................................................................................................33 ElectricalSpecifications...............................................................................................................33 AcousticNoiseEmissions ...........................................................................................................34 InternalComponents ..................................................................................................................34 Motherboard,Memory,andPCIeCards ..................................................................................36 OptionalCableManagementArm ............................................................................................40 AttachedStorage ..........................................................................................................................41 ZS3-4.....................................................................................................................................................41 ZS3-4HardwareOverview .........................................................................................................41 ControllerOverview....................................................................................................................41 3 Contents InternalBoards.............................................................................................................................44 Components .................................................................................................................................45 AttachedStorage ..........................................................................................................................51 ZS3-2.....................................................................................................................................................51 ZS3-2CRUMaintenanceProcedures .......................................................................................51 PreparetheControllerforServicingInternalComponents...................................................53 ControllerReplacementTasks...................................................................................................56 OracleDE2andSunDiskShelfInteroperability......................................................................72 ZS3-4.....................................................................................................................................................73 ZS3-4CRUMaintenanceProcedures .......................................................................................73 Prerequisites .................................................................................................................................73 SafetyInformation .......................................................................................................................73 RequiredToolsandInformation ...............................................................................................73 ChassisSerialNumber.................................................................................................................74 ControllerReplacementTasks...................................................................................................74 OracleDE2andSunDiskShelfInteroperability......................................................................89 7120 .......................................................................................................................................................90 7120HardwareOverview ...........................................................................................................90 ChassisOverview .........................................................................................................................90 ElectricalSpecifications...............................................................................................................92 InternalComponents ..................................................................................................................93 StandaloneControllerConfigurations......................................................................................98 AttachedStorage ..........................................................................................................................99 7320 .......................................................................................................................................................99 7320HardwareOverview ...........................................................................................................99 ChassisOverview .......................................................................................................................100 7320ReplaceableComponents ................................................................................................105 7320SingleandClusterControllerConfigurations ..............................................................107 7420 .....................................................................................................................................................109 7420HardwareOverview .........................................................................................................109 ApplianceOverview ..................................................................................................................109 Chassis.........................................................................................................................................110 InternalBoards...........................................................................................................................113 Components ...............................................................................................................................114 AttachedStorage ........................................................................................................................120 7x20 .....................................................................................................................................................120 4 OracleZFSStorageApplianceCustomerServiceManual • January2014E48492–02 Contents 7x20CRUMaintenanceProcedures........................................................................................120 Prerequisites ...............................................................................................................................120 SafetyInformation .....................................................................................................................120 RequiredToolsandInformation .............................................................................................121 ChassisSerialNumber...............................................................................................................121 ControllerReplacementTasks.................................................................................................122 OracleDE2andSunDiskShelfInteroperability....................................................................142 Shelf.....................................................................................................................................................143 DiskShelfOverview...................................................................................................................143 Shelf.....................................................................................................................................................156 DiskShelfMaintenanceProcedures........................................................................................156 Prerequisites ...............................................................................................................................156 SafetyInformation .....................................................................................................................156 ElectrostaticDischargePrecautions ........................................................................................156 Tasks............................................................................................................................................157 Faults...................................................................................................................................................167 HardwareFaults .........................................................................................................................167 Cabling................................................................................................................................................168 ConnectingtoAttachedStorage ..............................................................................................168 Cabling................................................................................................................................................169 ConnectingtoAttachedStorage ..............................................................................................170 SummaryofControllerConfigurations .........................................................................................171 MaximumControllerConfigurations.....................................................................................171 DE2toZS3-2/7120/7320Standalone..............................................................................................171 ConnectingZS3-2/7120/7320StandaloneControllerstoDiskShelves..............................171 DE2toZS3-2/7320Clustered ..........................................................................................................173 ConnectingZS3-2/7320ClusteredControllerstoDiskShelves ..........................................173 DE2toZS3-4/7420Standalone........................................................................................................174 ConnectingtheZS3-4/7420StandaloneControllertoDiskShelves(3HBAs)..................174 DE2toZS3-4/7420Clustered ..........................................................................................................176 ConnectingtheZS3-4/7420ClusteredControllertoDiskShelves(3HBAs) ....................176 7120-7320Cabling ............................................................................................................................179 Connecting7120/7320StandaloneControllerstoSunDiskShelves ..................................179 7320ClusterCabling.........................................................................................................................180 Connectingthe7320ClusteredControllertoSunDiskShelves..........................................180 7420Cabling ......................................................................................................................................181 5 Contents Connectingthe7420StandaloneControllertoSunDiskShelves(2and6HBAs)............181 7420ClusterCabling.........................................................................................................................184 Connectingthe7420ClusteredControllerstoDiskShelves(2and6HBAs) ....................184 ZS3-2/7120/7320withDE2andSunDiskShelves ........................................................................187 ConnectingZS3-2/7120/7320StandaloneControllerstoMixedDiskShelves..................187 ZS3-2/7320ClusteredwithDE2andSunDiskShelves ................................................................188 ConnectingZS3-2/7320StorageClusteredControllerstoMixedDiskShelves ................188 ZS3-4/7420withDE2andSunDiskShelves ..................................................................................189 ConnectingZS3-4/7420StandaloneControllerstoMixedDiskShelves............................189 ZS3-4/7420ClusteredwithDE2andSunDiskShelves ................................................................190 ConnectingZS3-4/7420ClusteredControllerstoMixedDiskShelves ..............................190 3 SystemMaintenance.........................................................................................................................193 System.................................................................................................................................................193 Introduction ...............................................................................................................................193 SystemDisks...............................................................................................................................193 SupportBundles.........................................................................................................................194 InitialSetup.................................................................................................................................195 FactoryReset...............................................................................................................................196 Updates...............................................................................................................................................196 SystemUpdates ..........................................................................................................................196 HardwareFirmwareUpdates ...................................................................................................204 Rollback.......................................................................................................................................206 ClusterUpgrade .........................................................................................................................208 UpdatingviatheBUI.................................................................................................................209 UpdatingviatheCLI .................................................................................................................211 Passthroughx.....................................................................................................................................214 Passthrough-xDeferredUpdate ..............................................................................................214 UserQuotas........................................................................................................................................214 UserQuotasDeferredUpdate..................................................................................................214 COMSTAR.........................................................................................................................................215 COMSTARDeferredUpdate ...................................................................................................215 TripleParityRAID ............................................................................................................................215 Triple-ParityRAIDDeferredUpdate......................................................................................215 Dedup .................................................................................................................................................215 6 OracleZFSStorageApplianceCustomerServiceManual • January2014E48492–02 Contents DataDeduplicationDeferredUpdate .....................................................................................215 Replication .........................................................................................................................................216 ReplicationDeferredUpdate....................................................................................................216 ReceivedProperties...........................................................................................................................216 ReceivedPropertiesDeferredUpdate .....................................................................................216 SlimZIL ..............................................................................................................................................217 Introduction ...............................................................................................................................217 SnapshotDeletion .............................................................................................................................217 SnapshotDeletionDeferredUpdate .......................................................................................217 RecursiveSnapshots..........................................................................................................................217 RecursiveSnapshotsDeferredUpdate....................................................................................217 MultiReplace .....................................................................................................................................218 MultiReplaceDeferredUpdate................................................................................................218 RAIDZMirror ...................................................................................................................................218 RAIDZ/MirrorDeferredUpdate.............................................................................................218 OptionalChildDir ............................................................................................................................218 Introduction ...............................................................................................................................218 MultipleInitiatorGroupsperLUN.................................................................................................219 Introduction ...............................................................................................................................219 ConfigurationBackup .......................................................................................................................219 ConfigurationBackup...............................................................................................................219 Problems.............................................................................................................................................224 Problems .....................................................................................................................................224 Activeproblemsdisplay ............................................................................................................224 Repairingproblems ...................................................................................................................225 Relatedfeatures ..........................................................................................................................225 Logs .....................................................................................................................................................226 Introduction ...............................................................................................................................226 BUI...............................................................................................................................................228 CLI ...............................................................................................................................................228 Glossary..............................................................................................................................................231 7 8 Preface TheOracleZFSStorageApplianceCustomerServiceManualcontainshardwareoverviewsand maintenanceproceduresfortheOracleZFSStorageAppliance. ThisdocumentationisalsoavailablewhileusingtheBrowserUserInterface,accessibleviathe Helpbutton.TheappliancedocumentationmaybeupdatedusingtheSystemUpgrade proceduredocumentedintheSystemMaintenancechapterofthisbook. WhoShouldUseThisBook ThesenotesareforusersandsystemadministratorswhoserviceandusetheOracleZFSStorage Appliance. RelatedDocumentation Refertothefollowingdocumentationforinstallationinstructions,hardwareoverviews,service proceduresandsoftwareupdatenotes. ■ InstallationGuide,AnalyticsGuideandAdministrationGuide(http://www.oracle.com/ technetwork/documentation/) Third-PartyWebSiteReferences Third-partyURLsarereferencedinthisdocumentandprovideadditional,relatedinformation. Note–Oracleisnotresponsiblefortheavailabilityofthird-partyWebsitesmentionedinthis document.Oracledoesnotendorseandisnotresponsibleorliableforanycontent,advertising, products,orothermaterialsthatareavailableonorthroughsuchsitesorresources.Oraclewill notberesponsibleorliableforanyactualorallegeddamageorlosscausedbyorinconnection withtheuseoforrelianceonanysuchcontent,goods,orservicesthatareavailableonor throughsuchsitesorresources. 9 Preface AccesstoOracleSupport OraclecustomershaveaccesstoelectronicsupportthroughMyOracleSupport.For information,visithttp://www.oracle.com/pls/topic/lookup?ctx=acc&id=infoorvisit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trsifyouarehearingimpaired. 10 OracleZFSStorageApplianceCustomerServiceManual • January2014E48492–02