
Originated: Thu Jan 10 00:00:00 2019
********************************************************************************

HealthCheck_8.1.2_2019-01: Patch for 8.1.2.0.
This patch contains the 2019-01 Service Pack for the Isilon Healthcheck System
********************************************************************************

This patch can be installed on clusters running the following OneFS version: 
 * 8.1.2.0


********************************************************************************

CHECKLISTS

                           all: All available checks
                        avscan: Checklist to determine the overall health of
                                AVScan
              cluster_capacity: Checklist to determine the overall capacity
                                health for a pool or cluster
                    infiniband: Checklist to determine the overall health of
                                the Infiniband backend
                          ioca: Checklist contains all integrated IOCA items.
                    job_engine: Job Engine-related health checks
                     log_level: Checklist to determine the overall health of
                                log-level
                          ndmp: Checklist to determine the overall health of
                                NDMP
                           nfs: Checklist to determine the overall health of
                                nfs
                           ntp: Checklist to determine the overall health of
                                time synchronization
                  post_upgrade: Checklist to determine post upgrade cluster
                                health
                   pre_upgrade: Checklist to determine pre upgrade cluster
                                health
                  smartconnect: Checklist to determine the overall health of
                                SmartConnect
                           smb: Checklist to determine the overall health of
                                smb
                        synciq: Checklist to determine the overall health of
                                SyncIQ


********************************************************************************

ITEMS

                  auth_enabled: Service auth enabled
            avscan_icap_status: Check the ICAP servers status to ensure at
                                least one ICAP server is enabled and active.
          avscan_scan_settings: Check if the AVScan setting 'Scan On Close' is
                                enabled.
         avscan_service_status: Check if AVScan service isi_avscan_d is enabled
                                and sysctl value 'efs.bam.av.enabled' is set
                                correctly.
           battery_test_status: Check nvram.xml and battery status to get the
                                battery health result
               boot_drive_wear: Boot drive wear level.
                     celog_alt: Verify celog process celog_alerting running
                  celog_alt_ap: Verify celog process AlertProcessor running
                     celog_ana: Verify celog process celog_analysis running
                  celog_ana_qp: Verify celog process QueryProcessor running
                  celog_ana_sp: Verify celog process StatusProcessor running
                celog_att_fail: CELOG database locked
                     celog_cap: Verify celog process celog_capture running
                  celog_cap_ag: Verify celog process AttachmentGenerator
                                running
                  celog_cap_ex: Verify celog process Exporter running
                  celog_cap_km: Verify celog process KernelMonitor running
             celog_db_lock_log: CELOG database locked
                 celog_enabled: Service celog enabled
               celog_heartbeat: Celog heartbeat sent and received today
                  celog_memory: CELOG memory issues
         celog_process_restart: CELOG process restarts
                     celog_rep: Verify celog process celog_reporting running
                  celog_rep_pp: Verify celog process PruneProcessor running
         celog_service_restart: CELOG process restarts
           check_mirror_status: Checks the Boot Partition Mirror status of
                                drives.
               custom_cronjobs: Warn the administrator if there are custom cron
                                jobs defined on the cluster.
               data_protection: Check if exists data protection mechanisms
                                applied.
                dcerpc_running: Likewise service dcerpc enabled
            dimm_health_status: Correctable DIMM Errors on Gen-4 and Gen-6.
           drive_unprovisioned: Check if any there are any unprovisioned
                                drives.
  duplicate_gateway_priorities: Checks for subnets with duplicate gateway
                                priorities.
               flexnet_running: Determines if Flexnet is running.
          gateway_connectivity: Each defined gateway responds to a ping from
                                each node.
         healthcheck_self_test: Self test of the healthcheck framework and
                                items
           healthcheck_version: Healthcheck Version Report.
                ilog_log_level: Check the log-level for all services controlled
                                by ilog.
          infiniband_data_rate: Checks each infiniband interface to ensure that
                                data rate is set to the correct value for the
                                given node type.
  infiniband_interface_oactive: When there are physical errors on a port, the
                                Tx queue can back up and cause IPoIB to set the
                                OACTIVE flag on an interface. When OACTIVE is
                                set, the interface will not send any traffic to
                                allow the queue to empty before resuming
                                traffic. Checks each infiniband interface to
                                see if the OACTIVE flag is set.
   infiniband_interface_status: Checks each Infiniband interface to ensure that
                                interface is up and active.
                infiniband_mtu: Checks each Infiniband interface to ensure that
                                its MTU is set to the correct value.
       infiniband_socket_count: Checks all layers of each socket (QP, SDP, RBM)
                                and makes sure associated layers are set up
                                properly.
       infiniband_socket_state: Checks each socket to ensure that it is armed
                                with both a primary and alternate path.
                          ioca: Runs IOCA health checks
         ioca_checkAccessZones: Checks if multiple access zones are configured
                                for upgrades across 7.1.1. Checks for nested or
                                overlapping SMB shares. Adds warnings when any
                                non-System access zone pools are found, only
                                applies for upgrades across OneFS 7.1.1
     ioca_checkAggregationMode: Checks that the aggregation mode is not Legacy
                                FEC mode for upgrades to OneFS 8+
              ioca_checkAspera: Checks for aspera services being enabled,
                                indicating that Aspera is in use on the
                                cluster.
          ioca_checkAuthStatus: Checks authentication status on each node.
                                Warns if any authentication providers are not
                                online or active.  Checks for RFC2307 and Auto-
                                locate of GID/UIDs and points to KB335338
           ioca_checkBMCandCMC: Checks for BMC/CMC related issues
            ioca_checkBXENodes: Checks for existence of nodes with BXE
                                interfaces, also checks for KB493493 & KB511208
                                known issues.
           ioca_checkBootDisks: Checks boot disk wear life remaining, firmware
                                level, and historic error count.  For
                                Generation 4/5, checks for a master and slave
                                boot device.
            ioca_checkCapacity: Verifies cluster capacity based on documented
                                numbers the Upgrade Planning and Progress
                                Guide. Warns if approaching.
             ioca_checkContact: Checks contact information configured in CELog
                                (only useful when called with --extra)
    ioca_checkDestinationOneFS: Checks destination OneFS version
           ioca_checkDiskpools: Checks diskpools and class equivalence for
                                OneFS upgrades going across 7.0.
       ioca_checkDriveFirmware: Checks for out of date Drive Firmware and calls
                                other related drive firmware checks
ioca_checkDriveFirmwarePackage: Checks for drive firmware updates available in
                                the Drive Firmware Package
           ioca_checkDriveLoad: Checks the current load on the drives
   ioca_checkDriveStallTimeout: Checks current Drive Stall Timeout setting,
                                recommend value is 3.5 seconds (3500000
                                microseconds) or higher
 ioca_checkDriveSupportPackage: Checks for drive firmware updates available in
                                the Drive Support Package
        ioca_checkDrivesHealth: Checks health of drives and the drive stall
                                timeout setting in sysctl
                ioca_checkETAs: Checks for ETAs
       ioca_checkEmailSettings: Checks Email settings configured in CELog (only
                                useful when called with --extra)
            ioca_checkEncoding: Checks exports and cluster configuration for if
                                utf-8/default encoding.
              ioca_checkEvents: Checks events on all the nodes, failure if any
                                critical events exist.
        ioca_checkFCOF042415EE: Checks the cluster to see if it meets criteria
                                for FCO F042415EE
         ioca_checkFileSharing: Checks if Atime is enabled
    ioca_checkFilepoolPolicies: Checks GNA requirements and checks filepools
                                for final match being set and names starting
                                with a number.
     ioca_checkGatewayPriority: Checks for subnets with duplicate gateway
                                priorities.
                ioca_checkHDFS: Display HDFS details, only useful when run with
                                --extra
      ioca_checkHardwareStatus: Checks battery health, power supplies, and
                                gathers hardware details for use elsewhere.
              ioca_checkHealth: Verifies cluster health status and node health
                                status.
        ioca_checkIBInterfaces: Checks for ib0/1 as being active, checks for
                                ETA180317 IB switch firmware versions, and
                                checks for overlapping IB networks.
                 ioca_checkIDI: Checks for IDI errors in the past 90 days
               ioca_checkISCSI: Checks for iSCSI LUNs being configured in
                                /ifs/.ifsvar/iscsi/iscsi.conf (OneFS prior to
                                8.x only)
          ioca_checkJobHistory: Checks job history for issues, currently just
                                MediaScan issues.
           ioca_checkJobStatus: Checks for running jobs that would impact an
                                upgrade.
            ioca_checkKB469133: Checks for criteria of KB 469133.
            ioca_checkKB496582: Checks for auth rules issues detailed in
                                KB496582.
            ioca_checkKB507031: Checks for criteria outlined in KB507031
            ioca_checkKB516613: Checks if any node meets criteria for KB516613
            ioca_checkKB519119: Checks if nodes may be impacted by KB 519119
            ioca_checkKB519388: Pre-upgrade check for issues outlined in
                                KB519388
            ioca_checkKB519890: Checks for a known issue with LAGG interfaces
                                in LACP mode when running OneFS 8.0.0.6,
                                8.0.1.2, 8.1.0.2, and 8.1.1.1
            ioca_checkKB521778: Checks for criteria outlined in KB 521778
            ioca_checkKB521890: Checks for criteria outlined in KB 521890
            ioca_checkKB524082: Checks if the cluster is enabled for HTTP
                                clients and flags an issue caused by the change
                                in Apache versions.
            ioca_checkKB527312: Checks if the cluster meets criteria for KB
                                527312
        ioca_checkKerberos8000: Checks for an issue with the Kerberos
                                configuration file for OneFS upgrades
                                targetting 8.0.0.0.
             ioca_checkLACPSFP: Checks for LACP on cxgb interfaces for KB
                                489262
            ioca_checkLWIODLog: Checks /var/log/lwiod.log for known errors
                                occuring in the last 30 days
      ioca_checkLastZoneID8000: Checks for gaps in access zones that may cause
                                major issues for OneFS upgrades targeting
                                8.0.0.0.
          ioca_checkLegacyLDAP: Checks for Legacy LDAP being enabled in OneFS 6
                                to OneFS 7 upgrades
             ioca_checkLicense: Checks licenses and gives direction based on
                                licensed features.  InsigntIQ and vCenter
                                licenses, gives information from compatibility
                                guide.  iSCSI, instructs to only perform
                                simultaneous OneFS upgrades and that it is not
                                supported in 8.0.
         ioca_checkListenQueue: Checks for listen queue overflows to be less
                                than 50,000 per node
              ioca_checkMemory: Checks each DIMM to meet criteria outlined in
                                KB89614 and if the expected (per product info
                                line) matches closely the reported RAM.
         ioca_checkMessagesLog: Checks /var/log/messages.log for known errors
                                occuring in the last 30 days
             ioca_checkMirrors: Checks the boot mirror health
                ioca_checkNDMP: Checks for running NDMP sessions
                 ioca_checkNFS: Runs nfsstat and looks for Encountered RPC
                                error
             ioca_checkNetstat: Checks connections counts for specific
                                protocols via netstat
   ioca_checkNodeCompatibility: Checks node compatibility by comparing it
                                against known supported versions.
        ioca_checkNodeFirmware: Checks node firmware for updates
               ioca_checkNodes: Checks if nodes are EOSL
       ioca_checkOneFSVersions: Checks running version and target version for
                                any issues. Failure: Any version mismatch
                                across all nodes
           ioca_checkOpenFiles: Checks if there are more than 50,000 open files
                                are reported by the kernel in sysctl.
          ioca_checkPartitions: Checks system partition space.
             ioca_checkPatches: Checks for highly recommended patches, on the
                                current version if no target version, or for
                                the target version.
         ioca_checkPerformance: Checks cluster performance
           ioca_checkProcesses: Checks for OpenSM master, MCP, and
                                isi_upgrade_d process related issues
       ioca_checkRoutingTables: Displays routing table for each node
             ioca_checkSBR8000: Checks if SBR is enabled pre-upgrade for OneFS
                                upgrades targeting 8.0.0.0/1.
                ioca_checkSPNs: Displays a list of SPNs, only useful when run
                                with --extra
                 ioca_checkSRS: Checks if the cluster is SRS enabled or not.
                                Displays DialHome information used by RPS;
                                whether ConnectEMC and SupportIQ are currently
                                enabled or disabled.
            ioca_checkServices: Checks common services to make sure they are
                                not disabled
        ioca_checkSmartConnect: Check that the SC Service IPs are all assigned.
            ioca_checkSnapshot: Checks if the Snapshot count is approaching
                                cluster limit of 20,000, whether Autodelete is
                                set to yes, and checks snapshot logs. Checks
                                snapshot logs for EIN/EIO/EDEADLK/Failed to
                                create snapshot
        ioca_checkStoragePools: Checks storage pools for
                                health/capacity/unprovisioned drive issues
              ioca_checkSyncIQ: Gathers source and target SyncIQ information
                                and reports partners of SyncIQ. Checks for an
                                issue where having a large number of SyncIQ
                                report files causes a tar process to delay
                                other upgrade processes potentially leaving the
                                cluster in a temporary DU scenario for an
                                extended period of time.
           ioca_checkTimeDrift: Checks time drift between nodes
            ioca_checkTimeSync: Checks if the cluster is enabled to sync to an
                                external server
            ioca_checkTimeZone: Checks for missing time zone in target OneFS
                                code level.
             ioca_checkUpgrade: Checks for in progress upgrade related issues.
                                Warns if the isi_upgrade_d service is enabled.
                                Fails if not in a committed state. Fails if an
                                upgrade activity is already in progress.Checks
                                the fs_fmt_version, an odd or zero
                                fs_fmt_version is problematic
    ioca_checkUpgradeAgentPort: Checks the port used by the isi_upgrade_agent_d
                                daemon to ensure it is not in use by other
                                processes
         ioca_checkUpgradePath: Checks where multiple jumps are required and
                                provides specifics required.
              ioca_checkUptime: Checks node uptime, warning over 200 days,
                                flags uptime ETAs
                ioca_installed: Determines if IOCA is installed.
          job_schedules_health: Checks the health of job schedules.
             leak_freed_blocks: Check if the sysctl 'efs.lbm.leak_freed_blocks'
                                is set to 0 for all nodes.
               lsass_log_level: Check lsass log-level status
                 lsass_running: Likewise service lsass enabled
                  lwio_running: Likewise service lwio enabled
                 lwreg_running: Likewise service lwreg enabled
                  lwsm_enabled: Service lwsm enabled
                 lwwit_running: Likewise service lwwit enabled
          manual_static_routes: Flags any static route that appears in the
                                routingtable but not in the flexnet config.
            mcp_running_status: Status of MCP Process.
             mediascan_enabled: Determines if MediaScan is enabled.
              mediascan_status: Check if MediaScan has been run in the last 3
                                months.
          ndmp_data_connection: Check NDMP data port connections status cluster
                                wide.
       ndmp_interface_settings: Check if any NDMP data transactions use the
                                1Gbe cluster interfaces.
             ndmp_job_stalling: Check if any running NDMP job is stalling
                                without data bytes moved.
                  ndmp_service: Check if NDMP service is enabled with a valid
                                NDMP user.
            netlogon_log_level: Check netlogon log-level status
              netlogon_running: Likewise service netlogon enabled
    network_external_40gbe_mtu: Determines if any 40G iface has mtu of 1500.
                    nfs_daemon: Verify if NFS daemons (nfs, lsass, lwreg,
                                onefs_nfs) are running. Note: Here the name
                                "daemon" should not be interpreted in the
                                strict Unix sense of the word, but in a broader
                                sense that comprises the different services
                                within the Likewise framework.
              nfs_daemon_start: Verify if NFS daemon was started correctly.
                 nfs_log_level: Check nfs log-level status
                     nfs_mount: Verify that node is working as NFS client
                                (mount external NFS export).
                   nfs_netstat: Verify node is listening on port 2049 and 304.
                       nfs_rpc: Verify if RPC service has been registered for
                                NFSv3 and NFSv4.
                   nfs_service: Verify if NFS services (NFSv3, NFSv4) have been
                                enabled on the cluster.
                 node_capacity: Check the cluster and node pool capacity.
                    ntp_config: Verify NTP configuration, including NTP
                                server's IP/name and chimer node's IP/name.
                   ntp_network: Check network connectivity among chimer node(s)
                                and time server(s).
                  ntp_timeskew: Check max time skew among nodes & NTP server(if
                                exists).
                  ntp_timesync: Check time sync status among node(s) and time
                                servers.
                 onefs_running: Likewise service onefs enabled
                opensm_masters: Determines if backend fabric has proper number
                                of opensm masters.
                    phone_home: Checks that isi_phone_home tool is enabled if
                                RemoteSupport or ESRS are found to be enabled.
             pst_files_present: Verifies if any Outlook Personal Data Files are
                                being frequently used.
                reserve_blocks: Check if the syctl
                                'efs.bam.layout.reserved_blocks' is set to the
                                default values of 32000 for all nodes.
       root_partition_capacity: Check root (/) partition capacity usage.
          smartconnect_enabled: Determines if SmartConnect enabled and running.
                   smb_enabled: Service smb enabled
                 smb_log_level: Check lwio log-level status
                   smb_netstat: Verify Isilon is listening on port 445.
              snapshot_reserve: Check if the snapshot reserve percentage is set
                                to 0
                   srv_running: Likewise service srv enabled
                srvsvc_running: Likewise service srvsvc enabled
              sshd_config_hash: Check MD5 hashes of /etc/ssh/sshd_config across
                                the cluster to make sure all nodes use the same
                                sshd_config.
                svcctl_running: Likewise service svcctl enabled
          synciq_daemon_status: Check if all SyncIQ daemons are running.
            synciq_job_failure: Check if any latest SyncIQ job report shows
                                failed and gather the failure infos.
           synciq_job_stalling: Check if any running synciq jobs is stalling.
         synciq_job_throughput: Check if any SyncIQ job is running with non-
                                throughput.
          synciq_pworker_crash: Check if any pworker crash, related stack info,
                                generates when the latest SyncIQ jobs failed
                                with worker crash errors.
         synciq_service_status: Check if SyncIQ service isi_migrate is enabled.
      synciq_target_connection: Check the SyncIQ connection status when the
                                latest jobs failed with target connection
                                errors.
              syslog_log_level: Check if log-level for all services controlled
                                by syslog is set to Debug.
                tardis_enabled: Service isi_tardis_d enabled
        var_partition_capacity: Check '/var' partition capacity usage.
   varcrash_partition_capacity: Check '/var/crash' partition capacity usage.
                           vhs: Verify if Virtual Hot Spare (VHS) setting
                                conforms to the following rules:   1. VHS Deny
                                Writes is enabled.   2. VHS Hide Spare is
                                enabled.   3. When node pool is less than 90%
                                full, the VHS percentage      is larger than
                                10% of the total space.
                winreg_running: Likewise service winreg enabled


********************************************************************************

RESOLVED ISSUES

Service Pack 1 Resolved Issues

 An issue that could cause checklist evaluations to fail with missing results
 from random nodes on larger clusters has been resolved.


********************************************************************************

CHANGED FILES

 * usr/libexec/isilon/ioca/IOCA
   (MD5 = f0754f790decafad6fc20f5c50fa91ea)
 * usr/libexec/isilon/isi_healthcheck
   (MD5 = 571796533a986ff35294bc259f538314)
 * usr/libexec/isilon/checks/nfs_daemon.pyc
   (MD5 = e5e715d245488a7de0497aff5c1a38b1)
 * usr/libexec/isilon/checks/dimm_health_status.pyc
   (MD5 = 5e60780064d947b0dede655cb742dcd0)
 * usr/libexec/isilon/checks/smartconnect_enabled.pyc
   (MD5 = c1014c9cded9141e679cbb2fbcceb515)
 * usr/libexec/isilon/checks/infiniband_interface_status.pyc
   (MD5 = 0a29fb3363a620c68cb8dd0d4bb6412e)
 * usr/libexec/isilon/checks/flexnet_running.pyc
   (MD5 = 2f9b31784cd1abdd3f9f1d3a98a1dc3d)
 * usr/libexec/isilon/checks/ntp.pyc
   (MD5 = a5b9cad64ba618b420d7aca87772f1d5)
 * usr/libexec/isilon/checks/celog_ana_qp.pyc
   (MD5 = 46ac7ad8d06b4f6da4d96a69ded0680d)
 * usr/libexec/isilon/checks/svcctl_running.pyc
   (MD5 = 1cc86622e7d971425a0a21ce71500951)
 * usr/libexec/isilon/checks/synciq_daemon.pyc
   (MD5 = d40c2351a746c9a3d77b8fb5e88ae96e)
 * usr/libexec/isilon/checks/vhs.pyc
   (MD5 = cb5f166250b85dafd9354f270bf1b082)
 * usr/libexec/isilon/checks/synciq_target_connection.pyc
   (MD5 = 97e99d22a4dd77e190c0e9a81d7c6ff6)
 * usr/libexec/isilon/checks/avscan_scan_settings.pyc
   (MD5 = 0d53067bac0a44df9dabed47cf94d1d6)
 * usr/libexec/isilon/checks/synciq_job_thrput.pyc
   (MD5 = 691cbd88dcc19dcdd6410fc0cc37572f)
 * usr/libexec/isilon/checks/ndmp_data_connection.pyc
   (MD5 = 9d133078473b7804012a9a9c929d51ce)
 * usr/libexec/isilon/checks/celog_rep_pp.pyc
   (MD5 = c3b55e4f1416f87da15f261479ef9eb2)
 * usr/libexec/isilon/checks/sshd_config_hash.pyc
   (MD5 = 59c3fe3882b8fc696754a0f9ed8b0729)
 * usr/libexec/isilon/checks/healthcheck_version.pyc
   (MD5 = 02938b1b734cf6a99698e7e387fc7b63)
 * usr/libexec/isilon/checks/smb_log_level.pyc
   (MD5 = 9253736d27ef11ece4d4339f4a3e5926)
 * usr/libexec/isilon/checks/celog_rep.pyc
   (MD5 = dd1fcc798434a5362637bb60bfc200fa)
 * usr/libexec/isilon/checks/celog_memory.pyc
   (MD5 = 8b169d5f25bd9e8645d4cc60662f887b)
 * usr/libexec/isilon/checks/celog_heartbeat.pyc
   (MD5 = 5f6aaff701b3495ea29b3f499b1c6a85)
 * usr/libexec/isilon/checks/lwreg_running.pyc
   (MD5 = 61637e7d7665c8b543f3630f52a1ae2e)
 * usr/libexec/isilon/checks/lwsm_enabled.pyc
   (MD5 = 6de361a4214088912e00795a4cb1c478)
 * usr/libexec/isilon/checks/celog_cap_ag.pyc
   (MD5 = 847edb3b21fd118fa87a555e43e50745)
 * usr/libexec/isilon/checks/ndmp_service.pyc
   (MD5 = 8dec085fe1994f0c262fc76db38340cd)
 * usr/libexec/isilon/checks/mcp_status.pyc
   (MD5 = b1c779eaef123c68aab15edefb004307)
 * usr/libexec/isilon/checks/lwwit_running.pyc
   (MD5 = bd1f3dacdf16a981b102aeeda9dcf34b)
 * usr/libexec/isilon/checks/leak_freed_blocks.pyc
   (MD5 = a362dec174f5935c0711a589a8944747)
 * usr/libexec/isilon/checks/cluster_capacity.pyc
   (MD5 = 109f3be5ca7d22a2f6d139bb7acacd40)
 * usr/libexec/isilon/checks/srvsvc_running.pyc
   (MD5 = 13cf5d09a15157f2d8faa5c66d1328e7)
 * usr/libexec/isilon/checks/infiniband_socket_count.pyc
   (MD5 = cb99110f6506a371bdb29ff75fe67ffc)
 * usr/libexec/isilon/checks/infiniband_socket_state.pyc
   (MD5 = b8997fbb09d02f9a1b68eebbf16cc0a4)
 * usr/libexec/isilon/checks/mediascan_enabled.pyc
   (MD5 = c518e2f21d08636015e9410aae77f3eb)
 * usr/libexec/isilon/checks/drive_unprovisioned.pyc
   (MD5 = 5ea4396d0454466ddf3aaea6c76848ca)
 * usr/libexec/isilon/checks/celog_cap.pyc
   (MD5 = 84d7cead7f813314c54a7a7b804b69f7)
 * usr/libexec/isilon/checks/celog_ana_sp.pyc
   (MD5 = 9b57a5f6354048ea96cda319d361421d)
 * usr/libexec/isilon/checks/srv_running.pyc
   (MD5 = 25dd64b4ad944a1ceb93454348ce7605)
 * usr/libexec/isilon/checks/onefs_running.pyc
   (MD5 = 3242230ab113cf6755d72f9149cd4854)
 * usr/libexec/isilon/checks/celog_ana.pyc
   (MD5 = de1e18bee30fff0428c47dc0491e354d)
 * usr/libexec/isilon/checks/celog_att_fail.pyc
   (MD5 = 91b54cdfe8a9501b920143f55bd20614)
 * usr/libexec/isilon/checks/lwio_running.pyc
   (MD5 = 1669d0b8ec2c31a880a4f719326842e4)
 * usr/libexec/isilon/checks/nfs_mount.pyc
   (MD5 = 62efeb7b91bccc1288225004348fa846)
 * usr/libexec/isilon/checks/mediascan_status.pyc
   (MD5 = 53c5079d1606a1ae8e2d7591b34a6a9d)
 * usr/libexec/isilon/checks/job_schedules_health.pyc
   (MD5 = c48f24b27360cf386224e095592af347)
 * usr/libexec/isilon/checks/avscan_service.pyc
   (MD5 = 9929da413ad46fc1276b8fa52383571d)
 * usr/libexec/isilon/checks/celog_cap_ex.pyc
   (MD5 = c0b1d080aff28dbaa4d679e5c5ce6dd1)
 * usr/libexec/isilon/checks/var_partition_capacity.pyc
   (MD5 = 9791b2cba1b72cf6fb88971da11fa221)
 * usr/libexec/isilon/checks/boot_drive_wear.pyc
   (MD5 = bed045e7a797d1f12dddb744a5d1d06d)
 * usr/libexec/isilon/checks/auth_enabled.pyc
   (MD5 = ed91a1906365fc2b677d6617d3c95df4)
 * usr/libexec/isilon/checks/nfs_netstat.pyc
   (MD5 = f78370ab9eb9184f9c75c656bde7ff7e)
 * usr/libexec/isilon/checks/check_mirror_status.pyc
   (MD5 = 195f1ef670792c3c63ec1da451dc0e97)
 * usr/libexec/isilon/checks/celog_alt.pyc
   (MD5 = aa607db36f246e96dbfca4da2d8e60d9)
 * usr/libexec/isilon/checks/data_protection.pyc
   (MD5 = 34315da95924dcd120dfcc795cff5b73)
 * usr/libexec/isilon/checks/netlogon_log_level.pyc
   (MD5 = dc999a1c87956bf18ea3b7fd153b72f4)
 * usr/libexec/isilon/checks/synciq_job_failure.pyc
   (MD5 = 5ebf9fb2e371e5beffd98e85829c80a8)
 * usr/libexec/isilon/checks/celog_cap_km.pyc
   (MD5 = eeeed2e2d07f3729df3d6867e762e7ef)
 * usr/libexec/isilon/checks/avscan_icap_status.pyc
   (MD5 = a0899166f00fe32a4fa9735b7dcbb527)
 * usr/libexec/isilon/checks/winreg_running.pyc
   (MD5 = aa74fa507575d541e772b1a79299247a)
 * usr/libexec/isilon/checks/smb_netstat.pyc
   (MD5 = 28af2df78c55b035dc14cce718306a7a)
 * usr/libexec/isilon/checks/tardis_enabled.pyc
   (MD5 = 93199b29782e4f2b6679a833c82339cf)
 * usr/libexec/isilon/checks/netlogon_running.pyc
   (MD5 = 50c2152f05dd0ff77d49a1642361f809)
 * usr/libexec/isilon/checks/nfs_service.pyc
   (MD5 = ea053f97d17c77928ade552c68cb5ad3)
 * usr/libexec/isilon/checks/infiniband_mtu.pyc
   (MD5 = 2d1a376a698de1807fdd57e3ac148567)
 * usr/libexec/isilon/checks/manual_static_routes.pyc
   (MD5 = 2c9a24c6464d422829e53ae1fdea8731)
 * usr/libexec/isilon/checks/synciq_job_stall.pyc
   (MD5 = 3f706b57646600ca4581d97f50a5f189)
 * usr/libexec/isilon/checks/ndmp_job_stall.pyc
   (MD5 = 8a9a231c094a3b11c490d3ed874c645e)
 * usr/libexec/isilon/checks/opensm_masters.pyc
   (MD5 = 7cbe84e42388aa9e87602412ead7bf94)
 * usr/libexec/isilon/checks/lsass_running.pyc
   (MD5 = ca616e3044fe20669cb01b9d57f2932b)
 * usr/libexec/isilon/checks/ioca.pyc
   (MD5 = 52dd7860fa91515aedcb1475fca609a4)
 * usr/libexec/isilon/checks/celog_enabled.pyc
   (MD5 = 2931048bc793f44d5225a6e67da0ae7c)
 * usr/libexec/isilon/checks/nfs_log_level.pyc
   (MD5 = c992a814797966ff901bf8b1ec30af6e)
 * usr/libexec/isilon/checks/varcrash_partition_capacity.pyc
   (MD5 = 516c1d7dbfdead96d1528fafbb17e655)
 * usr/libexec/isilon/checks/nfs_daemon_start.pyc
   (MD5 = 7b1d1c73fb5bb57a1f160538213924ea)
 * usr/libexec/isilon/checks/celog_db_lock_log.pyc
   (MD5 = dda69c0f31eddcc8e545311d35fa50ea)
 * usr/libexec/isilon/checks/ilog_log_level.pyc
   (MD5 = b01e61809e3657feada6457334922c3a)
 * usr/libexec/isilon/checks/synciq_pworker_crash.pyc
   (MD5 = 1195f926c4e784a060eb32b75caf9366)
 * usr/libexec/isilon/checks/celog_process_restart.pyc
   (MD5 = bdd44ac52f20521149110f661759b94a)
 * usr/libexec/isilon/checks/syslog_log_level.pyc
   (MD5 = 2fa7fe9091e077aea5773ea559811778)
 * usr/libexec/isilon/checks/dcerpc_running.pyc
   (MD5 = 440d44444006c295866e01f35cd5a6db)
 * usr/libexec/isilon/checks/nfs_rpc.pyc
   (MD5 = 21bd8f3ba6494cf744e6cbbb56b5d780)
 * usr/libexec/isilon/checks/smb_enabled.pyc
   (MD5 = 68d9f822affabe4ec8b157fa700e3d23)
 * usr/libexec/isilon/checks/root_partition_capacity.pyc
   (MD5 = e7d99335c1a74d4cfad1cec63979e0af)
 * usr/libexec/isilon/checks/celog_alt_ap.pyc
   (MD5 = 4da1c2a2b3ed668eb825b0c87dbce736)
 * usr/libexec/isilon/checks/lsass_log_level.pyc
   (MD5 = c23714e976f929dc3a1dbc9b91f4bc05)
 * usr/libexec/isilon/checks/phone_home.pyc
   (MD5 = 1f220356f113338102959fc226cdade3)
 * usr/libexec/isilon/checks/synciq_service.pyc
   (MD5 = b1c15eff8c4f110ebf98c1f75951e200)
 * usr/libexec/isilon/checks/ndmp_interface_settings.pyc
   (MD5 = d07c9894b46378c2f660de6056a7a569)
 * usr/libexec/isilon/checks/snapshot_reserve.pyc
   (MD5 = b03a3f87e0749a69416818ddaa6f0605)
 * usr/libexec/isilon/checks/reserve_blocks.pyc
   (MD5 = a423e67bb6afc0ca590347d4c8e1d8ce)
 * usr/libexec/isilon/checks/pst_files_present.pyc
   (MD5 = a1cc99d929479dc67b95c365ee5526b8)
 * usr/libexec/isilon/checks/celog_service_restart.pyc
   (MD5 = 24afb27d0e5b2055509491559632a559)
 * usr/libexec/isilon/checks/infiniband_interface_oactive.pyc
   (MD5 = 60bf58a930fce0094e53703e7b238b10)
 * usr/libexec/isilon/checks/duplicate_gateway_priorities.pyc
   (MD5 = aeca4b9bf5bb88bd3ce03b0f5da0a0e5)
 * usr/libexec/isilon/checks/network_external_40gbe_mtu.pyc
   (MD5 = 967cd00089ee3a0984e9da25da20912e)
 * usr/libexec/isilon/checks/battery_test_status.pyc
   (MD5 = fd3c78bc98bb449207dfc261d7655770)
 * usr/libexec/isilon/checks/gateway_connectivity.pyc
   (MD5 = 71ac07d29f95248692e8302fc5d17efe)
 * usr/libexec/isilon/checks/custom_cronjobs.pyc
   (MD5 = 9ae5f8bc4b29d179d0d90eea3dd9bf34)
 * usr/libexec/isilon/checks/infiniband_data_rate.pyc
   (MD5 = 956a7255c8ae62b20aad5e9d50a345b4)
 * usr/libexec/isilon/checklists/nfs
   (MD5 = 04eea39c1c9cb2a3adefb3ff99ab133f)
 * usr/libexec/isilon/checklists/cluster_capacity
   (MD5 = dc0f8e7c65a2716b4bed3c1e27608042)
 * usr/libexec/isilon/checklists/infiniband
   (MD5 = 836dac6ba556e1cde8e4430a02759a19)
 * usr/libexec/isilon/checklists/smb
   (MD5 = 91d8f0f18a18e7167bf626934a1f4277)
 * usr/libexec/isilon/checklists/pre_upgrade
   (MD5 = b0cfad435d63502f16ba98bb2a53367e)
 * usr/libexec/isilon/checklists/ioca
   (MD5 = 92e14fbb73f4510d977ef678006d2810)
 * usr/libexec/isilon/checklists/ndmp
   (MD5 = d328f61ce519093a108ad8a5a95ac7b1)
 * usr/libexec/isilon/checklists/avscan
   (MD5 = 3e5bad582892700334fc421eac42b2af)
 * usr/libexec/isilon/checklists/smartconnect
   (MD5 = bb8f7973070b385ce2ff96414e89f453)
 * usr/libexec/isilon/checklists/all
   (MD5 = 2ebad13925cf209331d5c64636129720)
 * usr/libexec/isilon/checklists/synciq
   (MD5 = a9575a2a7c7576152e8bba74c6f60b79)
 * usr/libexec/isilon/checklists/log_level
   (MD5 = 693383f4029307b179355bfd5f5fbcef)
 * usr/libexec/isilon/checklists/ntp
   (MD5 = 7c56b6183c9202e5d3ce164d0c4f7156)
 * usr/libexec/isilon/checklists/post_upgrade
   (MD5 = effa269800dd1dfb41ee7f0043a4b52d)
 * usr/libexec/isilon/checklists/job_engine
   (MD5 = 586f331b4eff610879300c85ba2782ba)
 * usr/local/lib/python2.7/site-packages/isi/healthcheck/checklist.pyc
   (MD5 = 535d915e583168676eafc4178982fbb4)
 * usr/local/lib/python2.7/site-packages/isi/healthcheck/constants.pyc
   (MD5 = 605b71696e5e38357610f43b16af81e7)
 * usr/local/lib/python2.7/site-packages/isi/healthcheck/check.pyc
   (MD5 = 79476a965ec9ad746180ad6202d086eb)
 * usr/local/lib/python2.7/site-packages/isi/healthcheck/__init__.pyc
   (MD5 = 479ebf80f156f26f18e80c93aa5c9f10)
 * usr/local/lib/python2.7/site-packages/isi/healthcheck/item.pyc
   (MD5 = 4385624bbd806c64922a92f46551bb24)
 * usr/local/lib/python2.7/site-packages/isi/healthcheck/evaluation.pyc
   (MD5 = 4f5d94760b7c4b0f4704cba893f966b6)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/check_utils.pyc
   (MD5 = 6d4b3c88a56171e27cc4cd8f59eeeb9f)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/logger.pyc
   (MD5 = f9af9201b3c9755fd2afaa96e83412f8)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/simple.pyc
   (MD5 = 08e18e0b9f262a0c4099b40214b2c470)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/__init__.pyc
   (MD5 = dd4e224d03eddcf41d77fb3dd3908b05)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/infiniband_util.pyc
   (MD5 = 137d77fe8373ed2ee8b43952106c5f59)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/failpoint.pyc
   (MD5 = 1190d8e295f1e9b755858677841aa4f6)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/check_script.pyc
   (MD5 = f6a8749ea1db691da0cd7a67958852be)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/ntp_utils.pyc
   (MD5 = 5ed46f696821b4f591883c906278cd5c)
 * usr/local/lib/python2.7/site-packages/isi/checksupport/mocks.pyc
   (MD5 = 99bb9a95bce16dbb300902e53529b24c)
 * etc/mcp/sys/services/isi_healthcheck
   (MD5 = 0472dcf8cb0521b0fa1a4494686b09f0)
 * usr/bin/isi_healthcheck
   (MD5 = 0cb7e89cff0a5e2071816e21a8190169)
 * usr/local/share/CLI/controllers/isi/healthcheck/checklists/__init__.py
   (MD5 = 3a4be042b213223e101ef4de6d9286e2)
 * usr/local/share/CLI/controllers/isi/healthcheck/checklists/list.py
   (MD5 = 59bb07b702bf38b7df97f76363b5df49)
 * usr/local/share/CLI/controllers/isi/healthcheck/checklists/util.py
   (MD5 = be2d481003f2244703dd4cf82a54e501)
 * usr/local/share/CLI/controllers/isi/healthcheck/checklists/view.py
   (MD5 = 4e3ba59d1bb1dfca6b0cec4ea3372528)
 * usr/local/share/CLI/controllers/isi/healthcheck/items/__init__.py
   (MD5 = 45849c95a5589533dd83283b55a446fc)
 * usr/local/share/CLI/controllers/isi/healthcheck/items/list.py
   (MD5 = b9a79e88fa38ad9de2fed76776529e41)
 * usr/local/share/CLI/controllers/isi/healthcheck/items/util.py
   (MD5 = c0fa61e36b635b5f1cdea0ca0fb4f2ed)
 * usr/local/share/CLI/controllers/isi/healthcheck/items/view.py
   (MD5 = 46ac9827e1bf06c126850f89a471ff2e)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/pause.py
   (MD5 = 09829411ba38fc6609a6188abb7230cb)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/__init__.py
   (MD5 = 38ea05a793d41acf4ed9a674aff55c2f)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/list.py
   (MD5 = 877bb704d6207d3267a4a408d81de4bf)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/util.py
   (MD5 = 3c343337b467b0be7ab542a6b966b99e)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/view.py
   (MD5 = 96eeb0d8dd6e28022e9a76894ba73add)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/run.py
   (MD5 = 50b5ee9348244195034ea17d997917fa)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/resume.py
   (MD5 = 61e277a07806859b474accf273b1f03e)
 * usr/local/share/CLI/controllers/isi/healthcheck/evaluations/cancel.py
   (MD5 = a734cac909e5f8e53c1b6537fa029bcc)
 * usr/local/share/CLI/controllers/isi/healthcheck/__init__.py
   (MD5 = 5e22993cb3ba0b8521dceaed5ee6b689)
 * usr/local/share/CLI/controllers/isi/healthcheck/parameters/delete.py
   (MD5 = a164c34c028fdc9a67fb2251caf0f93d)
 * usr/local/share/CLI/controllers/isi/healthcheck/parameters/__init__.py
   (MD5 = 4617b38807ffe13a08d9604bde76fefe)
 * usr/local/share/CLI/controllers/isi/healthcheck/parameters/list.py
   (MD5 = 755af6d5651e78be144f6b53de0d9fdc)
 * usr/local/share/CLI/controllers/isi/healthcheck/parameters/util.py
   (MD5 = 7a8eb3079b28a0412ff0e6325f41a508)
 * usr/local/share/CLI/controllers/isi/healthcheck/parameters/view.py
   (MD5 = 78df0e5c8819e36331428ff2cea0dab7)
 * usr/local/share/CLI/controllers/isi/healthcheck/parameters/set.py
   (MD5 = 0a0378d017c7ab37d3a5463285dc7983)
 * usr/share/papi/doc/3/healthcheck/checklists/overview.json
   (MD5 = baf52d7c6190bece2b4bd69b39241060)
 * usr/share/papi/doc/3/healthcheck/checklists/<ID>/overview.json
   (MD5 = 267ad7280428e0d880c43d5d359f9a97)
 * usr/share/papi/doc/3/healthcheck/checklists/<ID>/overview.txt
   (MD5 = 1c04b849786d6ff64c2316482ed27d7b)
 * usr/share/papi/doc/3/healthcheck/checklists/<ID>/GET_output_schema.json
   (MD5 = b38024390aff287e2faac24f208b088b)
 * usr/share/papi/doc/3/healthcheck/checklists/overview.txt
   (MD5 = 406038e768c92e33fb089d8a1cdc5694)
 * usr/share/papi/doc/3/healthcheck/checklists/GET_output_schema.json
   (MD5 = 92ca0f505dad6539c68e9262a622dea3)
 * usr/share/papi/doc/3/healthcheck/items/overview.json
   (MD5 = 0ac6bb6f65d5b6394d6abef74f01a73f)
 * usr/share/papi/doc/3/healthcheck/items/<ID>/overview.json
   (MD5 = 3b312a4a9f51dd952f1724c44f60dfd1)
 * usr/share/papi/doc/3/healthcheck/items/<ID>/overview.txt
   (MD5 = 0526fe1b69349d5f537aa83c5aa241c7)
 * usr/share/papi/doc/3/healthcheck/items/<ID>/GET_output_schema.json
   (MD5 = abb48249b6a195409660eebaa38e0878)
 * usr/share/papi/doc/3/healthcheck/items/overview.txt
   (MD5 = f6dcd15a7aca20d6b5b315b805aca430)
 * usr/share/papi/doc/3/healthcheck/items/GET_output_schema.json
   (MD5 = d60f22333f62d498e7ccf5866c4651b3)
 * usr/share/papi/doc/3/healthcheck/evaluations/overview.json
   (MD5 = daff0ccf2309d4fb1b56dd38ef1dc925)
 * usr/share/papi/doc/3/healthcheck/evaluations/<ID>/overview.json
   (MD5 = 7b07c7bc9361b73ae9837f493885e44e)
 * usr/share/papi/doc/3/healthcheck/evaluations/<ID>/PUT_input_schema.json
   (MD5 = 0096e675460a983bcecb1691a4ca8d8a)
 * usr/share/papi/doc/3/healthcheck/evaluations/<ID>/overview.txt
   (MD5 = 8a9df1de2dbcdb46cc2a34da60781c4a)
 * usr/share/papi/doc/3/healthcheck/evaluations/<ID>/GET_output_schema.json
   (MD5 = c1040ff5f04e28026b84c4d75a6f1d4d)
 * usr/share/papi/doc/3/healthcheck/evaluations/overview.txt
   (MD5 = d8478efcc3c76f5a21dae879caee2910)
 * usr/share/papi/doc/3/healthcheck/evaluations/GET_output_schema.json
   (MD5 = b1f321f2f92948b11d1b510ccd2e1799)
 * usr/share/papi/doc/3/healthcheck/evaluations/POST_output_schema.json
   (MD5 = a3213dc69e3415caa23a063bc6dea8e9)
 * usr/share/papi/doc/3/healthcheck/evaluations/POST_input_schema.json
   (MD5 = f03e86726db1d55e0b00ffa50d969335)
 * usr/share/papi/doc/3/healthcheck/parameters/overview.json
   (MD5 = 3c88746caf5266332d159b71cd2fe6df)
 * usr/share/papi/doc/3/healthcheck/parameters/<ID>/overview.json
   (MD5 = 5846d119fb08c76f6f55fc7febf74eb0)
 * usr/share/papi/doc/3/healthcheck/parameters/<ID>/PUT_input_schema.json
   (MD5 = a27b56792aad6415909af75b451d7c1d)
 * usr/share/papi/doc/3/healthcheck/parameters/<ID>/overview.txt
   (MD5 = a595e76429e7c001f9677d6ad96ac29d)
 * usr/share/papi/doc/3/healthcheck/parameters/<ID>/GET_output_schema.json
   (MD5 = fc61c09f58d88a85cd239a75737c6c03)
 * usr/share/papi/doc/3/healthcheck/parameters/overview.txt
   (MD5 = c10cb49852116f00a85bba9bf9e66c74)
 * usr/share/papi/doc/3/healthcheck/parameters/GET_output_schema.json
   (MD5 = f4c0486d26839baf2ac4ba9e9838a165)
 * usr/share/papi/doc/3/healthcheck/parameters/POST_output_schema.json
   (MD5 = a3213dc69e3415caa23a063bc6dea8e9)
 * usr/share/papi/doc/3/healthcheck/parameters/POST_input_schema.json
   (MD5 = fc8bc8f1489b7b5a9ed41b6e0b79f440)
 * usr/lib/libisi_papi_healthcheck.so.1
   (MD5 = 95380f1f653bd0b7d77021e5f723829f)


********************************************************************************

INSTALLATION/REMOVAL IMPACTS

During installation or removal of this patch, the platform API service 
(isi_papi_d) will be restarted along with the healthcheck service.

Any healthcheck evaluation in progress during patch installation might be
disrupted and will need to be rerun once patch installation is complete.

********************************************************************************

IMPORTANT!
VERIFY CLUSTER-FREE SPACE
If there is insufficient free space and you attempt to install or remove a
patch, the process might not complete successfully. An incomplete patch
installation or patch removal can leave the cluster in an inaccessible state.

Before installing or removing a patch, verify that your cluster has enough
free space to perform the procedure. For more information about maintaining
sufficient free space on an Isilon cluster, see the Best Practices Guide for
Maintaining Enough Free Space on Isilon Clusters and Pools:
    https://support.emc.com/docu48119.

********************************************************************************


This patch will conflict with the following patches:
['HealthCheck_8.1.2_v1.0.pkg', 'HealthCheck_8.1.2_v2.0.pkg']

This patch deprecates the following patches:
['HealthCheck_8.1.2_v1.0.pkg', 'HealthCheck_8.1.2_v2.0.pkg']
 
If any conflicting or deprecated patches are installed on the cluster,
you must remove them before installing this patch.

********************************************************************************

 
REMOVING CONFLICTING AND DEPRECATED PATCHES
 
If any conflicting or deprecated patches are installed on the cluster,
perform the following procedure to remove them before installing this patch.
 
IMPORTANT!
Read the INSTALLATION/REMOVAL IMPACTS in the README for the
conflicting and deprecated patches before performing this procedure.
 
1. Verify that your cluster has enough free space to remove this patch.
 
2. Open an SSH connection on any node in the cluster and log in using the
   root account.
 
   NOTE: If the procedure is being done on a compliance mode cluster,
   log in using the compadmin account.
 
3. To remove this patch, run the following command:
        
          isi upgrade patches uninstall {patch_id}
 
   Confirm that you want to continue with this operation:
        
          Are you sure?  (yes/[no]): yes
 
4. To verify that this patch was removed, run the following command:
     
       isi upgrade patches list
 
5. Confirm that {patch_id} does not appear in the list of installed packages.
 
********************************************************************************


INSTALLING THIS PATCH

IMPORTANT!
Read INSTALLATION/REMOVAL IMPACTS before performing this procedure.

1. Open an SSH connection on any node in the cluster and log on using the 
   "root" account.

   NOTE: If the patch is being installed on a compliance mode cluster, log in
   using the compadmin account.

2. Copy the HealthCheck_8.1.2_2019-01.pkg file to the cluster.

3. To install this patch, run the following command:

   isi upgrade patch install HealthCheck_8.1.2_2019-01.pkg

5. To verify that this patch is installed, run the following command:

   isi upgrade patch list

6. Verify that HealthCheck_8.1.2_2019-01 appears in the list of
   installed packages and the status is set to Installed.

********************************************************************************

REMOVING THIS PATCH

If you need to remove this patch, complete the steps below.

IMPORTANT!
Read INSTALLATION/REMOVAL IMPACTS before performing this procedure.

1. To delete this patch, run the following command:

   isi upgrade patch uninstall HealthCheck_8.1.2_2019-01

2. To verify that this patch was removed, run the following command:

   isi upgrade patch list

3. Confirm that HealthCheck_8.1.2_2019-01 does not appear in the list of
   installed packages.

********************************************************************************

TROUBLESHOOTING THIS PATCH

If you received the following output after running the 'isi upgrade patches
list' command during installation or removal of this patch, follow the
additional instructions below.

# isi upgrade patches list
Patch Name   Description                           Status
HealthCheck_8.1.2_2019-01 ...                            Failed
Total: 1

1. Run the following command to create a statuscache file on the cluster:

   isi_upgrade_status > /ifs/.ifsvar/upgrade/statuscache

2. Run the following command to attempt the patch installation or removal
   procedure again:

   isi upgrade retry-last-action --nodes=all

3. Wait five minutes for the commands to take effect.

4. Run the following command to verify that this patch is installed or removed:

   isi upgrade patches list

5. Confirm that HealthCheck_8.1.2_2019-01 appears (or does not appear, if the patch is
   being removed) in the list of installed packages and the status is set to
   Installed.

6. Should the patch status fail again, please contact Isilon Technical Support
   for further troubleshooting steps.

********************************************************************************

NDU UPGRADE SYSTEM CONFLICT

During a cluster upgrade, if nodes are transitioning to a higher version of
OneFS, or if the cluster is in mixed mode (with some nodes at a higher version
of OneFS and others at a lower version), it was possible for healthcheck
evaluation runs to report inaccurate results and for the evaluation to
fail to complete.

Workaround:
Ensure all nodes are on the same version of OneFS prior to starting
or resuming healthcheck evaluations.

To check the progress of an upgrade, run the following command:

    isi upgrade view

To stop a healthcheck evaluation, run the following command:

    isi healthcheck evaluations cancel --id=<evaluation id>

********************************************************************************
