ACPI: PCI Interrupt Link [LNKE] (IRQs *5 7 10 11) ACPI: PCI Interrupt Link [LNKF] (IRQs 5 7 *10 11) ACPI: PCI Interrupt Link [LNKG] (IRQs 5 7 *10 11) ACPI: PCI Interrupt Link [LNKH] (IRQs 5 *7 10 11) Linux Plug and Play Support v0.97 (c) Adam Belay pnp: PnP ACPI init pnp: PnP ACPI: found 11 devices usbcore: registered new driver usbfs usbcore: registered new driver hub PCI: Using ACPI for IRQ routing PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report NetLabel: Initializing NetLabel: domain hash size = 128 NetLabel: protocols = UNLABELED CIPSOv4 NetLabel: unlabeled traffic allowed by default hpet0: at MMIO 0xfed00000 (virtual 0xffffffffff5fe000), IRQs 2, 8, 0, 0 hpet0: 4 64-bit timers, 14318180 Hz DMAR:Host address width 39 DMAR:DRHD base: 0x000000e7ffe000 flags: 0x1 IOMMU e7ffe000: ver 1:0 cap c90780106f0462 ecap f0207e DMAR:RMRR base: 0x000000df7fc000 end: 0x000000df7fdfff DMAR:RMRR base: 0x000000df7f5000 end: 0x000000df7fafff DMAR:RMRR base: 0x000000df63e000 end: 0x000000df63ffff DMAR:ATSR flags: 0x0 PCI-GART: No AMD northbridge found. pnp: 00:01: ioport range 0x408-0x40f has been reserved pnp: 00:01: ioport range 0x4d0-0x4d1 has been reserved pnp: 00:01: ioport range 0x700-0x71f has been reserved pnp: 00:01: iomem range 0xe0000000-0xe3ffffff could not be reserved pnp: 00:01: iomem range 0xfe000000-0xfebfffff has been reserved pnp: 00:01: iomem range 0xe7ffe000-0xe7ffffff has been reserved PCI: Bridge: 0000:00:01.0 IO window: 4000-4fff MEM window: fb300000-fb7fffff PREFETCH window 0x00000000e6000000-0x00000000e60fffff PCI: Bridge: 0000:00:02.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:08:02.0 IO window: 6000-6fff MEM window: fbc00000-fbdfffff PREFETCH window: disabled. PCI: Bridge: 0000:08:04.0 IO window: 7000-7fff MEM window: fbe00000-fbffffff PREFETCH window: disabled. PCI: Bridge: 0000:07:00.0 IO window: 6000-7fff MEM window: fbc00000-fbffffff PREFETCH window: disabled. PCI: Bridge: 0000:00:03.0 IO window: 6000-7fff MEM window: fbc00000-fbffffff PREFETCH window: disabled. PCI: Bridge: 0000:00:04.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:05.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:06.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:07.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:08.0 IO window: disabled. MEM window: f6000000-f9ffffff PREFETCH window 0x00000000e6100000-0x00000000e61fffff PCI: Bridge: 0000:00:09.0 IO window: 5000-5fff MEM window: fbb00000-fbbfffff PREFETCH window 0x00000000e6200000-0x00000000e62fffff PCI: Bridge: 0000:00:0a.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:1e.0 IO window: 2000-3fff MEM window: f5e00000-f5ffffff PREFETCH window 0x00000000e8000000-0x00000000efffffff PCI: Setting latency timer of device 0000:00:01.0 to 64 PCI: Setting latency timer of device 0000:00:02.0 to 64 PCI: Setting latency timer of device 0000:00:03.0 to 64 PCI: Setting latency timer of device 0000:07:00.0 to 64 PCI: Setting latency timer of device 0000:08:02.0 to 64 PCI: Setting latency timer of device 0000:08:04.0 to 64 PCI: Setting latency timer of device 0000:00:04.0 to 64 PCI: Setting latency timer of device 0000:00:05.0 to 64 PCI: Setting latency timer of device 0000:00:06.0 to 64 PCI: Setting latency timer of device 0000:00:07.0 to 64 PCI: Setting latency timer of device 0000:00:08.0 to 64 PCI: Setting latency timer of device 0000:00:09.0 to 64 PCI: Setting latency timer of device 0000:00:0a.0 to 64 PCI: Setting latency timer of device 0000:00:1e.0 to 64 NET: Registered protocol family 2 IP route cache hash table entries: 524288 (order: 10, 4194304 bytes) TCP established hash table entries: 262144 (order: 10, 4194304 bytes) TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) TCP: Hash tables configured (established 262144 bind 65536) TCP reno registered audit: initializing netlink socket (disabled) type=2000 audit(1304047355.470:1): initialized Total HugeTLB memory allocated, 0 VFS: Disk quotas dquot_6.5.1 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) SELinux: Registering netfilter hooks Initializing Cryptographic API alg: No test for crc32c (crc32c-generic) ksign: Installing public key data Loading keyring - Added public key 5374A126489F531 - User ID: Oracle USA, Inc. (Kernel Module GPG key) io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered io scheduler cfq registered (default) Boot video device is 0000:01:03.0 PCI: Setting latency timer of device 0000:00:01.0 to 64 PCI: Setting latency timer of device 0000:00:02.0 to 64 PCI: Setting latency timer of device 0000:00:03.0 to 64 PCI: Setting latency timer of device 0000:00:04.0 to 64 PCI: Setting latency timer of device 0000:00:05.0 to 64 PCI: Setting latency timer of device 0000:00:06.0 to 64 PCI: Setting latency timer of device 0000:00:07.0 to 64 PCI: Setting latency timer of device 0000:00:08.0 to 64 PCI: Setting latency timer of device 0000:00:09.0 to 64 PCI: Setting latency timer of device 0000:00:0a.0 to 64 PCI: Setting latency timer of device 0000:07:00.0 to 64 PCI: Setting latency timer of device 0000:08:02.0 to 64 PCI: Setting latency timer of device 0000:08:04.0 to 64 pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Monitor-Mwait will be used to enter C-1 state Monitor-Mwait will be used to enter C-3 state Monitor-Mwait will be used to enter C-3 state ACPI: CPU0 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU8 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU4 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU12 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU2 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU10 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU6 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU14 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU1 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU9 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU5 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU13 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU3 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU11 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU7 (power states: C1[C1] C2[C3] C3[C3]) ACPI: CPU15 (power states: C1[C1] C2[C3] C3[C3]) ACPI: Thermal Zone [THM0] (8 C) Real Time Clock Driver v1.12ac hpet_resources: 0xfed00000 is busy Non-volatile memory driver v1.2 Linux agpgart interface v0.101 (c) Dave Jones Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A 00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A brd: module loaded Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx Probing IDE interface ide0... Probing IDE interface ide1... ide-floppy driver 0.99.newide usbcore: registered new driver hiddev usbcore: registered new driver usbhid drivers/usb/input/hid-core.c: v2.6:USB HID core driver PNP: PS/2 Controller [PNP0303:KBD,PNP0f0e:PS2M] at 0x60,0x64 irq 1,12 serio: i8042 KBD port at 0x60,0x64 irq 1 serio: i8042 AUX port at 0x60,0x64 irq 12 mice: PS/2 mouse device common for all mice md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27 md: bitmap version 4.39 TCP bic registered Initializing IPsec netlink socket NET: Registered protocol family 1 NET: Registered protocol family 17 ACPI: (supports S0 S4 S5) Initalizing network drop monitor service Freeing unused kernel memory: 224k freed Write protecting the kernel read-only data: 520k GSI 16 sharing vector 0x52 and IRQ 16 ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 20 (level, low) -> IRQ 82 PCI: Setting latency timer of device 0000:00:1d.7 to 64 ehci_hcd 0000:00:1d.7: EHCI Host Controller ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1 ehci_hcd 0000:00:1d.7: debug port 1 PCI: cache line size of 32 is not supported by device 0000:00:1d.7 ehci_hcd 0000:00:1d.7: irq 82, io mem 0xf5df0000 ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 8 ports detected ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI) USB Universal Host Controller Interface driver v3.0 ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 20 (level, low) -> IRQ 82 PCI: Setting latency timer of device 0000:00:1d.0 to 64 uhci_hcd 0000:00:1d.0: UHCI Host Controller uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 uhci_hcd 0000:00:1d.0: irq 82, io base 0x00001000 usb usb2: configuration #1 chosen from 1 choice hub 2-0:1.0: USB hub found hub 2-0:1.0: 2 ports detected GSI 17 sharing vector 0x5A and IRQ 17 ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 23 (level, low) -> IRQ 90 PCI: Setting latency timer of device 0000:00:1d.1 to 64 uhci_hcd 0000:00:1d.1: UHCI Host Controller uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 uhci_hcd 0000:00:1d.1: irq 90, io base 0x00001020 usb usb3: configuration #1 chosen from 1 choice hub 3-0:1.0: USB hub found hub 3-0:1.0: 2 ports detected GSI 18 sharing vector 0x62 and IRQ 18 ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 22 (level, low) -> IRQ 98 PCI: Setting latency timer of device 0000:00:1d.2 to 64 uhci_hcd 0000:00:1d.2: UHCI Host Controller uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 uhci_hcd 0000:00:1d.2: irq 98, io base 0x00001040 usb usb4: configuration #1 chosen from 1 choice hub 4-0:1.0: USB hub found hub 4-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.3[D] -> GSI 23 (level, low) -> IRQ 90 PCI: Setting latency timer of device 0000:00:1d.3 to 64 uhci_hcd 0000:00:1d.3: UHCI Host Controller uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5 uhci_hcd 0000:00:1d.3: irq 90, io base 0x00001060 usb usb5: configuration #1 chosen from 1 choice hub 5-0:1.0: USB hub found hub 5-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:01:04.4[B] -> GSI 22 (level, low) -> IRQ 98 uhci_hcd 0000:01:04.4: UHCI Host Controller uhci_hcd 0000:01:04.4: new USB bus registered, assigned bus number 6 uhci_hcd 0000:01:04.4: port count misdetected? forcing to 2 ports uhci_hcd 0000:01:04.4: irq 98, io base 0x00003800 usb usb6: configuration #1 chosen from 1 choice hub 6-0:1.0: USB hub found hub 6-0:1.0: 2 ports detected SCSI subsystem initialized HP CISS Driver (v 3.6.22-RH1) GSI 19 sharing vector 0x6A and IRQ 19 ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 28 (level, low) -> IRQ 106 cciss0: <0x323a> at PCI 0000:03:00.0 IRQ 130 using DAC cciss/c0d0: p1 p2 cciss/c0d1: p1 QLogic Fibre Channel HBA Driver GSI 20 sharing vector 0x92 and IRQ 20 ACPI: PCI Interrupt 0000:04:00.0[A] -> GSI 32 (level, low) -> IRQ 146 qla2xxx 0000:04:00.0: Found an ISP2432, irq 146, iobase 0xffffc20010094000 qla2xxx 0000:04:00.0: Configuring PCI space... PCI: Setting latency timer of device 0000:04:00.0 to 64 qla2xxx 0000:04:00.0: Configure NVRAM parameters... qla2xxx 0000:04:00.0: Verifying loaded RISC code... usb 6-1: new full speed USB device using uhci_hcd and address 2 usb 6-1: configuration #1 chosen from 1 choice input: HP Virtual Keyboard as /class/input/input0 input: USB HID v1.01 Keyboard [HP Virtual Keyboard] on usb-0000:01:04.4-1 input: HP Virtual Keyboard as /class/input/input1 input: USB HID v1.01 Mouse [HP Virtual Keyboard] on usb-0000:01:04.4-1 qla2xxx 0000:04:00.0: Allocated (64 KB) for EFT... qla2xxx 0000:04:00.0: Allocated (1413 KB) for firmware dump... qla2xxx 0000:04:00.0: Unable to read FCP priority data. scsi0 : qla2xxx qla2xxx 0000:04:00.0: QLogic Fibre Channel HBA Driver: 8.03.01.05.05.06-k QLogic HPAE312A - PCI-Express Dual Port 4Gb Fibre Channel HBA ISP2432: PCIe (2.5Gb/s x4) @ 0000:04:00.0 hdma+, host#=0, fw=5.03.02 (496) GSI 21 sharing vector 0x9A and IRQ 21 ACPI: PCI Interrupt 0000:04:00.1[B] -> GSI 42 (level, low) -> IRQ 154 qla2xxx 0000:04:00.1: Found an ISP2432, irq 154, iobase 0xffffc200101fa000 qla2xxx 0000:04:00.1: Configuring PCI space... PCI: Setting latency timer of device 0000:04:00.1 to 64 qla2xxx 0000:04:00.1: Configure NVRAM parameters... qla2xxx 0000:04:00.1: Verifying loaded RISC code... qla2xxx 0000:04:00.0: LIP reset occured (f700). qla2xxx 0000:04:00.0: LIP occured (f700). qla2xxx 0000:04:00.0: LIP reset occured (f7f7). qla2xxx 0000:04:00.1: Allocated (64 KB) for EFT... qla2xxx 0000:04:00.1: Allocated (1413 KB) for firmware dump... qla2xxx 0000:04:00.0: LOOP UP detected (4 Gbps). qla2xxx 0000:04:00.1: Unable to read FCP priority data. scsi1 : qla2xxx qla2xxx 0000:04:00.1: QLogic Fibre Channel HBA Driver: 8.03.01.05.05.06-k QLogic HPAE312A - PCI-Express Dual Port 4Gb Fibre Channel HBA ISP2432: PCIe (2.5Gb/s x4) @ 0000:04:00.1 hdma+, host#=1, fw=5.03.02 (496) device-mapper: uevent: version 1.0.3 device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com device-mapper: dm-raid45: initialized v0.2594l qla2xxx 0000:04:00.1: LIP reset occured (f700). qla2xxx 0000:04:00.1: LIP occured (f700). qla2xxx 0000:04:00.1: LIP reset occured (f7f7). qla2xxx 0000:04:00.1: LOOP UP detected (4 Gbps). Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sda: 4194304 512-byte hdwr sectors (2147 MB) sda: Write Protect is off sda: Mode Sense: 7f 00 10 08 SCSI device sda: drive cache: write back w/ FUA SCSI device sda: 4194304 512-byte hdwr sectors (2147 MB) sda: Write Protect is off sda: Mode Sense: 7f 00 10 08 SCSI device sda: drive cache: write back w/ FUA sda: sda1 sda2 sd 0:0:0:0: Attached scsi disk sda Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdb: 188743680 512-byte hdwr sectors (96637 MB) sdb: Write Protect is off sdb: Mode Sense: 7f 00 10 08 SCSI device sdb: drive cache: write back w/ FUA SCSI device sdb: 188743680 512-byte hdwr sectors (96637 MB) sdb: Write Protect is off sdb: Mode Sense: 7f 00 10 08 SCSI device sdb: drive cache: write back w/ FUA sdb: sdb1 sd 0:0:0:1: Attached scsi disk sdb Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdc: 188743680 512-byte hdwr sectors (96637 MB) sdc: Write Protect is off sdc: Mode Sense: 7f 00 10 08 SCSI device sdc: drive cache: write back w/ FUA SCSI device sdc: 188743680 512-byte hdwr sectors (96637 MB) sdc: Write Protect is off sdc: Mode Sense: 7f 00 10 08 SCSI device sdc: drive cache: write back w/ FUA sdc: sdc1 sd 0:0:0:2: Attached scsi disk sdc Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdd: 188743680 512-byte hdwr sectors (96637 MB) sdd: Write Protect is off sdd: Mode Sense: 7f 00 10 08 SCSI device sdd: drive cache: write back w/ FUA SCSI device sdd: 188743680 512-byte hdwr sectors (96637 MB) sdd: Write Protect is off sdd: Mode Sense: 7f 00 10 08 SCSI device sdd: drive cache: write back w/ FUA sdd: sdd1 sd 0:0:0:3: Attached scsi disk sdd Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sde: 188743680 512-byte hdwr sectors (96637 MB) sde: Write Protect is off sde: Mode Sense: 7f 00 10 08 SCSI device sde: drive cache: write back w/ FUA SCSI device sde: 188743680 512-byte hdwr sectors (96637 MB) sde: Write Protect is off sde: Mode Sense: 7f 00 10 08 SCSI device sde: drive cache: write back w/ FUA sde: sde1 sd 0:0:0:4: Attached scsi disk sde Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdf: 251658240 512-byte hdwr sectors (128849 MB) sdf: Write Protect is off sdf: Mode Sense: 7f 00 10 08 SCSI device sdf: drive cache: write back w/ FUA SCSI device sdf: 251658240 512-byte hdwr sectors (128849 MB) sdf: Write Protect is off sdf: Mode Sense: 7f 00 10 08 SCSI device sdf: drive cache: write back w/ FUA sdf: sdf1 sd 0:0:0:5: Attached scsi disk sdf Vendor: 3PARdata Model: SES Rev: 0000 Type: Enclosure ANSI SCSI revision: 05 Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdg: 4194304 512-byte hdwr sectors (2147 MB) sdg: Write Protect is off sdg: Mode Sense: 7f 00 10 08 SCSI device sdg: drive cache: write back w/ FUA SCSI device sdg: 4194304 512-byte hdwr sectors (2147 MB) sdg: Write Protect is off sdg: Mode Sense: 7f 00 10 08 SCSI device sdg: drive cache: write back w/ FUA sdg: sdg1 sdg2 sd 0:0:1:0: Attached scsi disk sdg Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdh: 188743680 512-byte hdwr sectors (96637 MB) sdh: Write Protect is off sdh: Mode Sense: 7f 00 10 08 SCSI device sdh: drive cache: write back w/ FUA SCSI device sdh: 188743680 512-byte hdwr sectors (96637 MB) sdh: Write Protect is off sdh: Mode Sense: 7f 00 10 08 SCSI device sdh: drive cache: write back w/ FUA sdh: sdh1 sd 0:0:1:1: Attached scsi disk sdh Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdi: 188743680 512-byte hdwr sectors (96637 MB) sdi: Write Protect is off sdi: Mode Sense: 7f 00 10 08 SCSI device sdi: drive cache: write back w/ FUA SCSI device sdi: 188743680 512-byte hdwr sectors (96637 MB) sdi: Write Protect is off sdi: Mode Sense: 7f 00 10 08 SCSI device sdi: drive cache: write back w/ FUA sdi: sdi1 sd 0:0:1:2: Attached scsi disk sdi Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdj: 188743680 512-byte hdwr sectors (96637 MB) sdj: Write Protect is off sdj: Mode Sense: 7f 00 10 08 SCSI device sdj: drive cache: write back w/ FUA SCSI device sdj: 188743680 512-byte hdwr sectors (96637 MB) sdj: Write Protect is off sdj: Mode Sense: 7f 00 10 08 SCSI device sdj: drive cache: write back w/ FUA sdj: sdj1 sd 0:0:1:3: Attached scsi disk sdj Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdk: 188743680 512-byte hdwr sectors (96637 MB) sdk: Write Protect is off sdk: Mode Sense: 7f 00 10 08 SCSI device sdk: drive cache: write back w/ FUA SCSI device sdk: 188743680 512-byte hdwr sectors (96637 MB) sdk: Write Protect is off sdk: Mode Sense: 7f 00 10 08 SCSI device sdk: drive cache: write back w/ FUA sdk: sdk1 sd 0:0:1:4: Attached scsi disk sdk Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdl: 251658240 512-byte hdwr sectors (128849 MB) sdl: Write Protect is off sdl: Mode Sense: 7f 00 10 08 SCSI device sdl: drive cache: write back w/ FUA SCSI device sdl: 251658240 512-byte hdwr sectors (128849 MB) sdl: Write Protect is off sdl: Mode Sense: 7f 00 10 08 SCSI device sdl: drive cache: write back w/ FUA sdl: sdl1 sd 0:0:1:5: Attached scsi disk sdl Vendor: 3PARdata Model: SES Rev: 0000 Type: Enclosure ANSI SCSI revision: 05 Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdm: 4194304 512-byte hdwr sectors (2147 MB) sdm: Write Protect is off sdm: Mode Sense: 7f 00 10 08 SCSI device sdm: drive cache: write back w/ FUA SCSI device sdm: 4194304 512-byte hdwr sectors (2147 MB) sdm: Write Protect is off sdm: Mode Sense: 7f 00 10 08 SCSI device sdm: drive cache: write back w/ FUA sdm: sdm1 sdm2 sd 1:0:0:0: Attached scsi disk sdm Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdn: 188743680 512-byte hdwr sectors (96637 MB) sdn: Write Protect is off sdn: Mode Sense: 7f 00 10 08 SCSI device sdn: drive cache: write back w/ FUA SCSI device sdn: 188743680 512-byte hdwr sectors (96637 MB) sdn: Write Protect is off sdn: Mode Sense: 7f 00 10 08 SCSI device sdn: drive cache: write back w/ FUA sdn: sdn1 sd 1:0:0:1: Attached scsi disk sdn Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdo: 188743680 512-byte hdwr sectors (96637 MB) sdo: Write Protect is off sdo: Mode Sense: 7f 00 10 08 SCSI device sdo: drive cache: write back w/ FUA SCSI device sdo: 188743680 512-byte hdwr sectors (96637 MB) sdo: Write Protect is off sdo: Mode Sense: 7f 00 10 08 SCSI device sdo: drive cache: write back w/ FUA sdo: sdo1 sd 1:0:0:2: Attached scsi disk sdo Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdp: 188743680 512-byte hdwr sectors (96637 MB) sdp: Write Protect is off sdp: Mode Sense: 7f 00 10 08 SCSI device sdp: drive cache: write back w/ FUA SCSI device sdp: 188743680 512-byte hdwr sectors (96637 MB) sdp: Write Protect is off sdp: Mode Sense: 7f 00 10 08 SCSI device sdp: drive cache: write back w/ FUA sdp: sdp1 sd 1:0:0:3: Attached scsi disk sdp Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdq: 188743680 512-byte hdwr sectors (96637 MB) sdq: Write Protect is off sdq: Mode Sense: 7f 00 10 08 SCSI device sdq: drive cache: write back w/ FUA SCSI device sdq: 188743680 512-byte hdwr sectors (96637 MB) sdq: Write Protect is off sdq: Mode Sense: 7f 00 10 08 SCSI device sdq: drive cache: write back w/ FUA sdq: sdq1 sd 1:0:0:4: Attached scsi disk sdq Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdr: 251658240 512-byte hdwr sectors (128849 MB) sdr: Write Protect is off sdr: Mode Sense: 7f 00 10 08 SCSI device sdr: drive cache: write back w/ FUA SCSI device sdr: 251658240 512-byte hdwr sectors (128849 MB) sdr: Write Protect is off sdr: Mode Sense: 7f 00 10 08 SCSI device sdr: drive cache: write back w/ FUA sdr: sdr1 sd 1:0:0:5: Attached scsi disk sdr Vendor: 3PARdata Model: SES Rev: 0000 Type: Enclosure ANSI SCSI revision: 05 Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sds: 4194304 512-byte hdwr sectors (2147 MB) sds: Write Protect is off sds: Mode Sense: 7f 00 10 08 SCSI device sds: drive cache: write back w/ FUA SCSI device sds: 4194304 512-byte hdwr sectors (2147 MB) sds: Write Protect is off sds: Mode Sense: 7f 00 10 08 SCSI device sds: drive cache: write back w/ FUA sds: sds1 sds2 sd 1:0:1:0: Attached scsi disk sds Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdt: 188743680 512-byte hdwr sectors (96637 MB) sdt: Write Protect is off sdt: Mode Sense: 7f 00 10 08 SCSI device sdt: drive cache: write back w/ FUA SCSI device sdt: 188743680 512-byte hdwr sectors (96637 MB) sdt: Write Protect is off sdt: Mode Sense: 7f 00 10 08 SCSI device sdt: drive cache: write back w/ FUA sdt: sdt1 sd 1:0:1:1: Attached scsi disk sdt Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdu: 188743680 512-byte hdwr sectors (96637 MB) sdu: Write Protect is off sdu: Mode Sense: 7f 00 10 08 SCSI device sdu: drive cache: write back w/ FUA SCSI device sdu: 188743680 512-byte hdwr sectors (96637 MB) sdu: Write Protect is off sdu: Mode Sense: 7f 00 10 08 SCSI device sdu: drive cache: write back w/ FUA sdu: sdu1 sd 1:0:1:2: Attached scsi disk sdu Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdv: 188743680 512-byte hdwr sectors (96637 MB) sdv: Write Protect is off sdv: Mode Sense: 7f 00 10 08 SCSI device sdv: drive cache: write back w/ FUA SCSI device sdv: 188743680 512-byte hdwr sectors (96637 MB) sdv: Write Protect is off sdv: Mode Sense: 7f 00 10 08 SCSI device sdv: drive cache: write back w/ FUA sdv: sdv1 sd 1:0:1:3: Attached scsi disk sdv Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdw: 188743680 512-byte hdwr sectors (96637 MB) sdw: Write Protect is off sdw: Mode Sense: 7f 00 10 08 SCSI device sdw: drive cache: write back w/ FUA SCSI device sdw: 188743680 512-byte hdwr sectors (96637 MB) sdw: Write Protect is off sdw: Mode Sense: 7f 00 10 08 SCSI device sdw: drive cache: write back w/ FUA sdw: sdw1 sd 1:0:1:4: Attached scsi disk sdw Vendor: 3PARdata Model: VV Rev: 0000 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdx: 251658240 512-byte hdwr sectors (128849 MB) sdx: Write Protect is off sdx: Mode Sense: 7f 00 10 08 SCSI device sdx: drive cache: write back w/ FUA SCSI device sdx: 251658240 512-byte hdwr sectors (128849 MB) sdx: Write Protect is off sdx: Mode Sense: 7f 00 10 08 SCSI device sdx: drive cache: write back w/ FUA sdx: sdx1 sd 1:0:1:5: Attached scsi disk sdx Vendor: 3PARdata Model: SES Rev: 0000 Type: Enclosure ANSI SCSI revision: 05 kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.0.8-rh (Oct 11, 2010) GSI 22 sharing vector 0xA2 and IRQ 22 ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 31 (level, low) -> IRQ 162 PCI: Setting latency timer of device 0000:02:00.0 to 64 eth0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f8000000, IRQ 162, node addr d8d3856080e4 GSI 23 sharing vector 0xAA and IRQ 23 ACPI: PCI Interrupt 0000:02:00.1[B] -> GSI 39 (level, low) -> IRQ 170 PCI: Setting latency timer of device 0000:02:00.1 to 64 eth1: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f6000000, IRQ 170, node addr d8d3856080e6 EDAC MC: Ver: 2.0.1 Apr 12 2011 ACPI: PCI Interrupt 0000:01:04.2[B] -> GSI 22 (level, low) -> IRQ 98 Floppy drive(s): fd0 is 1.44M input: PC Speaker as /class/input/input2 sd 0:0:0:0: Attached scsi generic sg0 type 0 sd 0:0:0:1: Attached scsi generic sg1 type 0 sd 0:0:0:2: Attached scsi generic sg2 type 0 sd 0:0:0:3: Attached scsi generic sg3 type 0 sd 0:0:0:4: Attached scsi generic sg4 type 0 sd 0:0:0:5: Attached scsi generic sg5 type 0 scsi 0:0:0:254: Attached scsi generic sg6 type 13 sd 0:0:1:0: Attached scsi generic sg7 type 0 sd 0:0:1:1: Attached scsi generic sg8 type 0 sd 0:0:1:2: Attached scsi generic sg9 type 0 sd 0:0:1:3: Attached scsi generic sg10 type 0 sd 0:0:1:4: Attached scsi generic sg11 type 0 sd 0:0:1:5: Attached scsi generic sg12 type 0 scsi 0:0:1:254: Attached scsi generic sg13 type 13 sd 1:0:0:0: Attached scsi generic sg14 type 0 sd 1:0:0:1: Attached scsi generic sg15 type 0 sd 1:0:0:2: Attached scsi generic sg16 type 0 sd 1:0:0:3: Attached scsi generic sg17 type 0 sd 1:0:0:4: Attached scsi generic sg18 type 0 sd 1:0:0:5: Attached scsi generic sg19 type 0 scsi 1:0:0:254: Attached scsi generic sg20 type 13 sd 1:0:1:0: Attached scsi generic sg21 type 0 sd 1:0:1:1: Attached scsi generic sg22 type 0 sd 1:0:1:2: Attached scsi generic sg23 type 0 sd 1:0:1:3: Attached scsi generic sg24 type 0 sd 1:0:1:4: Attached scsi generic sg25 type 0 sd 1:0:1:5: Attached scsi generic sg26 type 0 scsi 1:0:1:254: Attached scsi generic sg27 type 13 shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 e1000e: Intel(R) PRO/1000 Network Driver - 1.2.7-k2 e1000e: Copyright (c) 1999 - 2010 Intel Corporation. e1000e 0000:09:00.0: Disabling ASPM L1 GSI 24 sharing vector 0xB2 and IRQ 24 ACPI: PCI Interrupt 0000:09:00.0[B] -> GSI 36 (level, low) -> IRQ 178 PCI: Setting latency timer of device 0000:09:00.0 to 64 EDAC i7core: Driver loaded. eth2: (PCI Express:2.5GB/s:Width x4) 00:26:55:e0:62:39 eth2: Intel(R) PRO/1000 Network Connection eth2: MAC: 0, PHY: 4, PBA No: d98771-008 e1000e 0000:09:00.1: Disabling ASPM L1 GSI 25 sharing vector 0xC2 and IRQ 25 ACPI: PCI Interrupt 0000:09:00.1[A] -> GSI 35 (level, low) -> IRQ 194 PCI: Setting latency timer of device 0000:09:00.1 to 64 eth3: (PCI Express:2.5GB/s:Width x4) 00:26:55:e0:62:38 eth3: Intel(R) PRO/1000 Network Connection eth3: MAC: 0, PHY: 4, PBA No: d98771-008 e1000e 0000:0a:00.0: Disabling ASPM L1 GSI 26 sharing vector 0xD2 and IRQ 26 ACPI: PCI Interrupt 0000:0a:00.0[B] -> GSI 34 (level, low) -> IRQ 210 PCI: Setting latency timer of device 0000:0a:00.0 to 64 eth4: (PCI Express:2.5GB/s:Width x4) 00:26:55:e0:62:3b eth4: Intel(R) PRO/1000 Network Connection eth4: MAC: 0, PHY: 4, PBA No: d98771-008 e1000e 0000:0a:00.1: Disabling ASPM L1 GSI 27 sharing vector 0xE2 and IRQ 27 ACPI: PCI Interrupt 0000:0a:00.1[A] -> GSI 24 (level, low) -> IRQ 226 PCI: Setting latency timer of device 0000:0a:00.1 to 64 eth5: (PCI Express:2.5GB/s:Width x4) 00:26:55:e0:62:3a eth5: Intel(R) PRO/1000 Network Connection eth5: MAC: 0, PHY: 4, PBA No: d98771-008 floppy0: no floppy controllers found work still pending Floppy drive(s): fd0 is 1.44M floppy0: no floppy controllers found work still pending lp: driver loaded but no devices found ACPI: Power Button (FF) [PWRF] ACPI: Mapper loaded dell-wmi: No known WMI GUID found md: Autodetecting RAID arrays. md: autorun ... md: ... autorun DONE. EXT3 FS on dm-0, internal journal kjournald starting. Commit interval 5 seconds EXT3 FS on dm-5, internal journal EXT3-fs: mounted filesystem with ordered data mode. kjournald starting. Commit interval 5 seconds EXT3 FS on dm-6, internal journal EXT3-fs: mounted filesystem with ordered data mode. kjournald starting. Commit interval 5 seconds EXT3 FS on dm-1, internal journal EXT3-fs: mounted filesystem with ordered data mode. kjournald starting. Commit interval 5 seconds EXT3 FS on dm-4, internal journal EXT3-fs: mounted filesystem with ordered data mode. kjournald starting. Commit interval 5 seconds EXT3 FS on dm-3, internal journal EXT3-fs: mounted filesystem with ordered data mode. kjournald starting. Commit interval 5 seconds EXT3 FS on cciss/c0d0p1, internal journal EXT3-fs: mounted filesystem with ordered data mode. Adding 33554424k swap on /dev/vg_01/swap. Priority:-1 extents:1 across:33554424k Loading iSCSI transport class v2.0-871. 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com> All bugs added by David S. Miller <davem@redhat.com> cxgb3i: tag itt 0x1fff, 13 bits, age 0xf, 4 bits. iscsi: registered transport (cxgb3i) device-mapper: multipath: version 1.0.6 loaded device-mapper: multipath round-robin: version 1.0.0 loaded NET: Registered protocol family 10 lo: Disabled Privacy Extensions IPv6 over IPv4 tunneling driver Broadcom NetXtreme II CNIC Driver cnic v2.1.2 (May 26, 2010) cnic: Added CNIC device: eth0 cnic: Added CNIC device: eth1 Broadcom NetXtreme II iSCSI Driver bnx2i v2.1.3 (Aug 10, 2010) iscsi: registered transport (bnx2i) scsi2 : Broadcom Offload iSCSI Initiator scsi3 : Broadcom Offload iSCSI Initiator iscsi: registered transport (tcp) iscsi: registered transport (iser) iscsi: registered transport (be2iscsi) Ethernet Channel Bonding Driver: v3.4.0-1 (October 7, 2008) bonding: MII link monitoring set to 100 ms bonding: bond0: setting mode to active-backup (1). bonding: bond0: Setting MII monitoring interval to 100. ADDRCONF(NETDEV_UP): bond0: link is not ready bonding: bond0: Adding slave eth0. bnx2: eth0: using MSIX bnx2i [02:00.00]: ISCSI_INIT passed bonding: bond0: enslaving eth0 as a backup interface with a down link. bonding: bond0: Adding slave eth5. bonding: bond0: enslaving eth5 as a backup interface with a down link. e1000e: eth5 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex bonding: bond0: link status definitely up for interface eth0. bonding: bond0: making interface eth0 the new active one. bonding: bond0: first active interface up! bonding: bond0: link status definitely up for interface eth5. ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready bonding: bond1: setting mode to active-backup (1). bonding: bond1: Setting MII monitoring interval to 100. ADDRCONF(NETDEV_UP): bond1: link is not ready bonding: bond1: Adding slave eth1. bnx2: eth1: using MSIX bnx2i [02:00.01]: ISCSI_INIT passed bonding: bond1: enslaving eth1 as a backup interface with a down link. bonding: bond1: Adding slave eth4. bonding: bond1: enslaving eth4 as a backup interface with a down link. bnx2i [02:00.01]: ISCSI_INIT passed eth4: changing MTU from 1500 to 9000 bnx2: eth1 NIC Copper Link is Up, 1000 Mbps full duplex bonding: bond1: link status definitely up for interface eth1. bonding: bond1: making interface eth1 the new active one. bonding: bond1: first active interface up! ADDRCONF(NETDEV_CHANGE): bond1: link becomes ready e1000e: eth4 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None bonding: bond1: link status definitely up for interface eth4. ADDRCONF(NETDEV_UP): eth2: link is not ready ADDRCONF(NETDEV_UP): eth3: link is not ready e1000e: eth3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready bond0: no IPv6 routers present bond1: no IPv6 routers present eth3: no IPv6 routers present OCFS2 Node Manager 1.4.8 Wed Apr 13 01:55:52 EDT 2011 (build e8aac2f2bdee501fb1932596c706cca4) OCFS2 DLM 1.4.8 Wed Apr 13 01:55:52 EDT 2011 (build 160daa35825b01991fd7b803a9e47661) OCFS2 DLMFS 1.4.8 Wed Apr 13 01:55:52 EDT 2011 (build 160daa35825b01991fd7b803a9e47661) OCFS2 User DLM kernel interface loaded OCFS2 1.4.8 Wed Apr 13 01:55:46 EDT 2011 (build 27d6d0b45170348d3948369890be76c7) o2dlm: Nodes in domain 992E33DCF94F470B99F875CD9CC517DD: 0 kjournald starting. Commit interval 5 seconds ocfs2: Mounting device (253,14) on (node 0, slot 0) with ordered data mode. o2dlm: Nodes in domain B97A51730F624411AB90F9803F5FDB87: 0 kjournald starting. Commit interval 5 seconds ocfs2: Mounting device (253,13) on (node 0, slot 0) with ordered data mode. o2dlm: Nodes in domain BDA8E3A294774B96AE3C4147670BD869: 0 kjournald starting. Commit interval 5 seconds ocfs2: Mounting device (253,18) on (node 0, slot 0) with ordered data mode. o2dlm: Nodes in domain A3DF12A1F5F1416C99D93DE55ECB7897: 0 kjournald starting. Commit interval 5 seconds ocfs2: Mounting device (253,16) on (node 0, slot 0) with ordered data mode. o2dlm: Nodes in domain 42581156A20846B9BB87F0B72AD4E18B: 0 kjournald starting. Commit interval 5 seconds ocfs2: Mounting device (253,19) on (node 0, slot 0) with ordered data mode. o2net: accepted connection from node rac02.nucleussoftware.com (num 1) at 10.0.0.2:7777 o2dlm: Node 1 joins domain 992E33DCF94F470B99F875CD9CC517DD o2dlm: Nodes in domain 992E33DCF94F470B99F875CD9CC517DD: 0 1 o2dlm: Node 1 joins domain B97A51730F624411AB90F9803F5FDB87 o2dlm: Nodes in domain B97A51730F624411AB90F9803F5FDB87: 0 1 o2dlm: Node 1 joins domain BDA8E3A294774B96AE3C4147670BD869 o2dlm: Nodes in domain BDA8E3A294774B96AE3C4147670BD869: 0 1 o2dlm: Node 1 joins domain A3DF12A1F5F1416C99D93DE55ECB7897 o2dlm: Nodes in domain A3DF12A1F5F1416C99D93DE55ECB7897: 0 1 o2dlm: Node 1 joins domain 42581156A20846B9BB87F0B72AD4E18B o2dlm: Nodes in domain 42581156A20846B9BB87F0B72AD4E18B: 0 1 qla2xxx 0000:04:00.0: scsi(0:1:0): Abort command issued -- 1 3526ab 2002. qla2xxx 0000:04:00.0: scsi(0:1:0): Abort command issued -- 1 3526ac 2002. qla2xxx 0000:04:00.0: scsi(0:1:4): Abort command issued -- 1 3526b2 2002. sd 0:0:1:4: timing out command, waited 60s o2net: connection to node rac02.nucleussoftware.com (num 1) at 10.0.0.2:7777 has been idle for 30.0 seconds, shutting it down. (swapper,0,0):o2net_idle_timer:1506 here are some times that might help debug the situation: (tmr 1304566260.126113 now 1304566290.125951 dr 1304566260.126100 adv 1304566260.126113:1304566260.126114 func (7c5653ec:504) 1304566256.126026:1304566256.126035) o2net: no longer connected to node rac02.nucleussoftware.com (num 1) at 10.0.0.2:7777 (o2net,29995,0):o2net_connect_expired:1667 ERROR: no connection established with node 1 after 30.0 seconds, giving up and returning errors. (o2hb-A3DF12A1F5,30361,0):ocfs2_dlm_eviction_cb:98 device (253,14): dlm has evicted node 1 (o2hb-A3DF12A1F5,30361,0):ocfs2_dlm_eviction_cb:98 device (253,13): dlm has evicted node 1 (o2hb-A3DF12A1F5,30361,0):ocfs2_dlm_eviction_cb:98 device (253,18): dlm has evicted node 1 (o2hb-A3DF12A1F5,30361,0):ocfs2_dlm_eviction_cb:98 device (253,16): dlm has evicted node 1 (o2hb-A3DF12A1F5,30361,8):ocfs2_dlm_eviction_cb:98 device (253,19): dlm has evicted node 1 (ocfs2rec,31530,14):dlm_get_lock_resource:837 992E33DCF94F470B99F875CD9CC517DD:M0000000000000000000025378b9570: at least one node (1) to recover before lock mastery can begin (ocfs2rec,31531,9):dlm_get_lock_resource:837 B97A51730F624411AB90F9803F5FDB87:M0000000000000000000025f2d1e90c: at least one node (1) to recover before lock mastery can begin (ocfs2rec,31532,9):dlm_get_lock_resource:837 BDA8E3A294774B96AE3C4147670BD869:M000000000000000000002513ef62be: at least one node (1) to recover before lock mastery can begin (ocfs2rec,31533,9):dlm_get_lock_resource:837 A3DF12A1F5F1416C99D93DE55ECB7897:M00000000000000000000255f6ee2c4: at least one node (1) to recover before lock mastery can begin (dlm_reco_thread,30189,6):dlm_get_lock_resource:837 992E33DCF94F470B99F875CD9CC517DD:$RECOVERY: at least one node (1) to recover before lock mastery can begin (dlm_reco_thread,30189,6):dlm_get_lock_resource:871 992E33DCF94F470B99F875CD9CC517DD: recovery map is not empty, but must master $RECOVERY lock now (dlm_reco_thread,30189,6):dlm_do_recovery:524 (30189) Node 0 is the Recovery Master for the Dead Node 1 for Domain 992E33DCF94F470B99F875CD9CC517DD (ocfs2rec,31534,0):dlm_get_lock_resource:837 42581156A20846B9BB87F0B72AD4E18B:M00000000000000000000257e29263a: at least one node (1) to recover before lock mastery can begin (ocfs2rec,31530,0):ocfs2_replay_journal:1183 Recovering node 1 from slot 1 on device (253,14) (ocfs2rec,31531,9):dlm_get_lock_resource:891 B97A51730F624411AB90F9803F5FDB87:M0000000000000000000025f2d1e90c: at least one node (1) to recover before lock mastery can begin (ocfs2rec,31532,9):dlm_get_lock_resource:891 BDA8E3A294774B96AE3C4147670BD869:M000000000000000000002513ef62be: at least one node (1) to recover before lock mastery can begin (ocfs2rec,31533,9):dlm_get_lock_resource:891 A3DF12A1F5F1416C99D93DE55ECB7897:M00000000000000000000255f6ee2c4: at least one node (1) to recover before lock mastery can begin (ocfs2rec,31534,0):dlm_get_lock_resource:891 42581156A20846B9BB87F0B72AD4E18B:M00000000000000000000257e29263a: at least one node (1) to recover before lock mastery can begin (dlm_reco_thread,30512,13):dlm_get_lock_resource:837 42581156A20846B9BB87F0B72AD4E18B:$RECOVERY: at least one node (1) to recover before lock mastery can begin (dlm_reco_thread,30512,13):dlm_get_lock_resource:871 42581156A20846B9BB87F0B72AD4E18B: recovery map is not empty, but must master $RECOVERY lock now (dlm_reco_thread,30512,13):dlm_do_recovery:524 (30512) Node 0 is the Recovery Master for the Dead Node 1 for Domain 42581156A20846B9BB87F0B72AD4E18B (dlm_reco_thread,30392,6):dlm_get_lock_resource:837 A3DF12A1F5F1416C99D93DE55ECB7897:$RECOVERY: at least one node (1) to recover before lock mastery can begin (dlm_reco_thread,30392,6):dlm_get_lock_resource:871 A3DF12A1F5F1416C99D93DE55ECB7897: recovery map is not empty, but must master $RECOVERY lock now (dlm_reco_thread,30392,6):dlm_do_recovery:524 (30392) Node 0 is the Recovery Master for the Dead Node 1 for Domain A3DF12A1F5F1416C99D93DE55ECB7897 kjournald starting. Commit interval 5 seconds (dlm_reco_thread,30338,14):dlm_get_lock_resource:837 BDA8E3A294774B96AE3C4147670BD869:$RECOVERY: at least one node (1) to recover before lock mastery can begin (dlm_reco_thread,30338,14):dlm_get_lock_resource:871 BDA8E3A294774B96AE3C4147670BD869: recovery map is not empty, but must master $RECOVERY lock now (dlm_reco_thread,30338,14):dlm_do_recovery:524 (30338) Node 0 is the Recovery Master for the Dead Node 1 for Domain BDA8E3A294774B96AE3C4147670BD869 (dlm_reco_thread,30291,2):dlm_get_lock_resource:837 B97A51730F624411AB90F9803F5FDB87:$RECOVERY: at least one node (1) to recover before lock mastery can begin (dlm_reco_thread,30291,2):dlm_get_lock_resource:871 B97A51730F624411AB90F9803F5FDB87: recovery map is not empty, but must master $RECOVERY lock now (dlm_reco_thread,30291,2):dlm_do_recovery:524 (30291) Node 0 is the Recovery Master for the Dead Node 1 for Domain B97A51730F624411AB90F9803F5FDB87 (ocfs2rec,31531,0):ocfs2_replay_journal:1183 Recovering node 1 from slot 1 on device (253,13) (ocfs2rec,31532,0):ocfs2_replay_journal:1183 Recovering node 1 from slot 1 on device (253,18) (ocfs2rec,31533,0):ocfs2_replay_journal:1183 Recovering node 1 from slot 1 on device (253,16) (ocfs2rec,31534,0):ocfs2_replay_journal:1183 Recovering node 1 from slot 1 on device (253,19) kjournald starting. Commit interval 5 seconds kjournald starting. Commit interval 5 seconds kjournald starting. Commit interval 5 seconds kjournald starting. Commit interval 5 seconds o2net: accepted connection from node rac02.nucleussoftware.com (num 1) at 10.0.0.2:7777 o2dlm: Node 1 joins domain 992E33DCF94F470B99F875CD9CC517DD o2dlm: Nodes in domain 992E33DCF94F470B99F875CD9CC517DD: 0 1 o2dlm: Node 1 joins domain B97A51730F624411AB90F9803F5FDB87 o2dlm: Nodes in domain B97A51730F624411AB90F9803F5FDB87: 0 1 o2dlm: Node 1 joins domain BDA8E3A294774B96AE3C4147670BD869 o2dlm: Nodes in domain BDA8E3A294774B96AE3C4147670BD869: 0 1 o2dlm: Node 1 joins domain A3DF12A1F5F1416C99D93DE55ECB7897 o2dlm: Nodes in domain A3DF12A1F5F1416C99D93DE55ECB7897: 0 1 o2dlm: Node 1 joins domain 42581156A20846B9BB87F0B72AD4E18B o2dlm: Nodes in domain 42581156A20846B9BB87F0B72AD4E18B: 0 1 cciss/c0d1: unknown partition table cciss/c0d1: p1 cciss/c0d1: p1 kjournald starting. Commit interval 5 seconds EXT3 FS on cciss/c0d1p1, internal journal EXT3-fs: mounted filesystem with ordered data mode. martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 rport-1:0-1: blocked FC remote port time out: saving binding sd 1:0:1:0: SCSI error: return code = 0x00010000 end_request: I/O error, dev sds, sector 980361 device-mapper: multipath: Failing path 65:32. sd 1:0:1:0: SCSI error: return code = 0x00010000 end_request: I/O error, dev sds, sector 980873 sd 1:0:1:1: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdt, sector 2247 device-mapper: multipath: Failing path 65:48. sd 1:0:1:3: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdv, sector 1130647 device-mapper: multipath: Failing path 65:80. sd 1:0:1:3: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdv, sector 2247 sd 1:0:1:3: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdv, sector 5677223 device-mapper: multipath: Failing path 65:112. device-mapper: multipath: Failing path 65:96. device-mapper: multipath: Failing path 65:64. martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 rport-1:0-1: blocked FC remote port time out: saving binding sd 1:0:1:0: SCSI error: return code = 0x00010000 end_request: I/O error, dev sds, sector 980361 device-mapper: multipath: Failing path 65:32. sd 1:0:1:0: SCSI error: return code = 0x00010000 end_request: I/O error, dev sds, sector 980873 sd 1:0:1:2: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdu, sector 2247 device-mapper: multipath: Failing path 65:64. sd 1:0:1:2: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdu, sector 3870887 sd 1:0:1:2: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdu, sector 3871143 sd 1:0:1:2: SCSI error: return code = 0x00010000 end_request: I/O error, dev sdu, sector 3870823 device-mapper: multipath: Failing path 65:112. device-mapper: multipath: Failing path 65:96. device-mapper: multipath: Failing path 65:80. device-mapper: multipath: Failing path 65:48. martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 FS-Cache: Loaded martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00 martian source 192.168.167.27 from 64.27.64.205, on dev eth3 ll header: 00:26:55:e0:62:38:00:09:44:d5:4c:00:08:00
Log File Name is /var/log/messages
Unable to read /var/log/messages
May be file permission problem.
Permissions are:
-rw------- 1 root root 14231 Jun 21 19:06 2011 Jun 21 19:06 2011 messagesUser: uid=54321(oracle) gid=54321(oinstall) groups=10(wheel),54321(oinstall),54322(dba),54323(asmdba),54324(asmadmin)