+ASM1@testdb11a /oracle/media/grid$ ./runcluvfy.sh stage -pre crsinst -n testdb11a,testdb11b -verbose Performing pre-checks for cluster services setup Checking node reachability... Check: Node reachability from node "testdb11a" Destination Node Reachable? ------------------------------------ ------------------------ testdb11b yes testdb11a yes Result: Node reachability check passed from node "testdb11a" Checking user equivalence... Check: User equivalence for user "grid" Node Name Status ------------------------------------ ------------------------ testdb11b passed testdb11a passed Result: User equivalence check passed for user "grid" Checking node connectivity... Checking hosts config file... Node Name Status ------------------------------------ ------------------------ testdb11b passed testdb11a passed Verification of the hosts config file successful Interface information for node "testdb11b" Name IP Address Subnet Gateway Def. Gateway HW Address MTU ------ --------------- --------------- --------------- --------------- ----------------- ------ eth0 192.168.1.21 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:B6:22:54 1500 eth0 192.168.1.24 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:B6:22:54 1500 eth0 192.168.1.23 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:B6:22:54 1500 eth1 192.168.2.21 192.168.2.0 0.0.0.0 192.168.1.1 00:0C:29:B6:22:5E 1500 eth1 169.254.164.12 169.254.0.0 0.0.0.0 192.168.1.1 00:0C:29:B6:22:5E 1500 eth2 192.168.1.115 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:B6:22:68 1500 Interface information for node "testdb11a" Name IP Address Subnet Gateway Def. Gateway HW Address MTU ------ --------------- --------------- --------------- --------------- ----------------- ------ eth0 192.168.1.20 192.168.1.0 0.0.0.0 192.168.2.1 00:0C:29:0B:FD:9E 1500 eth0 192.168.1.22 192.168.1.0 0.0.0.0 192.168.2.1 00:0C:29:0B:FD:9E 1500 eth1 192.168.2.20 192.168.2.0 0.0.0.0 192.168.2.1 00:0C:29:0B:FD:A8 1500 eth1 169.254.209.140 169.254.0.0 0.0.0.0 192.168.2.1 00:0C:29:0B:FD:A8 1500 Check: Node connectivity of subnet "192.168.1.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- testdb11b[192.168.1.21] testdb11b[192.168.1.24] yes testdb11b[192.168.1.21] testdb11b[192.168.1.23] yes testdb11b[192.168.1.21] testdb11b[192.168.1.115] yes testdb11b[192.168.1.21] testdb11a[192.168.1.20] yes testdb11b[192.168.1.21] testdb11a[192.168.1.22] yes testdb11b[192.168.1.24] testdb11b[192.168.1.23] yes testdb11b[192.168.1.24] testdb11b[192.168.1.115] yes testdb11b[192.168.1.24] testdb11a[192.168.1.20] yes testdb11b[192.168.1.24] testdb11a[192.168.1.22] yes testdb11b[192.168.1.23] testdb11b[192.168.1.115] yes testdb11b[192.168.1.23] testdb11a[192.168.1.20] yes testdb11b[192.168.1.23] testdb11a[192.168.1.22] yes testdb11b[192.168.1.115] testdb11a[192.168.1.20] yes testdb11b[192.168.1.115] testdb11a[192.168.1.22] yes testdb11a[192.168.1.20] testdb11a[192.168.1.22] yes Result: Node connectivity passed for subnet "192.168.1.0" with node(s) testdb11b,testdb11a Check: TCP connectivity of subnet "192.168.1.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- testdb11a:192.168.1.20 testdb11b:192.168.1.21 passed testdb11a:192.168.1.20 testdb11b:192.168.1.24 passed testdb11a:192.168.1.20 testdb11b:192.168.1.23 passed testdb11a:192.168.1.20 testdb11b:192.168.1.115 passed testdb11a:192.168.1.20 testdb11a:192.168.1.22 passed Result: TCP connectivity check passed for subnet "192.168.1.0" Check: Node connectivity of subnet "192.168.2.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- testdb11b[192.168.2.21] testdb11a[192.168.2.20] yes Result: Node connectivity passed for subnet "192.168.2.0" with node(s) testdb11b,testdb11a Check: TCP connectivity of subnet "192.168.2.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- testdb11a:192.168.2.20 testdb11b:192.168.2.21 passed Result: TCP connectivity check passed for subnet "192.168.2.0" Check: Node connectivity of subnet "169.254.0.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- testdb11b[169.254.164.12] testdb11a[169.254.209.140] yes Result: Node connectivity passed for subnet "169.254.0.0" with node(s) testdb11b,testdb11a Check: TCP connectivity of subnet "169.254.0.0" Source Destination Connected? ------------------------------ ------------------------------ ---------------- testdb11a:169.254.209.140 testdb11b:169.254.164.12 passed Result: TCP connectivity check passed for subnet "169.254.0.0" Interfaces found on subnet "169.254.0.0" that are likely candidates for VIP are: testdb11b eth1:169.254.164.12 testdb11a eth1:169.254.209.140 WARNING: Could not find a suitable set of interfaces for the private interconnect Checking subnet mask consistency... Subnet mask consistency check passed for subnet "192.168.1.0". Subnet mask consistency check passed for subnet "192.168.2.0". Subnet mask consistency check passed for subnet "169.254.0.0". Subnet mask consistency check passed. Result: Node connectivity check passed Checking multicast communication... Checking subnet "192.168.1.0" for multicast communication with multicast group "230.0.1.0"... Check of subnet "192.168.1.0" for multicast communication with multicast group "230.0.1.0" passed. Checking subnet "192.168.2.0" for multicast communication with multicast group "230.0.1.0"... Check of subnet "192.168.2.0" for multicast communication with multicast group "230.0.1.0" passed. Checking subnet "169.254.0.0" for multicast communication with multicast group "230.0.1.0"... Check of subnet "169.254.0.0" for multicast communication with multicast group "230.0.1.0" passed. Check of multicast communication passed. Checking ASMLib configuration. Node Name Status ------------------------------------ ------------------------ testdb11b passed testdb11a passed Result: Check for ASMLib configuration passed. Check: Total memory Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b 999.8672MB (1023864.0KB) 1.5GB (1572864.0KB) failed testdb11a 999.8672MB (1023864.0KB) 1.5GB (1572864.0KB) failed Result: Total memory check failed Check: Available memory Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b 326.4297MB (334264.0KB) 50MB (51200.0KB) passed testdb11a 210.5391MB (215592.0KB) 50MB (51200.0KB) passed Result: Available memory check passed Check: Swap space Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b 1.9687GB (2064376.0KB) 1.5GB (1572864.0KB) passed testdb11a 1.9687GB (2064376.0KB) 1.5GB (1572864.0KB) passed Result: Swap space check passed Check: Free disk space for "testdb11b:/u01/app/11.2.0/grid,testdb11b:/tmp" Path Node Name Mount point Available Required Status ---------------- ------------ ------------ ------------ ------------ ------------ /u01/app/11.2.0/grid testdb11b / 9.9961GB 7.5GB passed /tmp testdb11b / 9.9961GB 7.5GB passed Result: Free disk space check passed for "testdb11b:/u01/app/11.2.0/grid,testdb11b:/tmp" Check: Free disk space for "testdb11a:/u01/app/11.2.0/grid,testdb11a:/tmp" Path Node Name Mount point Available Required Status ---------------- ------------ ------------ ------------ ------------ ------------ /u01/app/11.2.0/grid testdb11a / 6.7471GB 7.5GB failed /tmp testdb11a / 6.7471GB 7.5GB failed Result: Free disk space check failed for "testdb11a:/u01/app/11.2.0/grid,testdb11a:/tmp" Check: User existence for "grid" Node Name Status Comment ------------ ------------------------ ------------------------ testdb11b passed exists(501) testdb11a passed exists(501) Checking for multiple users with UID value 501 Result: Check for multiple users with UID value 501 passed Result: User existence check passed for "grid" Check: Group existence for "oinstall" Node Name Status Comment ------------ ------------------------ ------------------------ testdb11b passed exists testdb11a passed exists Result: Group existence check passed for "oinstall" Check: Group existence for "dba" Node Name Status Comment ------------ ------------------------ ------------------------ testdb11b passed exists testdb11a passed exists Result: Group existence check passed for "dba" Check: Membership of user "grid" in group "oinstall" [as Primary] Node Name User Exists Group Exists User in Group Primary Status ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b yes yes yes yes passed testdb11a yes yes yes yes passed Result: Membership check for user "grid" in group "oinstall" [as Primary] passed Check: Membership of user "grid" in group "dba" Node Name User Exists Group Exists User in Group Status ---------------- ------------ ------------ ------------ ---------------- testdb11b yes yes yes passed testdb11a yes yes yes passed Result: Membership check for user "grid" in group "dba" passed Check: Run level Node Name run level Required Status ------------ ------------------------ ------------------------ ---------- testdb11b 5 3,5 passed testdb11a 5 3,5 passed Result: Run level check passed Check: Hard limits for "maximum open file descriptors" Node Name Type Available Required Status ---------------- ------------ ------------ ------------ ---------------- testdb11b hard 65536 65536 passed testdb11a hard 65536 65536 passed Result: Hard limits check passed for "maximum open file descriptors" Check: Soft limits for "maximum open file descriptors" Node Name Type Available Required Status ---------------- ------------ ------------ ------------ ---------------- testdb11b soft 1024 1024 passed testdb11a soft 1024 1024 passed Result: Soft limits check passed for "maximum open file descriptors" Check: Hard limits for "maximum user processes" Node Name Type Available Required Status ---------------- ------------ ------------ ------------ ---------------- testdb11b hard 16384 16384 passed testdb11a hard 16384 16384 passed Result: Hard limits check passed for "maximum user processes" Check: Soft limits for "maximum user processes" Node Name Type Available Required Status ---------------- ------------ ------------ ------------ ---------------- testdb11b soft 2047 2047 passed testdb11a soft 2047 2047 passed Result: Soft limits check passed for "maximum user processes" Check: System architecture Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b x86_64 x86_64 passed testdb11a x86_64 x86_64 passed Result: System architecture check passed Check: Kernel version Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b 2.6.18-308.el5 2.6.18 passed testdb11a 2.6.18-308.el5 2.6.18 passed Result: Kernel version check passed Check: Kernel parameter for "semmsl" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 250 250 250 passed testdb11a 250 250 250 passed Result: Kernel parameter check passed for "semmsl" Check: Kernel parameter for "semmns" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 32000 32000 32000 passed testdb11a 32000 32000 32000 passed Result: Kernel parameter check passed for "semmns" Check: Kernel parameter for "semopm" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 100 100 100 passed testdb11a 100 100 100 passed Result: Kernel parameter check passed for "semopm" Check: Kernel parameter for "semmni" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 128 128 128 passed testdb11a 128 128 128 passed Result: Kernel parameter check passed for "semmni" Check: Kernel parameter for "shmmax" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 1054504960 1054504960 524218368 passed testdb11a 1054504960 1054504960 524218368 passed Result: Kernel parameter check passed for "shmmax" Check: Kernel parameter for "shmmni" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 4096 4096 4096 passed testdb11a 4096 4096 4096 passed Result: Kernel parameter check passed for "shmmni" Check: Kernel parameter for "shmall" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 2097152 2097152 2097152 passed testdb11a 2097152 2097152 2097152 passed Result: Kernel parameter check passed for "shmall" Check: Kernel parameter for "file-max" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 6815744 6815744 6815744 passed testdb11a 6815744 6815744 6815744 passed Result: Kernel parameter check passed for "file-max" Check: Kernel parameter for "ip_local_port_range" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed testdb11a between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed Result: Kernel parameter check passed for "ip_local_port_range" Check: Kernel parameter for "rmem_default" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 262144 262144 262144 passed testdb11a 262144 262144 262144 passed Result: Kernel parameter check passed for "rmem_default" Check: Kernel parameter for "rmem_max" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 4194304 4194304 4194304 passed testdb11a 4194304 4194304 4194304 passed Result: Kernel parameter check passed for "rmem_max" Check: Kernel parameter for "wmem_default" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 262144 262144 262144 passed testdb11a 262144 262144 262144 passed Result: Kernel parameter check passed for "wmem_default" Check: Kernel parameter for "wmem_max" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 1048586 1048586 1048576 passed testdb11a 1048586 1048586 1048576 passed Result: Kernel parameter check passed for "wmem_max" Check: Kernel parameter for "aio-max-nr" Node Name Current Configured Required Status Comment ---------------- ------------ ------------ ------------ ------------ ------------ testdb11b 1048576 1048576 1048576 passed testdb11a 1048576 1048576 1048576 passed Result: Kernel parameter check passed for "aio-max-nr" Check: Package existence for "make" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b make-3.81-3.el5 make-3.81 passed testdb11a make-3.81-3.el5 make-3.81 passed Result: Package existence check passed for "make" Check: Package existence for "binutils" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b binutils-2.17.50.0.6-20.el5 binutils-2.17.50.0.6 passed testdb11a binutils-2.17.50.0.6-20.el5 binutils-2.17.50.0.6 passed Result: Package existence check passed for "binutils" Check: Package existence for "gcc(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b gcc(x86_64)-4.1.2-52.el5 gcc(x86_64)-4.1.2 passed testdb11a gcc(x86_64)-4.1.2-52.el5 gcc(x86_64)-4.1.2 passed Result: Package existence check passed for "gcc(x86_64)" Check: Package existence for "libaio(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b libaio(x86_64)-0.3.106-5 libaio(x86_64)-0.3.106 passed testdb11a libaio(x86_64)-0.3.106-5 libaio(x86_64)-0.3.106 passed Result: Package existence check passed for "libaio(x86_64)" Check: Package existence for "glibc(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b glibc(x86_64)-2.5-81 glibc(x86_64)-2.5-24 passed testdb11a glibc(x86_64)-2.5-81 glibc(x86_64)-2.5-24 passed Result: Package existence check passed for "glibc(x86_64)" Check: Package existence for "compat-libstdc++-33(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b compat-libstdc++-33(x86_64)-3.2.3-61 compat-libstdc++-33(x86_64)-3.2.3 passed testdb11a compat-libstdc++-33(x86_64)-3.2.3-61 compat-libstdc++-33(x86_64)-3.2.3 passed Result: Package existence check passed for "compat-libstdc++-33(x86_64)" Check: Package existence for "elfutils-libelf(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b elfutils-libelf(x86_64)-0.137-3.el5 elfutils-libelf(x86_64)-0.125 passed testdb11a elfutils-libelf(x86_64)-0.137-3.el5 elfutils-libelf(x86_64)-0.125 passed Result: Package existence check passed for "elfutils-libelf(x86_64)" Check: Package existence for "elfutils-libelf-devel" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125 passed testdb11a elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125 passed WARNING: PRVF-7584 : Multiple versions of package "elfutils-libelf-devel" found on node testdb11b: elfutils-libelf-devel(i386)-0.137-3.el5,elfutils-libelf-devel(x86_64)-0.137-3.el5 WARNING: PRVF-7584 : Multiple versions of package "elfutils-libelf-devel" found on node testdb11a: elfutils-libelf-devel(i386)-0.137-3.el5,elfutils-libelf-devel(x86_64)-0.137-3.el5 Result: Package existence check passed for "elfutils-libelf-devel" Check: Package existence for "glibc-common" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b glibc-common-2.5-81 glibc-common-2.5 passed testdb11a glibc-common-2.5-81 glibc-common-2.5 passed Result: Package existence check passed for "glibc-common" Check: Package existence for "glibc-devel(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b glibc-devel(x86_64)-2.5-81 glibc-devel(x86_64)-2.5 passed testdb11a glibc-devel(x86_64)-2.5-81 glibc-devel(x86_64)-2.5 passed Result: Package existence check passed for "glibc-devel(x86_64)" Check: Package existence for "glibc-headers" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b glibc-headers-2.5-81 glibc-headers-2.5 passed testdb11a glibc-headers-2.5-81 glibc-headers-2.5 passed Result: Package existence check passed for "glibc-headers" Check: Package existence for "gcc-c++(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b gcc-c++(x86_64)-4.1.2-52.el5 gcc-c++(x86_64)-4.1.2 passed testdb11a gcc-c++(x86_64)-4.1.2-52.el5 gcc-c++(x86_64)-4.1.2 passed Result: Package existence check passed for "gcc-c++(x86_64)" Check: Package existence for "libaio-devel(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b libaio-devel(x86_64)-0.3.106-5 libaio-devel(x86_64)-0.3.106 passed testdb11a libaio-devel(x86_64)-0.3.106-5 libaio-devel(x86_64)-0.3.106 passed Result: Package existence check passed for "libaio-devel(x86_64)" Check: Package existence for "libgcc(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b libgcc(x86_64)-4.1.2-52.el5 libgcc(x86_64)-4.1.2 passed testdb11a libgcc(x86_64)-4.1.2-52.el5 libgcc(x86_64)-4.1.2 passed Result: Package existence check passed for "libgcc(x86_64)" Check: Package existence for "libstdc++(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b libstdc++(x86_64)-4.1.2-52.el5 libstdc++(x86_64)-4.1.2 passed testdb11a libstdc++(x86_64)-4.1.2-52.el5 libstdc++(x86_64)-4.1.2 passed Result: Package existence check passed for "libstdc++(x86_64)" Check: Package existence for "libstdc++-devel(x86_64)" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b libstdc++-devel(x86_64)-4.1.2-52.el5 libstdc++-devel(x86_64)-4.1.2 passed testdb11a libstdc++-devel(x86_64)-4.1.2-52.el5 libstdc++-devel(x86_64)-4.1.2 passed Result: Package existence check passed for "libstdc++-devel(x86_64)" Check: Package existence for "sysstat" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b sysstat-7.0.2-11.el5 sysstat-7.0.2 passed testdb11a sysstat-7.0.2-11.el5 sysstat-7.0.2 passed Result: Package existence check passed for "sysstat" Check: Package existence for "ksh" Node Name Available Required Status ------------ ------------------------ ------------------------ ---------- testdb11b ksh-20100621-5.el5 ksh-20060214 passed testdb11a ksh-20100621-5.el5 ksh-20060214 passed Result: Package existence check passed for "ksh" Checking for multiple users with UID value 0 Result: Check for multiple users with UID value 0 passed Check: Current group ID Result: Current group ID check passed Starting check for consistency of primary group of root user Node Name Status ------------------------------------ ------------------------ testdb11b passed testdb11a passed Check for consistency of root user's primary group passed Starting Clock synchronization checks using Network Time Protocol(NTP)... NTP Configuration file check started... Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes No NTP Daemons or Services were found to be running Result: Clock synchronization check using Network Time Protocol(NTP) passed Checking Core file name pattern consistency... Core file name pattern consistency check passed. Checking to make sure user "grid" is not in "root" group Node Name Status Comment ------------ ------------------------ ------------------------ testdb11b passed does not exist testdb11a passed does not exist Result: User "grid" is not part of "root" group. Check passed Check default user file creation mask Node Name Available Required Comment ------------ ------------------------ ------------------------ ---------- testdb11b 0022 0022 passed testdb11a 0022 0022 passed Result: Default user file creation mask check passed Checking consistency of file "/etc/resolv.conf" across nodes Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined File "/etc/resolv.conf" does not have both domain and search entries defined Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes... domain entry in file "/etc/resolv.conf" is consistent across nodes Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes... search entry in file "/etc/resolv.conf" is consistent across nodes Checking file "/etc/resolv.conf" to make sure that only one search entry is defined All nodes have one search entry defined in file "/etc/resolv.conf" Checking all nodes to make sure that search entry is "localdomain" as found on node "testdb11b" All nodes of the cluster have same value for 'search' Checking DNS response time for an unreachable node Node Name Status ------------------------------------ ------------------------ testdb11b passed testdb11a passed The DNS response time for an unreachable node is within acceptable limit on all nodes File "/etc/resolv.conf" is consistent across nodes Check: Time zone consistency Result: Time zone consistency check passed Pre-check for cluster services setup was unsuccessful on all the nodes.