1/20
Contents
List of Tables
Title and Copyright Information
Preface
Intended Audience
Documentation Accessibility
Related Documents
Conventions
Changes in This Release for Oracle Grid Infrastructure Installation Guide
Changes in Oracle Grid Infrastructure 12
c
Release 1 (12.1)
1
Oracle Grid Infrastructure Installation Checklist
1.1
System Hardware, Software and Configuration Checklists
1.1.1
Oracle Grid Infrastructure Installation Server Hardware Checklist
1.1.2
Oracle Grid Infrastructure and Oracle RAC Environment Checklist
1.1.3
Oracle Grid Infrastructure Network Checklist
1.1.4
Oracle Grid Infrastructure and Oracle RAC Upgrades Checklist
1.1.5
Oracle Grid Infrastructure Storage Configuration Tasks
1.1.6
Oracle Grid Infrastructure Starting the Installation Tasks
2
Configuring Servers for Oracle Grid Infrastructure and Oracle RAC
2.1
Checking Server Hardware and Memory Configuration
2.2
General Server Minimum Requirements
2.3
Server Storage Minimum Requirements for Oracle Grid Infrastructure
2.4
Server Memory Minimum Requirements
2.4.1
64-bit System Minimum Memory Requirements
2.4.2
Shared Memory Requirements
3
Configuring Operating Systems for Oracle Grid Infrastructure and Oracle RAC
3.1
Reviewing Operating System and Software Upgrade Best Practices
3.1.1
General Upgrade Best Practices
3.1.2
Oracle ASM Upgrade Notifications
3.1.3
Rolling Upgrade Procedure Notifications
3.2
Reviewing Operating System Security Common Practices
3.3
Using Installation Fixup Scripts
3.4
Logging In to a Remote System Using X Terminal
3.5
About Operating System Requirements
3.6
Operating System Requirements for IBM AIX on POWER Systems (64-Bit)
3.6.1
Supported IBM AIX 7.1 Versions
3.6.2
Supported IBM AIX 6.1 Versions
3.7
Additional Drivers and Software Packages for IBM AIX on POWER Systems (64-Bit)
3.7.1
Installation Requirements for Open Database Connectivity
3.7.1.1
About ODBC Drivers and Oracle Database
3.7.1.2
Installing ODBC Drivers for IBM AIX
3.7.2
Installation Requirements for Oracle Messaging Gateway
3.7.2.1
About Oracle Messaging Gateway
3.7.2.2
Installing Oracle Messaging Gateway
3.7.3
Installation Requirements for Programming Environments
3.7.3.1
About Programming Environments and Oracle Database
3.7.3.2
Configuring Support for Programming Environments
3.7.4
Installation Requirements for Web Browsers
3.8
Checking the Software Requirements
3.9
Running the rootpre.sh Script
3.10
Enabling I/O Completion Ports
3.11
Checking Resource Limits for AIX
3.12
Tuning AIX System Environment
3.12.1
Tuning Virtual Memory Manager (VMM)
3.12.2
Increasing System Block Size Allocation
3.12.3
Configuring SSH LoginGraceTime Parameter for AIX
3.12.4
Configuring User Process Parameters
3.12.5
Configuring Network Tuning Parameters
3.13
Setting Network Time Protocol for Cluster Time Synchronization
3.14
Using Automatic SSH Configuration During Installation
4
Configuring Networks for Oracle Grid Infrastructure and Oracle RAC
4.1
Network Interface Hardware Requirements
4.2
IP Interface Configuration Requirements
4.3
Private Interconnect Redundant Network Requirements
4.4
IPv4 and IPv6 Protocol Requirements
4.5
Oracle Grid Infrastructure IP Name and Address Requirements
4.5.1
About Oracle Grid Infrastructure Name Resolution Options
4.5.2
Cluster Name and SCAN Requirements
4.5.3
IP Name and Address Requirements For Grid Naming Service (GNS)
4.5.4
IP Name and Address Requirements For Multi-Cluster GNS
4.5.4.1
About Multi-Cluster GNS Networks
4.5.4.2
Configuring GNS Server Clusters
4.5.4.3
Configuring GNS Client Clusters
4.5.4.4
Creating and Using a GNS Client Data File
4.5.5
IP Name and Address Requirements for Standard Cluster Manual Configuration
4.5.6
Confirming the DNS Configuration for SCAN
4.6
About Oracle Flex ASM Clusters Networks
4.7
Domain Delegation to Grid Naming Service
4.7.1
Choosing a Subdomain Name for Use with Grid Naming Service
4.7.2
Configuring DNS for Cluster Domain Delegation to Grid Naming Service
4.8
Broadcast Requirements for Networks Used by Oracle Grid Infrastructure
4.9
Multicast Requirements for Networks Used by Oracle Grid Infrastructure
4.10
Domain Delegation to Grid Naming Service
4.10.1
Choosing a Subdomain Name for Use with Grid Naming Service
4.10.2
DNS Configuration for Cluster Domain Delegation to GNS
4.11
Configuration Requirements for Oracle Flex Clusters
4.11.1
General Requirements for Oracle Flex Cluster Configuration
4.11.2
Oracle Flex Cluster DHCP-Assigned Virtual IP (VIP) Addresses
4.11.3
Oracle Flex Cluster Manually-Assigned Addresses
4.12
Grid Naming Service Standard Cluster Configuration Example
4.13
Manual IP Address Configuration Example
4.14
Network Interface Configuration Options
5
Configuring Users, Groups and Environments for Oracle Grid Infrastructure and Oracle RAC
5.1
Creating Groups, Users and Paths for Oracle Grid Infrastructure
5.1.1
Determining If the Oracle Inventory and Oracle Inventory Group Exists
5.1.2
Creating the Oracle Inventory Group If an Oracle Inventory Does Not Exist
5.1.3
Creating the Oracle Grid Infrastructure User
5.1.3.1
Understanding Restrictions for Oracle Software Installation Owners
5.1.3.2
Determining if an Oracle Software Owner User Exists
5.1.3.3
Creating or Modifying an Oracle Software Owner User for Oracle Grid Infrastructure
5.1.4
About the Oracle Base Directory for the Grid User
5.1.5
About the Oracle Home Directory for Oracle Grid Infrastructure Software
5.1.6
Creating the Oracle Home and Oracle Base Directory
5.1.7
About Job Role Separation Operating System Privileges Groups and Users
5.1.8
Descriptions of Job Role Separation Groups and Users
5.1.8.1
Oracle Software Owner For Each Oracle Software Product
5.1.8.2
Standard Oracle Database Groups for Job Role Separation
5.1.8.3
Extended Oracle Database Groups for Job Role Separation
5.1.8.4
Oracle ASM Groups for Job Role Separation
5.1.9
Creating Job Role Separation Operating System Privileges Groups and User
5.1.9.1
Creating the OSDBA Group to Prepare for Database Installations
5.1.9.2
Creating an OSOPER Group for Database Installations
5.1.9.3
Creating the OSASM Group
5.1.9.4
Creating the OSOPER for ASM Group
5.1.9.5
Creating the OSDBA for ASM Group for Database Access to Oracle ASM
5.1.9.6
Oracle Software Owner User Installation Tasks
5.1.9.7
Creating Identical Database Users and Groups on Other Cluster Nodes
5.1.10
Example of Creating Minimal Groups, Users, and Paths
5.1.11
Example of Creating Role-allocated Groups, Users, and Paths
5.1.11.1
Oracle Grid Infrastructure Groups and Users Example
5.1.11.2
Oracle Database DB1 Groups and Users Example
5.1.11.3
Oracle Database DB2 Groups and Users Example
5.1.12
Adding Oracle Grid Infrastructure Installation Owner to Hagsuser Group
5.2
Configuring Grid Infrastructure Software Owner User Environments
5.2.1
Environment Requirements for Oracle Software Owners
5.2.2
Procedure for Configuring Oracle Software Owner Environments
5.2.3
Checking Resource Limits for the Oracle Software Installation Users
5.2.4
Setting Display and X11 Forwarding Configuration
5.2.5
Preventing Installation Errors Caused by Terminal Output Commands
5.3
Enabling Intelligent Platform Management Interface (IPMI)
5.3.1
Requirements for Enabling IPMI
5.3.2
Configuring the IPMI Management Network
5.3.3
Configuring the BMC
5.3.3.1
Example of BMC Configuration Using IPMItool
5.4
Determining Root Script Execution Plan
6
Configuring Storage for Oracle Grid Infrastructure and Oracle RAC
6.1
Reviewing Oracle Grid Infrastructure Storage Options
6.1.1
Supported Storage Options
6.1.2
Oracle ACFS and Oracle ADVM
6.1.2.1
About Oracle ACFS and Oracle ADVM
6.1.2.2
Restrictions and Guidelines for Oracle ACFS
6.1.3
General Storage Considerations for Oracle Grid Infrastructure and Oracle RAC
6.1.3.1
General Storage Considerations for Oracle Clusterware
6.1.3.2
General Storage Considerations for Oracle RAC
6.1.4
Guidelines for Using Oracle ASM Disk Groups for Storage
6.1.5
Using Logical Volume Managers with Oracle Grid Infrastructure and Oracle RAC
6.1.6
After You Have Selected Disk Storage Options
6.2
About Shared File System Storage Configuration
6.2.1
Guidelines for Using a Shared File System with Oracle Grid Infrastructure
6.2.2
Requirements for Oracle Grid Infrastructure Shared File System Volume Sizes
6.2.3
Deciding to Use a Cluster File System for Oracle Clusterware Files
6.2.4
About Direct NFS Client and Data File Storage
6.2.4.1
About Direct NFS Client Storage
6.2.4.2
About Direct NFS Client Configuration
6.2.4.3
Using the oranfstab File with Direct NFS Client
6.2.4.4
About Mounting NFS Storage Devices with Direct NFS Client
6.2.5
Deciding to Use NFS for Data Files
6.2.6
Configuring HACMP Multinode Disk Heartbeat (MNDHB)
6.2.6.1
Overview of Requirements for Using HACMP with Oracle Clusterware
6.2.6.2
Deploying HACMP and MDNDHB for Oracle Clusterware
6.2.6.3
Upgrading an Existing Oracle Clusterware and HACMP Installation
6.2.7
Configuring Raw Logical Volumes for Oracle Clusterware
6.2.8
Configuring New Oracle Clusterware Volume Group Raw Logical Volumes
6.2.9
Creating a Volume Group for Database Files
6.2.10
Creating a Volume Group for Oracle Clusterware
6.2.11
Importing the Volume Group on the Other Cluster Nodes
6.2.12
Activating the Volume Group in Concurrent Mode on All Cluster Nodes
6.3
Configuring Operating System and Direct NFS Client
6.3.1
Configuring Operating System NFS Mount and Buffer Size Parameters
6.3.2
Checking Operating System NFS Mount and Buffer Size Parameters
6.3.3
Checking NFS Mount and Buffer Size Parameters for Oracle RAC
6.3.4
Setting TCP Network Protocol Buffer for Direct NFS Client
6.3.5
Enabling Direct NFS Client Oracle Disk Manager Control of NFS
6.3.6
Specifying Network Paths with the Oranfstab File
6.3.7
Enabling Hybrid Columnar Compression on Direct NFS Client
6.3.8
Creating Directories for Oracle Clusterware Files on Shared File Systems
6.3.9
Creating Directories for Oracle Database Files on Shared File Systems
6.3.10
Disabling Direct NFS Client Oracle Disk Management Control of NFS
6.4
Oracle Automatic Storage Management Storage Configuration
6.4.1
Configuring Storage for Oracle Automatic Storage Management
6.4.1.1
Identifying Storage Requirements for Oracle Automatic Storage Management
6.4.1.2
Creating Files on a NAS Device for Use with Oracle ASM
6.4.1.3
Using an Existing Oracle ASM Disk Group
6.4.1.4
Configuring Disk Devices for Oracle ASM
6.4.2
Using Disk Groups with Oracle Database Files on Oracle ASM
6.4.2.1
Identifying and Using Existing Oracle Database Disk Groups on Oracle ASM
6.4.2.2
Creating Disk Groups for Oracle Database Data Files
6.4.2.3
Creating and Using Oracle ASM Credentials File
6.4.3
Configuring Oracle Automatic Storage Management Cluster File System
6.4.4
Upgrading Existing Oracle ASM Instances
7
Installing Oracle Grid Infrastructure for a Cluster
7.1
Installing Grid Infrastructure
7.1.1
Running OUI to Install Grid Infrastructure
7.1.2
Installing Grid Infrastructure Using a Cluster Configuration File
7.2
Installing Grid Infrastructure Using a Software-Only Installation
7.2.1
Installing the Software Binaries
7.2.2
Configuring the Software Binaries
7.2.3
Configuring the Software Binaries Using a Response File
7.2.4
Setting Ping Targets for Network Checks
7.3
Confirming Oracle Clusterware Function
7.4
Confirming Oracle ASM Function for Oracle Clusterware Files
7.5
Understanding Offline Processes in Oracle Grid Infrastructure
8
Oracle Grid Infrastructure Postinstallation Procedures
8.1
Required Postinstallation Tasks
8.2
Recommended Postinstallation Tasks
8.2.1
Configuring IPMI-based Failure Isolation Using Crsctl
8.2.2
Tuning Semaphore Parameters
8.2.3
Creating a Fast Recovery Area Disk Group
8.2.3.1
About the Fast Recovery Area and the Fast Recovery Area Disk Group
8.2.3.2
Creating the Fast Recovery Area Disk Group
8.2.4
Checking the SCAN Configuration
8.2.5
Downloading and Installing the ORAchk Health Check Tool
8.2.6
Setting Resource Limits for Oracle Clusterware and Associated Databases and Applications
8.3
Using Earlier Oracle Database Releases with Oracle Grid Infrastructure
8.3.1
General Restrictions for Using Earlier Oracle Database Versions
8.3.2
Managing Server Pools with Earlier Database Versions
8.3.3
Making Oracle ASM Available to Earlier Oracle Database Releases
8.3.4
Using ASMCA to Administer Disk Groups for Earlier Database Versions
8.3.5
Pinning Cluster Nodes for Oracle Database Release 10.x or 11.x
8.3.6
Using the Correct LSNRCTL Commands
8.4
Modifying Oracle Clusterware Binaries After Installation
9
How to Modify or Deinstall Oracle Grid Infrastructure
9.1
Deciding When to Deinstall Oracle Clusterware
9.2
Migrating Standalone Grid Infrastructure Servers to a Cluster
9.3
Relinking Oracle Grid Infrastructure for a Cluster Binaries
9.4
Changing the Oracle Grid Infrastructure Home Path
9.5
Unconfiguring Oracle Clusterware Without Removing Binaries
9.6
Removing Oracle Clusterware and Oracle ASM
9.6.1
About the Deinstallation Tool
9.6.1.1
Deinstalling Previous Release Grid Home
9.6.2
Deinstallation Tool Command Example for Oracle Grid Infrastructure
9.6.3
Deinstallation Response File Example for Grid Infrastructure for a Cluster
A
Troubleshooting the Oracle Grid Infrastructure Installation Process
A.1
Best Practices for Contacting Oracle Support
A.2
General Installation Issues
A.2.1
Other Installation Issues and Errors
A.3
Interpreting CVU "Unknown" Output Messages Using Verbose Mode
A.4
Interpreting CVU Messages About Oracle Grid Infrastructure Setup
A.5
About the Oracle Grid Infrastructure Alert Log
A.6
Troubleshooting Issues on AIX
A.7
Performing Cluster Diagnostics During Oracle Grid Infrastructure Installations
A.8
About Using CVU Cluster Healthchecks After Installation
A.9
Interconnect Configuration Issues
A.10
SCAN VIP and SCAN Listener Issues
A.11
Storage Configuration Issues
A.11.1
Recovery from Losing a Node Filesystem or Grid Home
A.11.2
Oracle ASM Issues After Upgrading Oracle Grid Infrastructure
A.11.3
Oracle ASM Issues After Downgrading Oracle Grid Infrastructure for Standalone Server (Oracle Restart)
A.12
Failed or Incomplete Installations and Upgrades
A.12.1
Completing Failed or Interrupted Upgrades
A.12.1.1
Continuing Upgrade When Force Upgrade in Rolling Upgrade Mode Fails
A.12.1.2
Continuing Upgrade When Upgrade Fails on the First Node
A.12.1.3
Continuing Upgrade When Upgrade Fails on Nodes Other Than the First Node
A.12.2
Completing Failed or Interrupted Installations
A.12.2.1
Continuing Incomplete Installations on First Node
A.12.2.2
Continuing Installation on Nodes Other Than the First Node
B
How to Upgrade to Oracle Grid Infrastructure 12
c
Release 1
B.1
Back Up the Oracle Software Before Upgrades
B.2
About Oracle Grid Infrastructure and Oracle ASM Upgrade and Downgrade
B.3
Options for Clusterware and Oracle ASM Upgrades and Downgrades
B.4
Restrictions for Clusterware and Oracle ASM Upgrades
B.5
Preparing to Upgrade an Existing Oracle Clusterware Installation
B.5.1
Checks to Complete Before Upgrade an Existing Oracle Clusterware Installation
B.5.2
Unset Oracle Environment Variables
B.5.3
Running the Oracle ORAchk Upgrade Readiness Assessment
B.6
Using CVU to Validate Readiness for Oracle Clusterware Upgrades
B.6.1
About the CVU Grid Upgrade Validation Command Options
B.6.2
Example of Verifying System Upgrade Readiness for Grid Infrastructure
B.7
Understanding Rolling Upgrades Using Batches
B.8
Performing Rolling Upgrades of Oracle Grid Infrastructure
B.8.1
Performing a Rolling Upgrade from an Earlier Release
B.8.2
Completing an Oracle Clusterware Upgrade when Nodes Become Unreachable
B.8.3
Upgrading Inaccessible Nodes After Forcing an Upgrade
B.8.4
Changing the First Node for Install and Upgrade
B.9
Performing Rolling Upgrade of Oracle ASM
B.9.1
About Upgrading Oracle ASM Separately
B.9.2
Using ASMCA to Upgrade Oracle ASM
B.10
Applying Patches to Oracle ASM
B.10.1
About Individual (One-Off) Oracle ASM Patches
B.10.2
About Oracle ASM Software Patch Levels
B.10.3
Patching Oracle ASM to a Software Patch Level
B.11
Updating Oracle Enterprise Manager Cloud Control Target Parameters
B.11.1
Updating the Enterprise Manager Cloud Control Target After Upgrades
B.11.2
Updating the Enterprise Manager Agent Base Directory After Upgrades
B.12
Unlocking the Existing Oracle Clusterware Installation
B.13
Checking Cluster Health Monitor Repository Size After Upgrading
B.14
Downgrading Oracle Clusterware After an Upgrade
B.14.1
About Downgrading Oracle Clusterware After an Upgrade
B.14.2
Downgrading to Releases Before 11
g
Release 2 (11.2.0.2)
B.14.3
Downgrading to 11
g
Release 2 (11.2.0.2) or Later Release
C
Installing and Configuring Oracle Database Using Response Files
C.1
How Response Files Work
C.1.1
Reasons for Using Silent Mode or Response File Mode
C.1.2
General Procedure for Using Response Files
C.2
Preparing a Response File
C.2.1
Editing a Response File Template
C.2.2
Recording a Response File
C.3
Running the Installer Using a Response File
C.4
Running Net Configuration Assistant Using a Response File
C.5
Postinstallation Configuration Using a Response File
C.5.1
About the Postinstallation Configuration File
C.5.2
Running Postinstallation Configuration Using a Response File
D
Oracle Grid Infrastructure for a Cluster Installation Concepts
D.1
Understanding Preinstallation Configuration
D.1.1
Optimal Flexible Architecture Guidelines for Oracle Grid Infrastructure
D.1.2
Oracle Grid Infrastructure for a Cluster and Oracle Restart Differences
D.1.3
Understanding the Oracle Inventory Group
D.1.4
Understanding the Oracle Inventory Directory
D.1.5
Understanding the Oracle Base directory
D.1.6
Understanding the Oracle Home for Oracle Grid Infrastructure Software
D.1.7
Location of Oracle Base and Oracle Grid Infrastructure Software Directories
D.2
Understanding Network Addresses
D.2.1
About the Public IP Address
D.2.2
About the Private IP Address
D.2.3
About the Virtual IP Address
D.2.4
About the Grid Naming Service (GNS) Virtual IP Address
D.2.5
About the SCAN for Oracle Grid Infrastructure Installations
D.3
Understanding Network Time Requirements
D.4
Understanding Oracle Flex Clusters and Oracle ASM Flex Clusters
D.5
Understanding Storage Configuration
D.5.1
Understanding Oracle Automatic Storage Management Cluster File System
D.5.2
About Migrating Existing Oracle ASM Instances
D.5.3
Standalone Oracle ASM Installations to Clustered Installation Conversions
D.6
Understanding Out-of-Place Upgrade
E
How to Complete Preinstallation Tasks Manually
E.1
Configuring SSH Manually on All Cluster Nodes
E.1.1
Checking Existing SSH Configuration on the System
E.1.2
Configuring SSH on Cluster Nodes
E.1.2.1
Create SSH Directory, and Create SSH Keys On Each Node
E.1.2.2
Add All Keys to a Common authorized_keys File
E.1.3
Enabling SSH User Equivalency on Cluster Nodes
E.2
Configuring Shell Limits and System Configuration Parameters for AIX
E.2.1
Configuring Shell Limits
E.2.2
Configuring System Configuration Parameters
E.2.3
Checking Asynchronous Input Output Processes
E.3
Setting UDP and TCP Kernel Parameters Manually
Index
Scripting on this page enhances content navigation, but does not change the content in any way.