Monday 27 March 2017

Exadata: Install Oracle GoldenGate 12c using ACFS File System

Overview
You can install Oracle GoldenGate for Oracle RAC using:

  • Shared Storage
    •  NFS, OCFS2, DBFS, OCFS
  • Local file system
You can Install Oracle GoldenGate 12c in 2 ways:
  • Graphical User Interface (GUI)
  • Using response file (Silent)

In this article I will demonstrate how to Install Oracle GoldenGate 12c using GUI on a full Rack Exadata Database Machine using ACFS file system.

What is ACFS?
Automatic Storage Management Cluster File System (ACFS) was introduced in Oracle database 11gR2. ACFS is a general purpose single-node or cluster file system on top of ASM. ACFS can be accessed using industry-standard Network Attached Storage (NAS) file access protocols: Network File System (NFS) and Common Internet File System (CIFS)

Installing GoldenGate on ACFS
ACFS file systems are mounted on all nodes in a cluster. Oracle GoldenGate is supported in an Oracle ACFS environment. GoldenGate should be installed in the cluster to capture the data from the database.

How to configure ACFS?
Take a look at the below 2 articles on how to configure ACFS on Exadata Database Machine.
 
Flex ASM: http://netsoftmate.blogspot.in/2017/03/configure-acfs-on-exadata-running.html
Standard ASM: http://netsoftmate.blogspot.in/2017/02/configure-acfs-on-exadata-database.html

Environment:
  • Exadata Database Machine X5-2 Full Rack
  • Oracle GoldenGate 12.2.0.1
  • Oracle Database 12.2.0.1
  • ASM Cluster File System (ACFS)
Verify ACFS is running and mounted

dm01db01-+ASM1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.acfs_dg.acfsvol.acfs -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.acfs_dg.acfsvol.acfs
               ONLINE  ONLINE       dm01db01                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db02                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db03                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db04                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db05                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db06                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db07                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db08                 mounted on /acfs_ogg
                                                             ,STABLE
--------------------------------------------------------------------------------

dm01db01-+ASM1 {/home/oracle}:dcli -g ~/dbs_group -l oracle 'df -h /acfs_ogg'
dm01db01: Filesystem            Size  Used Avail Use% Mounted on
dm01db01: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db02: Filesystem            Size  Used Avail Use% Mounted on
dm01db02: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db03: Filesystem            Size  Used Avail Use% Mounted on
dm01db03: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db04: Filesystem            Size  Used Avail Use% Mounted on
dm01db04: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db05: Filesystem            Size  Used Avail Use% Mounted on
dm01db05: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db06: Filesystem            Size  Used Avail Use% Mounted on
dm01db06: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db07: Filesystem            Size  Used Avail Use% Mounted on
dm01db07: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db08: Filesystem            Size  Used Avail Use% Mounted on
dm01db08: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg


Steps to Download Oracle GoldenGate 12c Software
  • Open a web browser and enter www.oracle.com in the address bar
  • This will bring you to the Oracle website home page
  • On this page hover on the download tab and click on "middleware"
  • Click GoldenGate
  • Accept the agreement and select the desired Oracle GoldenGate version for your platform.
    • Here I am downloading "Oracle GoldenGate 12.2.0.1.1 for Oracle on Linux x86-64"
  • Copy the zip file from your desktop to Exadata Compute node 1 using WinScp
  • Drag and Drop the file from left to right in to a directory
    • Here I am copying the file to /u01/app/oracle/software location
  • File copy is in progress

Steps to Install Oracle GoldenGate 12c software using OUI (Graphical Interface)
  • Login to Exadata Compute node 1 as Oracle software owner and navigate to the Oracle GoldenGate staging location
dm01db01-orcldb1 {/home/oracle}:cd /u01/app/oracle/software

dm01db01-orcldb1 {/u01/app/oracle/software}:ls -ltr
total 464928
-rw-r--r-- 1 oracle oinstall 475611228 Jan  2 04:51 fbo_ggs_Linux_x64_shiphome.zip
  • Copy software zip file to ACFS location /acfs_ogg
dm01db01-orcl1 {/u01/app/oracle/software}: cp fbo_ggs_Linux_x64_shiphome.zip /acfs_ogg/
  • Unzip the Oracle GoldenGate 12c software
dm01db01-orcldb1 {/u01/app/oracle/software}: cd /acfs_ogg

dm01db01-orcldb1 {/acfs_ogg}:ls -l
total 467040
-rw-r--r-- 1 oracle oinstall 475611228 Mar 25 01:51 fbo_ggs_Linux_x64_shiphome.zip

dm01db01-orcldb1 {/acfs_ogg}:unzip fbo_ggs_Linux_x64_shiphome.zip
Archive:  fbo_ggs_Linux_x64_shiphome.zip
   creating: fbo_ggs_Linux_x64_shiphome/
   creating: fbo_ggs_Linux_x64_shiphome/Disk1/
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/runInstaller
   creating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/OuiConfigVariables.xml
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/productlanguages.properties
   creating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/setperms1.sh
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora11g_filemap.jar
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora12c_dirs.lst
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora12c_1.xml
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/racfiles.jar
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora11g_dirs.lst
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora12c_filemap.jar
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora11g_1.xml
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora11g_exp_1.xml
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/fastcopy/oracle.oggcore.top_ora12c_exp_1.xml
   creating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/globalvariables/
   creating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/Dialogs/
   creating: fbo_ggs_Linux_x64_shiphome/Disk1/stage/Dialogs/standardDialogs/

......

   creating: fbo_ggs_Linux_x64_shiphome/Disk1/response/
  inflating: fbo_ggs_Linux_x64_shiphome/Disk1/response/oggcore.rsp
  inflating: OGG-12.2.0.1-README.txt
  inflating: OGG-12.2.0.1.1-ReleaseNotes.pdf


dm01db01-orcldb1 {/acfs_ogg}:ls -ltr
total 467412
drwxr-xr-x 3 oracle oinstall     20480 Dec 12  2015 fbo_ggs_Linux_x64_shiphome
-rw-r--r-- 1 oracle oinstall      1559 Jan 18  2016 OGG-12.2.0.1-README.txt
-rw-r--r-- 1 oracle oinstall    282294 Jan 18  2016 OGG-12.2.0.1.1-ReleaseNotes.pdf
drwx------ 2 root   root         65536 Mar 23 08:53 lost+found
-rw-r--r-- 1 oracle oinstall 475611228 Mar 25 01:51 fbo_ggs_Linux_x64_shiphome.zip
  • Change directory to Disk1 and run the Installer
dm01db01-orcldb1 {/acfs_ogg}:cd fbo_ggs_Linux_x64_shiphome

dm01db01-orcldb1 {/acfs_ogg/fbo_ggs_Linux_x64_shiphome}:cd Disk1/

dm01db01-orcldb1 {/acfs_ogg/fbo_ggs_Linux_x64_shiphome/Disk1}:ls -ltr
total 160
drwxr-xr-x  4 oracle oinstall 20480 Dec 12  2015 install
drwxr-xr-x 11 oracle oinstall 20480 Dec 12  2015 stage
-rwxr-xr-x  1 oracle oinstall   918 Dec 12  2015 runInstaller
drwxrwxr-x  2 oracle oinstall 20480 Dec 12  2015 response


dm01db01-orcldb1 {/acfs_ogg/fbo_ggs_Linux_x64_shiphome/Disk1}: ./runInstaller

Select the Database version for which you are installing Oracle GoldenGate Software.
Here I am Installing Oracle GoldenGate for Oracle Database 12c
Click Next

Specify the GoldenGate Software location. Here I am using /acfs_ogg (ACFS file system)
Specify the Database Home Location and Manager port (Default Manager port is 7809) 
Click Next

Review the Installation Summary and click Install

Oracle GoldenGate Software Installation in progress

Installation completed. Click Close
  • Open the .bash_profile and add the following two variables
dm01db01-orcldb1 {/home/oracle}: vi .bash_profile

export GG_HOME=/acfs_ogg/app/oracle/product/12.2.0.1/gghome
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:$ORACLE_HOME/lib32:$GG_HOME

*** Repeat the above step on all the nodes to update the .bash_profile***
  • Execute the .bash_profile and verify the variables.
dm01db01-orcldb1 {/home/oracle}: . .bash_profile
dm01db01-orcldb1 {/home/oracle}: echo $GG_HOME
/acfs_ogg/app/oracle/product/12.2.0.1/gghome

dm01db01-orcldb1 {/home/oracle}: echo $LD_LIBRARY_PATH
/u01/app/oracle/product/12.2.0.1/dbhome/lib:/u01/app/oracle/product/12.2.0.1/dbhome/lib32:/acfs_ogg/app/oracle/product/12.2.0.1/gghome
  • Let's connect to ggsci prompt and verify the manager process
dm01db01-orcldb1 {/home/oracle}:cd $GG_HOME
dm01db01-orcldb1 {/acfs_ogg/app/oracle/product/12.2.0.1/gghome}:./ggsci


Oracle GoldenGate Command Interpreter for Oracle
Version 12.2.0.1.1 OGGCORE_12.2.0.1.0_PLATFORMS_151211.1401_FBO
Linux, x64, 64bit (optimized), Oracle 12c on Dec 12 2015 02:56:48
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2015, Oracle and/or its affiliates. All rights reserved.

GGSCI (dm01db01.netsoftmate.com) 1> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING


GGSCI (dm01db01.netsoftmate.com) 2> info mgr

Manager is running (IP port dm01db01.netsoftmate.com.15000, Process ID 10249).
  • Let's verify it from node 2 this time. See the "info mgr" output. It clearly says that the mgr is up on node 1 that is dm01db01 using process ID 10249.
dm01db02-orcldb2 {/home/oracle}:cd $GG_HOME
dm01db02-orcldb2 {/acfs_ogg/app/oracle/product/12.2.0.1/gghome}:./ggsci

Oracle GoldenGate Command Interpreter for Oracle
Version 12.2.0.1.1 OGGCORE_12.2.0.1.0_PLATFORMS_151211.1401_FBO
Linux, x64, 64bit (optimized), Oracle 12c on Dec 12 2015 02:56:48
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2015, Oracle and/or its affiliates. All rights reserved.

GGSCI (dm01db02.netsoftmate.com) 1> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING

GGSCI (dm01db02.netsoftmate.com) 3> info mgr

Manager is running (IP port dm01db01.netsoftmate.com.15000, Process ID 10249).

dm01db02-orcldb2 {/acfs_ogg/app/oracle/product/12.2.0.1/gghome}:ps -ef|grep mgr
oracle   19219   823  0 04:06 pts/0    00:00:00 grep mgr

dm01db01-orcldb1 {/home/oracle}:dcli -g dbs_group -l oracle 'ls -l /acfs_ogg/app/oracle/product/12.2.0.1/'
dm01db01: total 52
dm01db01: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome
dm01db02: total 52
dm01db02: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome
dm01db03: total 52
dm01db03: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome
dm01db04: total 52
dm01db04: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome
dm01db05: total 52
dm01db05: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome
dm01db06: total 52
dm01db06: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome
dm01db07: total 52
dm01db07: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome
dm01db08: total 52
dm01db08: drwxr-xr-x 26 oracle oinstall 20480 Mar 25 03:57 gghome


Conclusion
This completes our Oracle GoldenGate 12c installation on Exadata database machine using ACFS. We have seen how much easy it is to install Oracle GoldenGate software using GUI interface. The key for installing Oracle GoldenGate on 12c a RAC environment is to choose a shared location for software. You can also choose to install Oracle GoldenGate on local file system if you don't have a shared location.

Friday 24 March 2017

Configure ACFS on Exadata running Oracle 12.2.0.1 on Flex ASM Architecture

Overview

In one of previous article I have demonstrated how to configure ACFS on Exadata database running Oracle database 12.1.0.2 using standard ASM. Now I have an opportunity to configure Oracle GoldenGate on Exadata running Oracle database 12.2.0.1. So I have decides to configure ACFS on Exadata running Oracle database 12.2.0.1 using ASM Flex Architecture.

In this article I will demostrate how to configure Oracle ACFS on Exadata Database machine running Oracle  Database 12.2.0.1 using Flex ASM.

For details on ACFS and how to configure ACFS on Standard ASM look at my previous article at:
http://netsoftmate.blogspot.in/2017/02/configure-acfs-on-exadata-database.html

Prerequisites

  • Verify ASM configuration on Standard Cluster (8 nodes)
Here the owner of the Grid Home is oracle user.

dm01db01-+ASM1 {/home/oracle}:id oracle
uid=1000(oracle) gid=1001(oinstall) groups=1001(oinstall),101(fuse),1002(dba),1003(oper),1004(asmdba)

  • Determine the ASM architecture
Here it is an ASM Flex configuration using the default cardinally=3 and the ASM instances are running on node 1, 2 and 4 out of 8 nodes:

dm01db01-+ASM1 {/home/oracle}:asmcmd showclustermode
ASM cluster : Flex mode enabled

dm01db01-orp258c1 {/home/oracle}:srvctl config asm -detail
ASM home: <CRS home>
Password file: +DBFS_DG/orapwASM
Backup of Password file:
ASM listener: LISTENER
ASM is enabled.
ASM is individually enabled on nodes:
ASM is individually disabled on nodes:
ASM instance count: 3
Cluster ASM listener: ASMNET1LSNR_ASM

dm01db01-+ASM1 {/home/oracle}:srvctl status asm
ASM is running on dm01db04,dm01db02,dm01db01
ASM is enabled.

  • Verify if ACFS/ADVM modules is enabled/loaded on every node in a standard cluster or every Hub Node in a Flex Cluster.
[root@dm01db01 ~]# dcli -g dbs_group -l root 'lsmod | grep oracle'
dm01db01: oracleacfs           4609822  3
dm01db01: oracleadvm            803161  17
dm01db01: oracleoks             660948  2 oracleacfs,oracleadvm
dm01db02: oracleacfs           4609822  3
dm01db02: oracleadvm            803161  17
dm01db02: oracleoks             660948  2 oracleacfs,oracleadvm
dm01db03: oracleacfs           4609822  3
dm01db03: oracleadvm            803161  17
dm01db03: oracleoks             660948  2 oracleacfs,oracleadvm
dm01db04: oracleacfs           4609822  3
dm01db04: oracleadvm            803161  17
dm01db04: oracleoks             660948  2 oracleacfs,oracleadvm
dm01db05: oracleacfs           4609822  3
dm01db05: oracleadvm            803161  17
dm01db05: oracleoks             660948  2 oracleacfs,oracleadvm
dm01db06: oracleacfs           4609822  3
dm01db06: oracleadvm            803161  17
dm01db06: oracleoks             660948  2 oracleacfs,oracleadvm
dm01db07: oracleacfs           4609822  3
dm01db07: oracleadvm            803161  17
dm01db07: oracleoks             660948  2 oracleacfs,oracleadvm
dm01db08: oracleacfs           4609822  3
dm01db08: oracleadvm            803161  17
dm01db08: oracleoks             660948  2 oracleacfs,oracleadvm

  • Check if ASM ADVM proxy is running on every node in a standard cluster or every Hub Node in a Flex Cluster.
dm01db01-+ASM1 {/home/oracle}:srvctl status asm -proxy
ADVM proxy is running on node dm01db06,dm01db05,dm01db04,dm01db03,dm01db02,dm01db01,dm01db08,dm01db07


dm01db01-+ASM1 {/home/oracle}:srvctl config asm -proxy -detail
ASM home: <CRS home>
ADVM proxy is enabled
ADVM proxy is individually enabled on nodes:
ADVM proxy is individually disabled on nodes:

dm01db01-orp258c1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.proxy_advm -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.proxy_advm
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
--------------------------------------------------------------------------------


Step I - Create ASM Disk Group for ACFS

  • Login as Oracle Grid Infrastructure software owner and start asmca.
dm01db01-orcldb1 {/home/oracle}: id oracle
uid=1000(oracle) gid=1001(oinstall) groups=1001(oinstall),1002(dba),1003(oper),1004(asmdba)

  • Set the ORACLE HOME and SID to ASM
dm01db01-orcldb1 {/home/oracle}:. oraenv
ORACLE_SID = [orcldb1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/oracle


dm01db01-+ASM1 {/home/oracle}:env | grep ORA
ORACLE_SID=+ASM1
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/12.2.0.1/grid

  • Set DISPLAY
dm01db01-+ASM1 {/home/oracle}:export DISPLAY=10.30.20.13:0.0
  • Start asmca utility
dm01db01-+ASM1 {/home/oracle}:which asmca
/u01/app/12.1.0.2/grid/bin/asmca

dm01db01-+ASM1 {/home/oracle}:asmca
 

ASMCA warming up

ASMCA Home page  appears

Click on ASM Instances to view the ASM configuration. We can see that it a Flex ASM Configuration

Click on "Dis Groups"  and click on "Create" button to create a new ASM Disk Group to be used for ACFS

On Create Disk Group page, specify:
    - Disk Group Name: ACFS_DG
    - Redundancy: Normal
    - Select Member Disk: Show Eligible
        - Select all candidate disks to be part of ACFS_DG disk group
        - In Exadata each Storage cell is a failure Group
    - Click on Show Advanced Options, specify:
       - Specify the ASM/DB/ADVM Compatibilty
    - Click Ok


ACFS_DG ASM Disk Group creation in progress

We can see our ACFS_DG Disk Group created 
  • Verify newly created ACFS_DG Disk Group as follows:
SQL> select inst_id, name, total_mb, group_number from gv$asm_diskgroup where name like 'ACFS_DG';

   INST_ID NAME                             TOTAL_MB GROUP_NUMBER
---------- ------------------------------ ---------- ------------
         1 ACFS_DG                          10407936            5
         3 ACFS_DG                          10407936            5
         2 ACFS_DG                          10407936            5

SQL> col value for a30
SQL> col name for a30
SQL> select name, value from v$asm_attribute where GROUP_NUMBER=5 and name like 'compatible%';

NAME                           VALUE
------------------------------ ------------------------------
compatible.asm                 12.2.0.1.0
compatible.rdbms               11.2.0.4.0
compatible.advm                12.2.0.1.0

dm01db01-+ASM1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.ACFS_DG.dg -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ACFS_DG.dg
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  OFFLINE      dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  OFFLINE      dm01db05                 STABLE
               ONLINE  OFFLINE      dm01db06                 STABLE
               ONLINE  OFFLINE      dm01db07                 STABLE
               ONLINE  OFFLINE      dm01db08                 STABLE
--------------------------------------------------------------------------------


Step II - Create ASM Volume

Click on Volumes

On Volumes page click on "Create"

On Create Volume page, specify:
    - Volumn name: acfsvol
    - Disk Group name: ACFS_DG
    - Size: 4927.56 (it can be anything based on your requirement from usable space avaialble.)
    - Click Ok


acfsvol creation is in progress

We can see our Volume created
  •  Verify newly created Volume as follows:
ASMCMD> volinfo --all
Diskgroup Name: ACFS_DG

         Volume Name: ACFSVOL
         Volume Device: /dev/asm/acfsvol-223
         State: ENABLED
         Size (MB): 5045824
         Resize Unit (MB): 64
         Redundancy: MIRROR
         Stripe Columns: 8
         Stripe Width (K): 1024
         Usage: ACFS
         Mountpath: /acfs_ogg


dm01db01-+ASM1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.ACFS_DG.ACFSVOL.advm -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ACFS_DG.ACFSVOL.advm
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
--------------------------------------------------------------------------------

dm01db01-+ASM1 {/home/oracle}:dcli -g ~/dbs_group -l oracle 'ls -l /dev/asm/*'
dm01db01: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
dm01db02: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
dm01db03: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
dm01db04: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
dm01db05: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
dm01db06: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
dm01db07: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223
dm01db08: brwxrwx--- 1 root asmdba 251, 114177 Mar 23 08:53 /dev/asm/acfsvol-223


III - Create ASM Cluster File system

Click on "ASM Cluster File Systems" on left pane


On ASM Cluster File Systems page click on "Create"

On Create ASM Cluster File System page, specify:
    - Type of ACFS: Cluster File System
    - Mount point: /acfs_ogg
    - Auto Mount: check
    - User Name: oracle
    - Group Name: oinstall
    - Description: acfs for OGG
    - Select Volume: ACFSVOL - /dev/asm/acfsvol-223 - 4927.5625G
    - Click Ok


ACFS creation in progress

Run the ACFS script on Node 1 only to register ACFS with Grid Infrastructure and to mount the ACFS file system.

  • Contents of ACFS script looks like this:
[root@dm01db01 ~]# cat /u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh | more
#!/bin/sh
/u01/app/12.2.0.1/grid/bin/srvctl add filesystem -d /dev/asm/acfsvol-223 -m /acfs_ogg -u oracle -fstype ACFS -

description 'acfs for OGG' -autostart ALWAYS
if [ $? = "0" -o $? = "2" ]; then
   /u01/app/12.2.0.1/grid/bin/srvctl start filesystem -d /dev/asm/acfsvol-223
   if [ $? = "0" ]; then
      chown oracle:oinstall /acfs_ogg
      chmod 775 /acfs_ogg
      /u01/app/12.2.0.1/grid/bin/srvctl status filesystem -d /dev/asm/acfsvol-223
      exit 0
   else
      exit $?
   fi
   /u01/app/12.2.0.1/grid/bin/srvctl status filesystem -d /dev/asm/acfsvol-223
fi

  • Execute the script
[root@dm01db01 ~]# /u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh
ACFS file system /acfs_ogg is mounted on nodes
dm01db01,dm01db02,dm01db03,dm01db04,dm01db05,dm01db06,dm01db07,dm01db08

Click Close on the Run ACFS script window

We can see our Volume created
  •  Verify newly created Volume as follows:
dm01db01-+ASM1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res ora.acfs_dg.acfsvol.acfs -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.acfs_dg.acfsvol.acfs
               ONLINE  ONLINE       dm01db01                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db02                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db03                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db04                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db05                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db06                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db07                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db08                 mounted on /acfs_ogg
                                                             ,STABLE
--------------------------------------------------------------------------------

dm01db01-+ASM1 {/home/oracle}:dcli -g ~/dbs_group -l oracle 'df -h /acfs_ogg'
dm01db01: Filesystem            Size  Used Avail Use% Mounted on
dm01db01: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db02: Filesystem            Size  Used Avail Use% Mounted on
dm01db02: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db03: Filesystem            Size  Used Avail Use% Mounted on
dm01db03: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db04: Filesystem            Size  Used Avail Use% Mounted on
dm01db04: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db05: Filesystem            Size  Used Avail Use% Mounted on
dm01db05: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db06: Filesystem            Size  Used Avail Use% Mounted on
dm01db06: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db07: Filesystem            Size  Used Avail Use% Mounted on
dm01db07: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg
dm01db08: Filesystem            Size  Used Avail Use% Mounted on
dm01db08: /dev/asm/acfsvol-223  4.9T   12G  4.9T   1% /acfs_ogg


dm01db01-orp258c1 {/home/oracle}:/u01/app/12.2.0.1/grid/bin/crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ACFS_DG.ACFSVOL.advm
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
ora.ACFS_DG.dg
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  OFFLINE      dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  OFFLINE      dm01db05                 STABLE
               ONLINE  OFFLINE      dm01db06                 STABLE
               ONLINE  OFFLINE      dm01db07                 STABLE
               ONLINE  OFFLINE      dm01db08                 STABLE
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
ora.DATA.ACFSVOL1.advm
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
ora.DATA.dg
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  OFFLINE      dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  OFFLINE      dm01db05                 STABLE
               ONLINE  OFFLINE      dm01db06                 STABLE
               ONLINE  OFFLINE      dm01db07                 STABLE
               ONLINE  OFFLINE      dm01db08                 STABLE
ora.DATA1.dg
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  OFFLINE      dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  OFFLINE      dm01db05                 STABLE
               ONLINE  OFFLINE      dm01db06                 STABLE
               ONLINE  OFFLINE      dm01db07                 STABLE
               ONLINE  OFFLINE      dm01db08                 STABLE
ora.DBFS_DG.dg
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               OFFLINE OFFLINE      dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               OFFLINE OFFLINE      dm01db05                 STABLE
               OFFLINE OFFLINE      dm01db06                 STABLE
               OFFLINE OFFLINE      dm01db07                 STABLE
               OFFLINE OFFLINE      dm01db08                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
ora.MGMT_DG.dg
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               OFFLINE OFFLINE      dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               OFFLINE OFFLINE      dm01db05                 STABLE
               OFFLINE OFFLINE      dm01db06                 STABLE
               OFFLINE OFFLINE      dm01db07                 STABLE
               OFFLINE OFFLINE      dm01db08                 STABLE
ora.acfs_dg.acfsvol.acfs
               ONLINE  ONLINE       dm01db01                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db02                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db03                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db04                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db05                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db06                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db07                 mounted on /acfs_ogg
                                                             ,STABLE
               ONLINE  ONLINE       dm01db08                 mounted on /acfs_ogg
                                                             ,STABLE
ora.chad
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
ora.data.acfsvol1.acfs
               ONLINE  ONLINE       dm01db01                 mounted on /acfs_ogg
                                                             1,STABLE
               ONLINE  ONLINE       dm01db02                 mounted on /acfs_ogg
                                                             1,STABLE
               ONLINE  ONLINE       dm01db03                 mounted on /acfs_ogg
                                                             1,STABLE
               ONLINE  ONLINE       dm01db04                 mounted on /acfs_ogg
                                                             1,STABLE
               ONLINE  ONLINE       dm01db05                 mounted on /acfs_ogg
                                                             1,STABLE
               ONLINE  ONLINE       dm01db06                 mounted on /acfs_ogg
                                                             1,STABLE
               ONLINE  ONLINE       dm01db07                 mounted on /acfs_ogg
                                                             1,STABLE
               ONLINE  ONLINE       dm01db08                 mounted on /acfs_ogg
                                                             1,STABLE
ora.net1.network
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
ora.ons
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
ora.proxy_advm
               ONLINE  ONLINE       dm01db01                 STABLE
               ONLINE  ONLINE       dm01db02                 STABLE
               ONLINE  ONLINE       dm01db03                 STABLE
               ONLINE  ONLINE       dm01db04                 STABLE
               ONLINE  ONLINE       dm01db05                 STABLE
               ONLINE  ONLINE       dm01db06                 STABLE
               ONLINE  ONLINE       dm01db07                 STABLE
               ONLINE  ONLINE       dm01db08                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       dm01db02                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       dm01db04                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       dm01db01                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       dm01db01                 192.168.2.1,STABLE
ora.asm
      1        ONLINE  ONLINE       dm01db01                 Started,STABLE
      2        ONLINE  ONLINE       dm01db02                 Started,STABLE
      3        ONLINE  ONLINE       dm01db04                 Started,STABLE
ora.dm01db01.vip
      1        ONLINE  ONLINE       dm01db01                 STABLE
ora.dm01db02.vip
      1        ONLINE  ONLINE       dm01db02                 STABLE
ora.dm01db03.vip
      1        ONLINE  ONLINE       dm01db03                 STABLE
ora.dm01db04.vip
      1        ONLINE  ONLINE       dm01db04                 STABLE
ora.dm01db05.vip
      1        ONLINE  ONLINE       dm01db05                 STABLE
ora.dm01db06.vip
      1        ONLINE  ONLINE       dm01db06                 STABLE
ora.dm01db07.vip
      1        ONLINE  ONLINE       dm01db07                 STABLE
ora.dm01db08.vip
      1        ONLINE  ONLINE       dm01db08                 STABLE
ora.cvu
      1        ONLINE  ONLINE       dm01db01                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       dm01db01                 Open,STABLE
ora.orcldb.db
      1        ONLINE  ONLINE       dm01db01                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      2        ONLINE  ONLINE       dm01db02                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      3        ONLINE  ONLINE       dm01db04                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      4        ONLINE  ONLINE       dm01db05                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      5        ONLINE  ONLINE       dm01db07                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      6        ONLINE  ONLINE       dm01db06                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      7        ONLINE  ONLINE       dm01db03                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      8        ONLINE  ONLINE       dm01db08                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
ora.prod.db
      1        ONLINE  ONLINE       dm01db01                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      2        ONLINE  ONLINE       dm01db02                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      3        ONLINE  ONLINE       dm01db04                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      4        ONLINE  ONLINE       dm01db05                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      5        ONLINE  ONLINE       dm01db07                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      6        ONLINE  ONLINE       dm01db06                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      7        ONLINE  ONLINE       dm01db03                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
      8        ONLINE  ONLINE       dm01db08                 Open,HOME=/u01/app/o
                                                             racle/product/12.2.0
                                                             .1/dbhome,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       dm01db01                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       dm01db02                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       dm01db04                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       dm01db01                 STABLE
--------------------------------------------------------------------------------


Conclusion:
In this article we have learned how to quickly configure ACFS on Exadata Database machine running Oracle 12.2.0.1 on ASM Flex Architecture.


Comparing Oracle Database Appliance X8-2 Model Family

September 2019 Oracle announced Oracle Database Appliance X8-2 (Small, Medium and HA). ODA X8-2 comes with more computing resources com...