2- Patch Exadata RoCE and Cisco Management Switches
Pre-Checks & Patch Application Guide
This is part 2/5 of Exadata Patch, when performing Exadata infrastructure patching, RoCE switches and management switches are often overlooked — but they are critical to maintaining optimal performance and high availability. Below is a step-by-step guide for pre-checks and patching of RoCE and Admin switches, following Oracle’s official guidance and best practices.
References You Must Review Before Proceeding
Before starting, always consult the official Oracle documentation and support resources to ensure compatibility and awareness of any known issues:
- Updating Exadata Software – Oracle Documentation:
https://docs.oracle.com/en/engineered-systems/exadata-database-machine/dbmmn/updating-exadata-software.html - Imaging a New System – Oracle Documentation:
https://docs.oracle.com/en/engineered-systems/exadata-database-machine/dbmin/configuring-exadata.html - MOS Note 888828.1 – For the latest patching issues and known workarounds.
- Patch: 36500722 (23.1.13.0.0 release) – Always verify the latest patch version applicable to your environment.
RoCE Switches Upgrade (Patch Version: 24.1.2.0.0.240711)
Step 1: Verify Targeted RoCE Switches
Defines the RoCE switches in a file, ensure correct hostnames and roles (leaf or spine) are accurately specified.
I kept my RoCE switches in the file below
cat /EXAVMIMAGES/patches/stage/roceswitches.lst
exaprd01sw-rocea0:leaf
exaprd01sw-roceb0:leaf
Step 2: Run Pre-Check
The --roceswitch-precheck flag ensures your environment and the switches are ready for patching.
cd /${PATCH_LOCATION}/roceswitches/patch_switch_24.1.2.0.0.240711
./patchmgr --roceswitches /EXAVMIMAGES/patches/stage/roceswitches.lst \
--upgrade --roceswitch-precheck --log_dir auto
Fix any errors before proceeding.
Step 3: Apply the RoCE Switch Patch
Start a screen session to ensure process continuity in case of terminal disconnection:
screen -S Sw_RoCE_patch
./patchmgr --roceswitches roceswitches.lst --upgrade --log_dir auto
Note: The use of screen allows you to detach safely from the terminal during long-running operations.
Cisco Management Switch Upgrade
Typically, the admin switch manages ILOM/management connections and is vital for overall system visibility.
Step 1: Verify Targeted Cisco Switch
cat /EXAVMIMAGES/patches/stage/adminswitch.lst
exa-Ciscosw-adm0
Step 2: Run Pre-Check
Always run pre-checks to validate switch readiness, configuration backup, and firmware compatibility.
./patchmgr --adminswitches /EXAVMIMAGES/patches/stage/adminswitch.lst \
--upgrade --<strong>adminswitch-precheck</strong> --log_dir auto
Step 3: Apply the Cisco Admin Switch Patch
screen -S Mngmnt_SW
./patchmgr --adminswitches adminswitch.lst --<strong>upgrade</strong> --log_dir auto
Note: Again, use screen to prevent session drops. Ensure logging is enabled to review post-patch results.
Final Tips:
Network Connectivity Check: Always validate the switch health post-patch using ipmitool, ping tests, or Cisco CLI.
Log Review: Collect and archive the patch logs (/var/opt/oracle/log/patchmgr) for auditing and rollback if needed.
Redundancy Check: Verify that dual RoCE switch connections are operational and traffic has returned to normal paths.
🔖 Next: Part 1/5 – Oracle Exadata Patching (Oracle Homes)
🔖 Next: Part 2/5 – Oracle Exadata Patching (RoCE Switches)
🔖 Next: Part 3/5 – Oracle Exadata Patching (Cell Storage)
🔖 Next: Part 4/5 – Oracle Exadata Patching (KVM Host)
🔖 Next: Part 5/5 – Oracle Exadata Patching (KVM Guest)
