Tips for Installing WCSites11gR1on Exalogic

This paper can be downloaded by clicking: Installing WebCenter Sites on Exalogic Ver1.0   Tips for Installing WebCenter Sites 11gR1 on Exalogic   Background: Recently I had the opportunity to install WebCenter Sites on Exalogic. Everything, including the database, was to be installed on the same Exalogic box. In this aspect the installation was different […]

Exalogic Virtual Tea Break Snippets – EATT Create Assembly OTD/WLS Cookbook

In the blog entry “Exalogic Virtual Tea Break Snippets – Create Assets Evolution” I described how the our asset / asssembley creation scripts had evolved to Python as a processing language and JSON as a file format. As part of that blog I briefly described the assembly configuration section and how it defines scripts that […]

Exalogic Virtual Tea Break Snippets – Create Assets Evolution

Following the success of the CreateAssets shell script and it’s subsequent merging into the SimpleExaCli script I decided to extend the features and leverage the full functionality of the 2.0.6.x (Echo) IaaS. As part of the revisit of the code a rewrite in python was performed and the primary reason for this was it allowed […]

Exalogic Virtual Tea Break Snippets – IaaS Utility vServer

Following a number of discussions around the SimpleExaCli Script and the ModifyLVM Script that are available from this blog site I decided to package the scripts and any future scripts within a simple Utility vServer that was then converted to a template using the SimpleExaCli script. The advantage of constructing this standard utility vServer is […]

Exalogic Virtual Tea Break Snippets – Creating Assets with the Simplified Exalogic Cli (A SimpleExaCli.sh Tutorial)

In a previous blog entry I described a script for creating assets (Distribution Groups, vServers, etc) but since that initial script I have written and blogged about the Simple Exalogic Cli Script and therefore have decided to write this short tutorial on the “–create-asset” command option. This version is expanded from it’s original release last […]

Exalogic Virtual Tea Break Snippets – Simplified Exalogic IaaS Cli

In previous blogs I have built and documented a number of extensions to the standard Exalogic IaaS Cli that either simplify the Cli usage or provide additional functionality. Following feedback from the various user I have enhanced and amalgamated a number of my scripts into a new single “SimpleExCli.sh”. In addition the SimpleExCli.sh script contains […]

Solaris on Exalogic – Transitive Probe-based Failure Detection

On Exalogic, no matter which supported Operating Systems that a compute node is running, it relies on the IB gateways (NM2-GW) to provide both internal (IPoIB) and external (EoIB) network connectivity. Each compute node is physically connected to two I…

Solaris on Exalogic – Reverse the active/pasive interface of an IPMP group

In a customer engagement, I found that that their bond0 and bond1 configurations look like this:

root@el01cn01:~# ipmpstat -i
INTERFACE   ACTIVE  GROUP       FLAGS     LINK      PROBE     STATE
eoib0       no      bond1       is—–   up        disabled  ok
eoib1       yes     bond1       –mb—   up        disabled  ok
bond0_0     yes     bond0       –mb—   up        disabled  ok
bond0_1     no      bond0       is—–   up        disabled  ok

notice that the active interface for bond1 is eoib1 while the active interface for bond0 is bond0_0

Although it is perfectly fine for the EoIB traffic and IPoIB traffic to go over different IB gateway, customer want like to re-configure it so that both type of traffic will go through the same IB gateway.

First of all, we turn on “standby” property for eoib1 and turn off “standby” property for eoib0 with the following commands:

root@el01cn01:~# ipadm set-ifprop -p standby=on -m ip eoib1
root@el01cn01:~# ipadm set-ifprop -p standby=off -m ip eoib0

The status of the IPMP groups look like this now:

root@el01cn01:~# ipmpstat -i
INTERFACE   ACTIVE  GROUP       FLAGS     LINK      PROBE     STATE
eoib0       yes     bond1       ——-   up        disabled  ok
eoib1       yes     bond1       -smb—   up        disabled  ok
bond0_0     yes     bond0       –mb—   up        disabled  ok
bond0_1     no      bond0       is—–   up        disabled  ok

Then we forced a failover by detaching eoib1 from bond1 with the following command:

root@el01cn01:~# if_mpadm -d eoib1

The status of the IPMP groups look like this now:

root@el01cn01:~# ipmpstat -i
INTERFACE   ACTIVE  GROUP       FLAGS     LINK      PROBE     STATE
eoib0       yes     bond1       –mb—   up        disabled  ok
eoib1       no      bond1       -s—d-   up        disabled  offline
bond0_0     yes     bond0       –mb—   up        disabled  ok
bond0_1     no      bond0       is—–   up        disabled  ok

Then we re-attach eoib1 back to bond1, because it is a standby interface, failback will not happen:

root@el01cn01:~# if_mpadm -r eoib1

That’s how it looks like after the re-configuration:

root@el01cn01:~# ipmpstat -i
INTERFACE   ACTIVE  GROUP       FLAGS     LINK      PROBE     STATE
eoib0       yes     bond1       –mb—   up        disabled  ok
eoib1       no      bond1       is—–   up        disabled  ok
bond0_0     yes     bond0       –mb—   up        disabled  ok
bond0_1     no      bond0       is—–   up        disabled  ok

Starting a cluster

Recently, I have been involved in a number of discussions with people who are setting up clusters of various Fusion Middleware products, often on an Exalogic machine.  These discussions have led me to feel that it would be worth sharing … Continue reading

InfiniBand Enabled Diskless PXE Boot

If you ever need to bring up a computer with InfiniBand networking
capabilities and diagnostic tools, without even going through any
installation on its hard disk, then please read on. In this article, I
am going to talk about how to boot a computer…

Configure IPoIB on Solaris 10 branded zone

Compute nodes in Exalogic communicate with each other and mount their shares from the ZFS storage appliance over the bond0 interface. Bond0 is a highly available network interface over the InfiniBand fabric using a portability layer called IPoIB that allows compute nodes and the storage appliance to communicate using TCP/IP protocol over InfiniBand.

In previous entry, we have created a Solaris 10 branded zone, obviously we would also like the branded zone to be able to mount shares from the ZFS storage appliance over IPoIB.

In this entry, I’ll show you the steps.

Create Solaris 10 Branded Zone on Exalogic

One of the reasons that customers choose to run Solaris 11 Express on Exalogic is the capability to create container. Container is a form of Operating System Virtualization that allows multiple operating system environments to coexist on a single system. Container not only allows user to run the same version of Solaris but it is also possible to create a container, also known as branded zone, to run previous Solaris version, such as Solaris 10. It is a very useful feature that enable customer to continue running applications that only certified on older OS version.

In this entry, I will show you the steps to create a Solaris 10 branded zone on Exalogic.

Deployments over InfiniBand Infrastructure

What actually drives network requirements ? Use of InfiniBand Partition
Keys to create isolation between functional groups of servers. Sample
use case illustrating how to design internal InfiniBand networks.
Application consolidations and their asso…

Bonding Parameters Based on Network Layout

Technical discussion on how to adjust Linux bonding configuration
parameters depending on how a host participates in a given network.
Limitations of link level failure detections and an easy solution within
bonding driver to overcome it.
[Read Mo…

Networks and Virtualization

Technical discussion on an approach to achieve virtualization through
network layers. Comparison between InfiniBand Partitions and Ethernet
VLANs. Consolidation and Isolation of logical network channels leading
to virtualization. How to satisfy com…

InfiniBand Building Blocks

In the context of Oracle’s Engineered Systems, I am going to explain how
an InfiniBand network is actually created using various building blocks
of hardware and software. Includes a very basic view of a host
participating in IB network and their con…

InfiniBand: What about it ?

Neeraj Gupta from our Networking team introduces Infiniband.
[Read More]