4 Adding Oracle Exalytics In-Memory Machine to Your Network

This chapter describes how to connect the Oracle Exalytics In-Memory Machine to your existing network. It also describes how to configure the Oracle Exalytics In-Memory Machine using the configure_network_for_exalytics.sh script.

Note:

You must download the configure_network_for_exalytics.sh script from the edelivery site. Create a directory named exalytics in the /opt directory on your Oracle Exalytics In-Memory Machine and copy the script to this location. Run the script from this location.

It contains the following topics:

Section 4.1, "Before You Begin"
Section 4.2, "Overview of Network Ports"
Section 4.3, "Transceiver and Optical Modules for 10 GbE Connectivity"
Section 4.4, "Connecting Exalytics In-Memory Machine to Your Network"
Section 4.5, "Configuring the Network for Oracle Exalytics In-Memory Machine"
Section 4.6, "What Next?"

4.1 Before You Begin

Before connecting the Oracle Exalytics In-Memory Machine to your data center's existing network, ensure that the following prerequisites are satisfied:

Switch Requirements
Cable Requirements

4.1.1 Switch Requirements

Before connecting the Oracle Exalytics In-Memory Machine to your data center's network, complete the following preparatory tasks:

Identify the network switch or connector that you will use to connect the Oracle Exalytics In-Memory Machine to your network.
Identify the IP subnet and the address range associated with the network switch.

4.1.2 Cable Requirements

The following Ethernet cables are included in the Oracle Exalytics In-Memory Machine package:

One 10-feet (CAT5/CAT5E) red cable (part number: 530-4433-01)
One 10-feet (CAT5/CAT5E) black cable (part number: 530-4435-01)

You can use these cables to connect the Oracle Exalytics In-Memory Machine to your data center's network.

4.2 Overview of Network Ports

Figure 4-1 shows the network ports available on the Oracle Exalytics In-Memory Machine.

Figure 4-1 Network Ports on the Back of the Oracle Exalytics In-Memory Machine

Description of "Figure 4-1 Network Ports on the Back of the Oracle Exalytics In-Memory Machine "

In Figure 4-1, the four 10/100/1000 Gb Ethernet ports located on the rear of the Oracle Exalytics In-Memory Machine are shown in a red circle of dashed line. They are named NET 0, NET 1, NET 2, and NET 3.

Note:

Although you can use any of these Gb Ethernet ports, Oracle recommends that you use NET 2.

The ILOM 10/100 Ethernet port is shown in a blue circle of solid line. This port is named SER MGT.

4.3 Transceiver and Optical Modules for 10 GbE Connectivity

To use the 10 GbE network ports, you must provide Small Form-factor Pluggable Plus (SFP+) transceivers and/or cables (either optical or copper) to connect the network ports to your existing 10 GbE network infrastructure. The Oracle Exalytics In-Memory Machine does not ship with SFP+ transceivers or 10 GbE cables. You must purchase them separately.For copper cables, you can purchase the following cables from Oracle. These cables have built-in SFP+ transceivers, and there is no need to purchase separate SFP+ transceivers for the network ports on the Oracle Exalytics In-Memory Machine.

Table 4-1 Cables

Name	Length	Oracle Part Number
TwinAx 1m	1m	X2130-1M
TwinAx 3m	3m	X2130-3M
TwinAx 5m	5m	X2130-5M
TwinAx 10m	10m	X2130-10M

For optical cables, you must purchase SFP+ transceivers (either Short Range (SR) or Long Range (LR)) for each of the network ports, and then plug in the appropriate optical cable. Currently Oracle sells both the SR and LR SFP+ transceivers.

Table 4-2 Transceivers

Name	Part Number
10 GbE Transceiver SR (SFP+)	X2129A-N
10 GbE Transceiver LR (SFP+)	X5562A-Z

In addition to these transceivers, you must purchase the appropriate LC-LC terminated fiber optic cables from a third party vendor.

4.4 Connecting Exalytics In-Memory Machine to Your Network

To connect the Oracle Exalytics In-Memory Machine to your data center's network, complete the following steps:

Attach one end of the network cable to a Gb Ethernet port, such as NET 2 (see Figure 4-1).
Connect the other end of the cable to a network connector or switch, if the network is already set up in your building; or to a hub, for a client/server network.
Ensure that you have a laptop with functional USB and network ports.
Ensure that you have a Category 5E patch cable of maximum length 25 feet and a serial cable of maximum length 15 feet.
Connect the network port of your laptop into an unused input port in the network connector or switch. Do not connect to any management ports on the network connector or switch.
If you have not booted the operating system on your laptop, start the operating system now.
- If you are using the Windows operating system on your laptop, do the following:
  1. Go to Control Panel > Network Connections. Select your wired network adapter in the list of network connections, right-click and select Properties. The network properties screen is displayed.
  2. Click the General tab, and select Internet Protocol (TCP/IP). Click Properties. The Internet Protocol (TCP/IP) Properties screen is displayed.
  3. Select the Use the following IP address: option, and enter a static IP address for your laptop. Although a default gateway is not necessary, enter the same IP address in the Default Gateway field. Click OK to exit the network connections screen.
    
    Note:
    
    This static IP should be on the same subnet and address range as the network on which your data center's network switch or connector resides.
- If you are using a Linux operating system on your laptop, do the following:
  1. Log in as a root user.
  2. At the command prompt, enter the following command to display the network devices, such as ETH0, attached to the Oracle Exalytics In-Memory Machine:
    
    # ifconfig -a
    
    The list of network devices or adapters attached to the Oracle Exalytics In-Memory Machine is displayed.
  3. To set up the desired network interface, run the ifconfig command at the command prompt, as in the following example:
    
    # ifconfig eth0 192.0.2.10 netmask 255.255.255.0 up
    
    In this example, the ifconfig command assigns the IPv4 address 192.0.2.10, with a network mask of 255.255.255.0, to the eth0 interface.

4.5 Configuring the Network for Oracle Exalytics In-Memory Machine

This section describes how to use the configure_network_for_exalytics.sh script, which is located in the <path> directory, to configure the network for Oracle Exalytics In-Memory Machine.

It contains the following topics:

Overview
State of the Oracle Exalytics In-Memory Machine Before Running the Script
Running the configure_network_for_exalytics.sh Script
Verifying the Configuration

4.5.1 Overview

The configure_network_for_exalytics.sh script is used to configure the Oracle Exalytics In-Memory Machine after the initial operating system image is installed.

This script verifies the following:

When started, the script verifies that the user is root. Users other than root are not allowed to run the script.
It verifies that the Oracle Exalytics In-Memory Machine is installed with a 10 GbE Niantic card. If the card is not installed or the drivers are not configured, the script stops its execution.
It verifies connectivity to all gateways and hostnames configured in the session.

You can run the script to configure the following multiple interfaces:

InfiniBand (Mellanox card)
10 GbE Interfaces (Niantic card)
1 GbE Interfaces
Host Name
Time
Domain Name Server (DNS)

Note:

You cannot configure Fiber Channel using the configure_network_for_exalytics.sh script.

4.5.1.1 InfiniBand (Mellanox card)

The configure_network_for_exalytics.sh script optionally configures the InfiniBand network interface by bonding two InfiniBand interfaces. This interface is for IPoIB communication (bond0) intended for Oracle Exalytics In-Memory Machine's connectivity with Exalogic machine or Oracle Exadata Database Machine. You must specify an IP address and netmask for the script. A gateway address for this InfiniBand interface is not necessary.

When you configure InfiniBand using the configure_network_for_exalytics.sh script, the following files are updated:

/etc/sysconfig/network-scripts/ifcfg-ib*
/etc/sysconfig/network-scripts/ifcfg-bond0
/etc/modprobe.conf

Note:

The script keeps a copy of these files in the /tmp/exalytics.save/ directory and creates a flat backup for the files that may be modified.

4.5.1.2 10 GbE Interfaces (Niantic card)

The configure_network_for_exalytics.sh script verifies whether bonding is required on the 10 GbE interfaces. If you opt for bonding, the script configures the bonded interfaces using bond1 on all 10 GbE interfaces. For bond1 interface, the script requires an IP address, netmask, and gateway address.

If you do not opt for a bonded interface, the script verifies whether you want to configure each interface separately. You are prompted to enter an IP address, netmask, and gateway address for each individual interface configured.

When you configure 10 GbE interfaces using the configure_network_for_exalytics.sh script, the following files are updated:

/etc/sysconfig/network-scripts/ifcfg-eth*
/etc/sysconfig/network-scripts/ifcfg-bond1
/etc/modprobe.conf

Note:

The script keeps a copy of the interface files in the /tmp/exalytics.save/ directory and creates a flat backup for the files that may be modified.

4.5.1.3 1 GbE Interfaces

The configure_network_for_exalytics.sh script verifies whether bonding is required on the 1 GbE interfaces. If you opt for bonding, the script configures the bonded interfaces using bond2 on all 1 GbE interfaces. For bond2 interface, the script requires an IP address, netmask, and gateway address.

When you configure 1 GbE interfaces using the configure_network_for_exalytics.sh script, the following files are updated:

/etc/sysconfig/network-scripts/ifcfg-eth*
/etc/sysconfig/network-scripts/ifcfg-bond2
/etc/modprobe.conf

Note:

The script keeps a copy of the interface files in the /tmp/exalytics.save/ directory and creates a flat backup for the files that may be modified.

4.5.1.4 Host Name

The configure_network_for_exalytics.sh script optionally configures a host name and a domain name for your Oracle Exalytics In-Memory Machine. You cannot configure a domain name without configuring a host name.

The configured host name maps to an IP address in the following sequence:

The Last IP configured in this session.
If no IP configured, it will take the IP from first active interface from: bond1, bond2, …, eth5.
If no IP is found, then no IP is configured in the /etc/hosts file.

When you configure host name using the configure_network_for_exalytics.sh script, the following files are updated:

/etc/sysconfig/network
/etc/hosts

Note:

The script keeps a copy of the interface files in the /tmp/exalytics.save/ directory and creates a flat backup for the files that may be modified.

4.5.1.5 Time

The configure_network_for_exalytics.sh script optionally configures the time zone using the tzselect script. This script guides you to select a continent, country, and city using numbered menu selection. The script verifies whether a network time server should be configured. If you choose to configure a server, the script prompts you to enter the server name and other required information.

If you do not opt for time server configuration, the script prompts you to set time and date.

For network time server configuration, the script modifies the /etc/ntp.conf file, and it starts the ntpd daemon and adds it to start at boot.

For time zone selection, the script creates a new soft link to /etc/localtime.

Note:

The script keeps a copy of the interface files in the /tmp/exalytics.save/ directory and creates a flat backup for the files that may be modified.

4.5.1.6 Domain Name Server (DNS)

The configure_network_for_exalytics.sh script optionally configures one or more domain name servers that you specify.

When you configure domain name servers using the configure_network_for_exalytics.sh script, the following file is updated:

/etc/resolv.conf

Note:

The script keeps a copy of the interface files in the /tmp/exalytics.save/ directory and creates a flat backup for the files that may be modified.

4.5.2 State of the Oracle Exalytics In-Memory Machine Before Running the Script

Before running the configure_network_for_exalytics.sh script, your Oracle Exalytics In-Memory Machine is not configured with the following:

10 GbE and 1 GbE network interfaces
Optional InfiniBand network interfaces
Host name, domain name, and time zone
Time server and domain name servers
NET0 interface configured with IP 192.168.1.100.

4.5.3 Running the configure_network_for_exalytics.sh Script

Run the configure_network_for_exalytics.sh script, and choose your configuration option, as described in Table 4-3.

Table 4-3 configure_network_for_exalytics.sh Properties

Question/Parameter	Description
`Do you want to configure InfiniBand for Exadata connection? [y/n) [n]`	Enter `y` if you want to configure InfiniBand for connecting Oracle Exalytics In-Memory Machine to Oracle Exadata Database Machine.
`Enter bond0 IP address`	Enter a `bond0` IP address. For example, `192.168.21.12`.
`Use xx.xxx.xx.xx for bond0 ip address (y/n) [y]`	Verify the `bond0` IP address you specified, and enter `y`.
`Enter bond0 netmask address`	Enter a `bond0` netmask address. For example, `255.255.255.0`.
`Use xx.xxx.xxx.xx for bond0 netmask (y/n) [y]`	Verify the `bond0` netmask address you specified, and enter `y`.
`Do you want to configure 10G network(y/n) [n]`	Depending on your configuration option, enter `y` or `n`.
`Configure bonding on eth0 eth1 ? (y/n) [n]`	Depending on your configuration option, enter `y` or `n`.
`Configure eth0 Interface? (y/n) [n]`	Depending on your configuration option, enter `y` or `n`.
`Enter eth0 IP address`	Enter an `eth0` IP address. For example, `10.10.10.10`.
`Use xx.xxx.xx.xx for eth0 ip address (y/n) [y]`	Verify the `eth0` IP address you specified, and enter `y`.
`Enter etho0 netmask address`	Enter a netmask for the `eth0` interface. For example, `255.255.248.0`.
`Use xx.xxx.xxx.xx for eth0 netmask (y/n) [y]`	Verify the `eth0` netmask you specified, and enter `y`.
`Enter eth0 gateway address`	Enter the `eth0` gateway address. For example, `10.20.30.40`.
`Use xx.xxx.xxx.xx for eth0 gateway (y/n) [y]`	Verify the `eth0` gateway address you specified, and enter `y`.
`Configure eth1 Interface? (y/n) [n]`	Depending on your configuration option, enter `y` or `n`.
`Disable eth1`	Depending on your configuration option, enter `y` or `n`.
`Do you want to configure 1G network (y/n) [y]`	Depending on your configuration option, enter `y` or `n`.
`Configure bonding on eth2 eth3 eth4 eth5 ? (y/n) [n]: n`	Depending on your configuration option, enter `y` or `n`.
`Configure eth2 Interface? (y/n) [n]: y`	Depending on your configuration option, enter `y` or `n`.
`Enter eth2 IP address`	Enter an `eth2` IP address. For example, `10.10.10.11`.
`Use xx.x.x.xx for eth2 ip address (y/n) [y]: y`	Verify the `eth2` IP address you specified, and enter `y`.
`Enter eth2 netmask address`	Enter a netmask for the `eth2` interface. For example, `255.255.255.254`.
`Use xxx.xxx.xxx.xxx for eth2 netmask (y/n) [y]: y`	Verify the `eth2` netmask address you specified and then enter `y`.
`Enter eth2 gateway address`	Enter an `eth2` gateway address. For example, `10.1.1.1`.
`Use xx.x.x.x for eth2 gateway (y/n) [y]: y`	Verify the `eth2` gateway address you specified, and enter `y`.
`Configure eth3 Interface? (y/n) [n]: n`	Depending on your configuration option, enter `y` or `n`.
`Disable eth3`	Depending on your configuration option, enter `y` or `n`.
`Configure eth4 Interface? (y/n) [n]: n`	Depending on your configuration option, enter `y` or `n`.
`Disable eth4`	Depending on your configuration option, enter `y` or `n`.
`Configure eth5 Interface? (y/n) [n]: n`	Depending on your configuration option, enter `y` or `n`.
`Disable eth5`	Depending on your configuration option, enter `y` or `n`.
`Do you want to configure hostname (y/n) [n]: y`	Depending on your configuration option, enter `y` or `n`.
`Enter hostname`	Enter a hostname for the machine. For example, `myhost`.
`Use xxxxx for host_name (y/n) [y]: y`	Verify the hostname you specified, and enter `y`.
`Enter domainname:mydomain`	Enter a domain name. For example, `mydomain`.
`Use xxxxx in for domainname (y/n) [y]: y`	Verify the domain name you specified, and enter `y`.
`Do you want to configure timezone (y/n) [y]: y`	Depending on your configuration option, enter `y` or `n`.
`Please identify a location so that time zone rules can be set correctly.` Please select a continent or ocean.	Enter your location. For example, if your location is Americas, enter `2`.
`Please select a country.`	Enter your country. For example, if your country is United States, enter `47`.
`Please select one of the following time zone regions`	Enter your time zone. For example, if your time zone is Pacific time, enter `21`.
`The following information has been given: United States Pacific Time Therefore TZ='America/Los_Angeles' will be used. Local time is now: Thu Oct 20 07:19:36 PDT 2005. Universal Time is now: Thu Oct 20 14:19:36 UTC 2005. Is the above information OK?`	If the information is correct, enter `1`.
`Here is that TZ value again, this time on standard output so that you can use the /usr/bin/tzselect command in shell scripts: do you want to configure time server (y/n) [y]: y`	If you want to configure a time server, enter `y`.
`Enter network time server:10.162.39.1 Use 10.162.39.1 for timeserver (y/n) [y]: y Do you want to configure DNS(s) (y/n) [y]: y Enter DNS: 10.162.39.57 Use 10.162.39.57 for DNS (y/n) [y]: y configure another DNS? (y/n) [n]: n`	If you want to configure one or more domain name servers, enter `y`.
`Commit changes? (y/n) [n]: y`	To confirm your configuration options and values, enter `y`.

4.5.4 Verifying the Configuration

After the configure_network_for_exalytics.sh script runs successfully, you can verify the network configuration for your Oracle Exalytics In-Memory Machine machine as follows:

Ping 10 GbE network addresses to verify the 10 GbE network interfaces
Ping 1 GbE network addresses to verify the 1 GbE network interfaces
Run the ibstat command on the Oracle Exalytics In-Memory Machine to verify the InfiniBand network interface
Ping the gateway addresses
Ping an IP address of a machine that is in the same subnet as Oracle Exalytics In-Memory Machine for each of the interfaces
Verify the log file (/var/log/init-exalytics/init-exalytics.log)
Run the ifconfig -a command to verify the network configuration

4.6 What Next?

After configuring network for the Oracle Exalytics In-Memory Machine, you can proceed to install the Oracle Business Intelligence software on the machine. For more information, see the Oracle Fusion Middleware Installation and Administration Guide for Oracle Exalytics In-Memory Machine.

For information about installing Oracle Essbase, see Oracle Hyperion Enterprise Performance Management System Installation and Configuration Guide.