OpenShift Install OpenShift Data Foundation (ODF) using Multus network Isolation

You can check the earlier post regarding cluster setup

https://kdinesh.in/deployment-of-openshift-4-20-with-using-the-assistant-installer/

1.Install nm state operator

2. Install ODF operator

3. Configure odf network using NMState

4. Create a ODF storage cluster

Login to OpenShift. Left side menu, under Ecosystem, select Software Catalog.

Search nm state, Select Kubernetes NMState Operator

Click on Install.

Stick with the default configuration. Click on Install.

Once Installation is completed. Click on View Operator option.

Click on create NMState option.

Click on Create.

Once NMState is created. You can additionally network option in UI – Node network configuration, NodeNetworkConfigurationPolicy …etc.

Search Local Storage operator in software catalog. Select Local Storage.

Click on Install option.

Click on Install.

Search data foundation operator on software catalog.

Click on Install.

Click on Next.

Once data foundation operator installed. You can see Data Foundation option in UI.

Configure a Network for ODF

1. Public Odf network

Used for client-facing traffic

Carries I/O between:

• 1. Applications (PVCs)
  2. CSI drivers
  3. Ceph MONs and OSDs

Must be reachable from all OpenShift nodes

Requires routing if nodes span subnet

2. Cluster Network

Used for internal Ceph-to-Ceph traffic only

Carries:

• 1. Replication
  2. Backfill
  3. Recovery
  4. Rebalancing

No routing required to external networks

Usually isolated or high-bandwidth

Important: Every node requires its own dedicated IP. Make sure to set up the network on each node.

You can download yaml files from below link (Note : Update yaml file based you NIC names and IP, subnet)

https://github.com/Dineshk1205/ocp4.20/tree/main

After applying the configuration. You can check status in UI – Network > NodeNetworkConfigurationPolicy

Apply network configuration on remaining nodes.

Now. Bond1 configured. Next configure ODF public and cluster network

You can download yaml file using below links

https://github.com/Dineshk1205/ocp4.20/tree/main

Next run network test using a test tool

You can download rook using below link

https://access.redhat.com/articles/7014721

Note: Red Hat advised validating and running the network prior to creating an ODF storage cluster with Multus network isolation.

The test was completed successfully. Should there be any network problems, the test will not succeed.

Create a Storage Cluster

Click on Storage > Storage cluster > click on configure Data Foundation

Click on Create Storage Cluster

You can select Set Default Storage Class for Virtualization

Click on Next.

It will take few minutes to discover hosts on the nodes.

Enter Local Volume Set Name

Configure label to the storage nodes. I am using three nodes as a storage node

Click on Next

Click on yes.

Select Performance profile based on your requirements

Click on Next

Select Isolate network using Multus option

Due to bug in 4.20, Network selection option not working. We can use CLI to finish the storage creation.

You can download yaml file using below link and update details according to your disks

https://github.com/Dineshk1205/ocp4.20/blob/main/scluster.yaml

Stora cluster creation is in progress. It will take few minutes.

Storage Cluster creation completed successfully.

You can check the next post regarding the Virtualization configuration