NSX-T 3.0 with K8S – Where do I begin? This Cheat will get lab up and running Quickly!

There are three main focus areas to getting a NSX-T with K8S environment up and running with the following stages:

  1. Build out a vSphere environment with NSX-T 3.0 (vSphere 6.7 or 7.0 only at this time)
  2. Download and prep the VMware K8S environment without connection to NSX-T (Review Requirements capture below)
  3. Download NCP 3.0.1 version (Only that will work at the moment) and follow my defined steps outlined in this post)

https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.0/rn/NSX-Container-Plugin-301-Release-Notes.html

Step #1

Get the environment prepped according to recommendations stated above to ensure you have the vSphere & NSX-T environment built and running as to VMware recommended baseline for a lab (Many examples to reference if you google it or look on VMware site for NSX-T Setup and vSphere Setup

Step#2

Many ways to follow getting K8S VM environment located onto the vSphere and NSX-T built environment but this option will streamline and make the entire process very easy. Thank you Sergey Marunich!!! (Don’t need the AVI portion that can be disabled but such an easy way to get up and running fast!)

https://github.com/smarunich/curly-computing-machine

Step#3

Follow the steps identified below that I will have a follow up post later after I have all steps clearly documented (Don’t forget to download NCP 3.0.1 – NOT NCP 3.):

In an environment with Kubernetes already installed, installing and configuring NCP typically involve the following steps. To perform the steps successfully, you must be familiar with NSX-T Data Center and Kubernetes installation and administration.

  1. Install NSX-T Data Center. (Already Done in earlier steps)
  2. Create an overlay transport zone. (Should Already be Done in earlier steps)
  3. Create an overlay logical switch and connect the Kubernetes nodes to the switch.
  4. Create a tier-0 logical router.
  5. Create IP blocks for Kubernetes pods.
  6. Create IP pools for SNAT (source network address translation).
  7. Install NSX CNI (container network interface) plug-in on each node.
  8. Install OVS (Open vSwitch) on each node.
  9. Configure NSX-T networking for Kubernetes nodes.
  10. Install NSX node agent as a DaemonSet.
  11. Install NCP as a ReplicationController.
  12. Mount security certificates in the NCP pod.

https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.0/ncp-kubernetes/GUID-22D54FC5-4B06-4FE1-86A9-96A953FA15B9.html