Creating the PKS Compute Plane

Page last updated:

This section provides instructions for preparing the vSphere and NSX-T infrastructure for the PKS Compute Plane where Kubernetes clusters run.

Prerequisites

Before you begin this procedure, ensure that you have successfully completed all preceding steps for installing Enterprise PKS on vSphere with NSX-T, including:

About the PKS Control Plane

Installing Enterprise Pivotal Container Service (Enterprise PKS) on vSphere with NSX-T requires the creation of vSphere resource pools that map to BOSH availability zones where Kubernetes VMs will run, as well as NSX IP blocks for Kubernetes node and pod networks, and a Floating IP Pool from which you can assign routable IP addresses to cluster resources.

Create separate NSX-T IP Blocks for the node networks and the pod networks. The subnets for both nodes and pods should have a size of 256 (/16). For more information, see Plan IP Blocks and Reserved IP Blocks.

  • NODE-IP-BLOCK is used by Enterprise PKS to assign address space to Kubernetes master and worker nodes when new clusters are deployed or a cluster increases its scale.
  • POD-IP-BLOCK is used by the NSX-T Container Plug-in (NCP) to assign address space to Kubernetes pods through the Container Networking Interface (CNI).

In addition, create a Floating IP Pool from which to assign routable IP addresses to components. This network provides your load balancing address space for each Kubernetes cluster created by Enterprise PKS. The network also provides IP addresses for Kubernetes API access and Kubernetes exposed services. For example, 10.172.2.0/24 provides 256 usable IPs. This network is used when creating the virtual IP pools, or when the services are deployed. You enter this network in the Floating IP Pool ID field in the Networking pane of the Enterprise PKS tile.

Step 1: Create vSphere Resource Pools for Kubernetes Cluster Nodes

Step 1: Create vSphere Resource Pool for AZ-1

  1. Log in to vCenter for your vSphere environment.
  2. Select Compute Cluster > New Resource Pool.
  3. Name the resource pool, such as RP-PKS-AZ-1.
  4. Click OK and verify resource pool creation:

Step 2: Create vSphere Resource Pool for AZ-N

  1. Log in to vCenter for your vSphere environment.
  2. Select Compute Cluster > New Resource Pool.
  3. Name the resource pool, such as RP-PKS-AZ-2.
  4. Click OK and verify resource pool creation:

Create NSX-T Objects for Kubernetes Nodes and Pods

Complete the following instructions to create the required NSX-T network objects.

Create the Nodes IP Block

  1. In NSX Manager, go to Advanced Networking & Security > Networking > IPAM.

  2. Add a new IP Block for Kubernetes Nodes. For example:

    • Name: NODES-IP-BLOCK
    • CIDR: 192.168.0.0/16
  3. Verify creation of the Nodes IP Block.

  4. Record the UUID of the Nodes IP Block object. You use this UUID when you install Enterprise PKS with NSX-T.

Create the Pods IP Block

  1. In NSX Manager, go to Advanced Networking & Security > Networking > IPAM.

  2. Add a new IP Block for Pods. For example:

    • Name: PKS-PODS-IP-BLOCK
    • CIDR: 172.16.0.0/16
  3. Verify creation of the Pods IP Block.

  4. Record the UUID of the Pods IP Block object. You use this UUID when you install Enterprise PKS with NSX-T.

Create a Floating IP Pool

  1. In NSX Manager, go to Advanced Networking & Security > Inventory > Groups > IP Pool.

  2. Add a new Floating IP Pool. For example:

    • Name: PKS-FLOATING-IP-POOL
    • IP Ranges: 10.40.14.10 - 10.40.14.253
    • Gateway: 10.40.14.254
    • CIDR: 10.40.14.0/24
  3. Verify creation of the Nodes IP Block.

  4. Get the UUID of the Floating IP Pool object. You use this UUID when you install Enterprise PKS with NSX-T.

Next Step

After you complete this procedure, follow the instructions in Deploying Ops Manager with NSX-T for Enterprise PKS.


Please send any feedback you have to pks-feedback@pivotal.io.