Upgrade Order for Tanzu Kubernetes Grid Integrated Edition Environments on vSphere

Page last updated:

This topic provides upgrade scenarios for Tanzu Kubernetes Grid Integrated Edition (TKGI) environments that are upgraded from v1.9 to v1.10 on vSphere.

Overview

When you upgrade TKGI on vSphere, you might also upgrade vSphere and, if you are using it, NSX‑T.

TKGI, NSX‑T, and vSphere upgrades depend on each other. Some combinations also require upgrading Ops Manager or TKGI-provisioned Kubernetes clusters.

For any combination of upgrades that you perform, you must follow the upgrade order described in this topic.

TKGI on vSphere with NSX‑T Networking

When upgrading a TKGI environment on vSphere with NSX‑T networking, you can choose to upgrade any of the following:

  • TKGI only, optionally including Kubernetes clusters
  • TKGI, Kubernetes clusters, and NSX‑T
  • TKGI, Kubernetes clusters, NSX‑T, and vSphere

For more information, see below:

To upgrade these components… Use this order… For more information, see…
TKGI
  1. Upgrade Ops Manager if necessary.
  2. Upgrade TKGI.
  3. (Recommended) Upgrade Kubernetes clusters.
 Upgrading to TKGI v1.10
TKGI and NSX‑T
  1. Upgrade NSX‑T.
  2. Upgrade Ops Manager if necessary.
  3. Upgrade TKGI.
  4. Upgrade Kubernetes clusters.
 Upgrading to TKGI v1.10 and NSX‑T v3.1
TKGI, NSX‑T, and vSphere
  1. Upgrade NSX‑T.
  2. Upgrade Ops Manager if necessary.
  3. Upgrade TKGI.
  4. Upgrade Kubernetes clusters.
  5. Upgrade vSphere.
 Upgrading to TKGI v1.10, NSX‑T v3.1, and vSphere v7.0

Warning: TKGI supports NSX‑T v3.0.1.2 (v3.0.1 EP2) and later patch versions of NSX‑T v3.0. It does not support NSX‑T v3.0.0, or v3.0.1.

For a list of NSX‑T and vSphere versions compatible with Tanzu Kubernetes Grid Integrated Edition v1.10, see:

Scenario 1: Upgrading to TKGI v1.10

In this upgrade scenario, you upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10 and do not upgrade your NSX‑T or vSphere infrastructure.

The upgrade scenario includes the following steps:

  1. Upgrade Ops Manager to v2.10.4 or later, or v2.9.15 or later. These are the recommended Ops Manager versions for Tanzu Kubernetes Grid Integrated Edition v1.10.0. To verify Ops Manager compatibility with other v1.10 versions, see VMware Tanzu Network.
  2. Upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10.
  3. (Recommended) Upgrade all Kubernetes clusters to Tanzu Kubernetes Grid Integrated Edition v1.10. This upgrades the NCP version of your clusters to 3.1.0.1.

See the table below for version information and instructions for this upgrade scenario:

Component Pre-upgrade version Post-upgrade version Instructions
TKGI 1.9 1.10 See Upgrading Tanzu Kubernetes Grid Integrated Edition (NSX‑T Networking).
Ops Manager 2.10.1, or 2.9.9 2.10.4 or 2.9.15 n/a

Scenario 2: Upgrading to TKGI v1.10 and NSX‑T v3.1

Warning: TKGI supports NSX‑T v3.0.1.2 (v3.0.1 EP2) and later patch versions of NSX‑T v3.0. It does not support NSX‑T v3.0.0, or v3.0.1.

In this upgrade scenario, you upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10 and NSX‑T from v2.5.0 or v2.5.1 to v3.0.1, v3.0.2 or v3.1.0.

The upgrade scenario includes the following steps:

  1. If upgrading to NSX-T v3.1.0, note the current DRS mode setting, then change DRS mode to Manual. For more information, see Pods Stop After Upgrading From NSX-T v3.0.2 to v3.1.0 in the Tanzu Kubernetes Grid Integrated Edition Release Notes.
  2. Upgrade NSX‑T from v2.5.0 or v2.5.1 to v3.0.1, v3.0.2 or v3.1.0.
  3. If you set DRS mode to Manual above, restore DRS to its original setting.
  4. Upgrade Ops Manager to v2.10.4 or later, or v2.9.15 or later. These are the recommended Ops Manager versions for Tanzu Kubernetes Grid Integrated Edition v1.10.0. To verify Ops Manager compatibility with other v1.10 versions, see VMware Tanzu Network.
  5. Upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10.
  6. Upgrade all Kubernetes clusters to Tanzu Kubernetes Grid Integrated Edition v1.10. This upgrades the NCP version of your clusters to 3.1.0.1.

See the table below for version information and instructions for this upgrade scenario:

Component Pre-upgrade version Post-upgrade version Instructions
TKGI 1.9 1.10 See Upgrading Tanzu Kubernetes Grid Integrated Edition (NSX‑T Networking).
Ops Manager 2.10.1 or 2.9.9 2.10.4 or later, or 2.9.15 or later n/a
NSX‑T 3.0.0 or 2.5.0 or later 3.1.0 or later, or 3.0.1 or later See Upgrade NSX‑T Data Center to v3.0 or v3.1 in Upgrading Tanzu Kubernetes Grid Integrated Edition (NSX‑T Networking).
NCP 3.0.2.1 3.1.0.1 n/a

Scenario 3: Upgrading to TKGI v1.10, NSX‑T v3.1, and vSphere v7.0

Warning: TKGI supports NSX‑T v3.0.1.2 (v3.0.1 EP2) and later patch versions of NSX‑T v3.0. It does not support NSX‑T v3.0.0, or v3.0.1.

In this upgrade scenario, you upgrade:

  • Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10
  • NSX‑T from v2.5.0, v2.5.1 or v2.5.2 to v3.0.1, v3.0.2 or v3.1.0.
  • vSphere from v6.5 or v6.7 to v7.0

The upgrade scenario includes the following steps:

  1. If upgrading to NSX-T v3.1.0, note the current DRS mode setting, then change DRS mode to Manual. For more information, see Pods Stop After Upgrading From NSX-T v3.0.2 to v3.1.0 in the Tanzu Kubernetes Grid Integrated Edition Release Notes.
  2. Upgrade NSX‑T from v2.5.0, v2.5.1 or v2.5.2 to v3.0.1, v3.0.2 or v3.1.0.
  3. If you set DRS mode to Manual above, restore DRS to its original setting.
  4. Upgrade Ops Manager to v2.10.4 or later, or v2.9.15 or later. These are the recommended Ops Manager versions for Tanzu Kubernetes Grid Integrated Edition v1.10.0. To verify Ops Manager compatibility with other v1.10 versions, see VMware Tanzu Network.
  5. Upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10.
  6. Upgrade all Kubernetes clusters to Tanzu Kubernetes Grid Integrated Edition v1.10. This upgrades the NCP version of your clusters to 3.1.0.1.
  7. Upgrade vSphere from v6.5 or v6.7 to v7.0.

See the table below for version information and instructions for this upgrade scenario:

Component Pre-upgrade version Post-upgrade version Instructions
TKGI 1.9 1.10 See Upgrading Tanzu Kubernetes Grid Integrated Edition (NSX‑T Networking).
Ops Manager 2.10.1, or 2.9.9 2.10.4 or 2.9.15 n/a
NSX‑T 3.0.2, 3.0.1.1, 3.0.0, 2.5.2, 2.5.1 or 2.5.0 3.1.0 or later, 3.0.2 or later, or 3.0.1 or later See Upgrade NSX‑T Data Center to v3.0 or v3.1 in Upgrading Tanzu Kubernetes Grid Integrated Edition (NSX‑T Networking).
NCP 3.0.2.1 3.1.0.1 n/a
vSphere 6.7 or 6.5 7.0

See the vSphere documentation:

  1. Upgrading the vCenter Server Appliance
  2. Upgrading ESXi Hosts
Also, see Overview of the vSphere Upgrade Process.

TKGI on vSphere with Flannel Networking

When upgrading a Tanzu Kubernetes Grid Integrated Edition environment on vSphere with Flannel networking, you can choose to upgrade any of the following:

  • TKGI only, optionally including Kubernetes clusters
  • TKGI, Kubernetes clusters, and vSphere

For more information, see below:

To upgrade these components… Use this order… For more information, see…
TKGI
  1. Upgrade Ops Manager if necessary.
  2. Upgrade TKGI.
  3. (Recommended) Upgrade Kubernetes clusters.
 Upgrading to TKGI v1.10
TKGI and vSphere
  1. Upgrade Ops Manager if necessary.
  2. Upgrade TKGI.
  3. Upgrade Kubernetes clusters.
  4. Upgrade vSphere.
 Upgrading to TKGI v1.10 and vSphere v7.0

For a list of vSphere versions compatible with Tanzu Kubernetes Grid Integrated Edition v1.10, see VMware Product Interoperability Matrices.

Scenario 1: Upgrading to TKGI v1.10

In this upgrade scenario, you upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10 and do not upgrade your vSphere infrastructure.

The upgrade scenario includes the following steps:

  1. Upgrade Ops Manager to v2.10.4 or later, or v2.9.15 or later. These are the recommended Ops Manager versions for Tanzu Kubernetes Grid Integrated Edition v1.10.0. To verify Ops Manager compatibility with other v1.10 versions, see VMware Tanzu Network.
  2. Upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10.
  3. (Recommended) Upgrade all Kubernetes clusters to Tanzu Kubernetes Grid Integrated Edition v1.10. This upgrades the NCP version of your clusters to 3.1.0.1.

See the table below for version information and instructions for this upgrade scenario:

Component Pre-upgrade version Post-upgrade version Instructions
TKGI 1.9 1.10 See Upgrading Tanzu Kubernetes Grid Integrated Edition (Flannel Networking).
Ops Manager 2.10.1 or 2.9.9 2.10.4 or 2.9.15 n/a
vSphere 7.0, 6.7 or 6.5 7.0, 6.7 or 6.5 n/a

Scenario 2: Upgrading to TKGI v1.10 and vSphere v7.0

In this upgrade scenario, you upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10 and vSphere from v6.5 or v6.7 to v7.0.

The upgrade scenario includes the following steps:

  1. Upgrade Ops Manager to v2.10.4 or later, or v2.9.15 or later. These are the recommended Ops Manager versions for Tanzu Kubernetes Grid Integrated Edition v1.10.0. To verify Ops Manager compatibility with other v1.10 versions, see VMware Tanzu Network.
  2. Upgrade Tanzu Kubernetes Grid Integrated Edition from v1.9 to v1.10.
  3. Upgrade all Kubernetes clusters to Tanzu Kubernetes Grid Integrated Edition v1.10. This upgrades the NCP version of your clusters to 3.1.0.1.
  4. Upgrade vSphere from v6.5 or v6.7 to v7.0.

See the table below for version information and instructions for this upgrade scenario:

Component Pre-upgrade version Post-upgrade version Instructions
TKGI 1.9 1.10 See Upgrading Tanzu Kubernetes Grid Integrated Edition (Flannel Networking).
Ops Manager 2.10.1 or 2.9.9 2.10.4 or 2.9.15 n/a
vSphere 6.7 or 6.5 7.0

See the vSphere documentation:

  1. Upgrading the vCenter Server Appliance
  2. Upgrading ESXi Hosts
Also, see Overview of the vSphere Upgrade Process.

Please send any feedback you have to pks-feedback@pivotal.io.