Page last updated:
Enterprise PKS manages multiple Kubernetes clusters. Each cluster’s storage requirements depend on the size of the cluster and applications deployed. Detailed guidance on these storage requirements can be found in the Enterprise PKS Documentation.
VxRail for PRA includes vSAN, which is well applied to PKS needs per vSphere cluster, or in the stretched cluster approach (MVP2), vSAN Fault Domains. This will provide storage for the Enterprise PKS installation in each AZ but there’s one additional need for storage: stateful apps.
Enterprise PKS storage options to support stateful apps include:
- NFS, iSCSI or fiber channel datastores from external sources that is common to all clusters/host groups
vSAN currently does not support sharing datastores across vSphere clusters. As fail-over across availability zones is desired in the multiple cluster architecture, deploying external shared storage across those availability zones (nee vSphere clusters) such as NFS/iSCSI/FC for both static and dynamic persistent volume provisioning for stateful workloads is supported. Please refer to Enterprise PKS Documentation for the implementation details of persistent volume.
Pivotal recommends the following capacity allocation for PAS installations:
- For production use, at least 8 TB of data storage, either as one 8 TB store or a number of smaller volumes adding up to 8 TB. High churn or heavily used development foundations may require significantly more storage to accommodate new code and buildpacks.
- For small installations without many tiles, 4-6 TB may be suffice.
- The primary consumer of storage is the NFS/WebDAV blobstore included in PAS. This job can be externalized to a hardware or emulated software S3-compatible blob store (see below).
Dell EMC ECS object storage features a flexible software-defined architecture that provides the simplistic benefits of the public cloud without the risk, compliance, and data sovereignty concerns.
PRA can use the ECS platform as its blobstore location to store application code, buildpacks, and applications. The blobstore uses the S3 protocol and can be managed by ECS nodes. The ECS platform provides software-defined object storage that is designed for modern cloud-scale storage requirements.
With Dell EMC ECS, VMware recommends that you use unversioned buckets for file storage by clearing the Use versioning for backup and restore checkbox in the File Storage pane of the TAS for VMs tile. For information, see Step 3: Configure PAS File Storage in this Dell EMC ECS whitepaper. You can use mirroring as an alternative to versioning.
Virtustream Storage Cloud is a hyper-scale, enterprise-class, public cloud object storage platform, built for resiliency and performance. Virtustream provides a unique value proposition with enterprise-class off-premises primary and backup storage.
Pivotal provides an internal WebDAV blobstore that PAS uses to store persistent data. The PAS internal blobstore is deployed as a single virtual machine in PAS. It does not offer high availability but can be backed up using Pivotal BOSH Backup and Restore (BBR). It is designed for small, non-production deployments. For PAS production-level deployments, Dell EMC and Pivotal recommend using an external S3-compatible blobstore.