For a while now, Portainer has offered a unified management control point for Kubernetes - any Kubernetes, anywhere - but recently we have been asked specifically if we know of any concerns or considerations with a few named distros such as; MicroK8s, Talos, Openshift, KOs, K3s, Rancher and Amazon EKS. I thought I would try them all out and I also tried; Azure AKS, Amazon EKS, Google GKE, Civo Kubernetes, Digital Ocean Kubernetes, Linode Kubernetes, Vultr Kubernetes.
As anyone who knows Portainer is likely aware, we do not provide any Kubernetes distribution; we focus solely on the "configuration and consumption" side of Kubernetes. By that I mean we make it really easy for Ops to configure a cluster (authentication, access, quota, security policy etc), and for Users (Devs) to consume the cluster (deploy apps, triage apps, configure GitOps pipelines etc). This has been our focus because we believe that raw Kubernetes requires too much specialist knowledge to operate, and we want to make it easier and safer. As a byproduct of that focus we are required to work on top of many different Kubernetes distributions, from the smallest to the largest, from community-supported to enterprise-supported. You name it, we likely have a customer using it.
Anyway, while we do a degree of QA against the most common distros, we cannot possibly test Portainer against all of them.
I decided it would be an interesting experiment to spin up as many of the distributions as I could, especially all of the ones our customers and/or users have mentioned to us in passing. So this is what I have done.
I now have an instance of Portainer that is managing the self-hosted distros:
Of course, I also spun up and connected Portainer to:
though I tore these Cloud ones back down again after testing, because of the cost.
Running Portainer through its paces, I could use every single "Platform" feature, including our centralized user authentication and RBAC (creating users with corresponding roles and role bindings) in the managed clusters. I was able to enable advanced security for each cluster (which deploys and configures OPA Gatekeeper, with a number of pre-set policies). I was able to deploy and configure GitOps pipelines to each of the clusters using Portainer's integrated GitOps engine, and I was able to centrally access all of the clusters via Portainer's Kubernetes API proxy endpoint (meaning I did not need to expose the Kubernetes API externally on any of these clusters). I was able to view metrics and events, I was able to interact with the nodes to see cluster and node health, and I was able to do all of this from a single UI with a consistent UX regardless.
I would call that a win.
I plan to keep this environment running and add to the list as more distros become requested. I would also love to spin up VMware TKG, but its very big.
Are there any distros that I have not tested, and that you would like me to try out? Leave a comment and I will try it.
Neil
